-- Logs begin at Thu 2022-09-29 01:29:39 UTC, end at Thu 2022-09-29 02:34:12 UTC. -- Sep 29 01:56:59.200180 dv-cinder-740146-21-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 29 01:56:59.208876 dv-cinder-740146-21-smb devstack@keystone.service[81638]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 29 01:56:59.210864 dv-cinder-740146-21-smb devstack@keystone.service[81638]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 29 01:56:59 2022] *** Sep 29 01:56:59.210864 dv-cinder-740146-21-smb devstack@keystone.service[81638]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 29 01:56:59.210864 dv-cinder-740146-21-smb devstack@keystone.service[81638]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 29 01:56:59.210864 dv-cinder-740146-21-smb devstack@keystone.service[81638]: nodename: dv-cinder-740146-21-smb Sep 29 01:56:59.210864 dv-cinder-740146-21-smb devstack@keystone.service[81638]: machine: x86_64 Sep 29 01:56:59.210864 dv-cinder-740146-21-smb devstack@keystone.service[81638]: clock source: unix Sep 29 01:56:59.210864 dv-cinder-740146-21-smb devstack@keystone.service[81638]: pcre jit disabled Sep 29 01:56:59.210864 dv-cinder-740146-21-smb devstack@keystone.service[81638]: detected number of CPU cores: 4 Sep 29 01:56:59.210864 dv-cinder-740146-21-smb devstack@keystone.service[81638]: current working directory: / Sep 29 01:56:59.210864 dv-cinder-740146-21-smb devstack@keystone.service[81638]: detected binary path: /usr/bin/uwsgi-core Sep 29 01:56:59.211370 dv-cinder-740146-21-smb devstack@keystone.service[81638]: your processes number limit is 47680 Sep 29 01:56:59.211370 dv-cinder-740146-21-smb devstack@keystone.service[81638]: your memory page size is 4096 bytes Sep 29 01:56:59.211370 dv-cinder-740146-21-smb devstack@keystone.service[81638]: detected max file descriptor number: 2048 Sep 29 01:56:59.211370 dv-cinder-740146-21-smb devstack@keystone.service[81638]: lock engine: pthread robust mutexes Sep 29 01:56:59.211370 dv-cinder-740146-21-smb devstack@keystone.service[81638]: thunder lock: enabled Sep 29 01:56:59.211370 dv-cinder-740146-21-smb devstack@keystone.service[81638]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 29 01:56:59.211370 dv-cinder-740146-21-smb devstack@keystone.service[81638]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 29 01:56:59.250878 dv-cinder-740146-21-smb devstack@keystone.service[81638]: Python main interpreter initialized at 0x55b1dd1eb9c0 Sep 29 01:56:59.250878 dv-cinder-740146-21-smb devstack@keystone.service[81638]: python threads support enabled Sep 29 01:56:59.250878 dv-cinder-740146-21-smb devstack@keystone.service[81638]: your server socket listen backlog is limited to 100 connections Sep 29 01:56:59.250878 dv-cinder-740146-21-smb devstack@keystone.service[81638]: your mercy for graceful operations on workers is 90 seconds Sep 29 01:56:59.251216 dv-cinder-740146-21-smb devstack@keystone.service[81638]: mapped 403077 bytes (393 KB) for 2 cores Sep 29 01:56:59.251295 dv-cinder-740146-21-smb devstack@keystone.service[81638]: *** Operational MODE: preforking *** Sep 29 01:56:59.251558 dv-cinder-740146-21-smb devstack@keystone.service[81638]: *** uWSGI is running in multiple interpreter mode *** Sep 29 01:56:59.251558 dv-cinder-740146-21-smb devstack@keystone.service[81638]: spawned uWSGI master process (pid: 81638) Sep 29 01:56:59.251754 dv-cinder-740146-21-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 29 01:56:59.253089 dv-cinder-740146-21-smb devstack@keystone.service[81638]: spawned uWSGI worker 1 (pid: 81648, cores: 1) Sep 29 01:56:59.253089 dv-cinder-740146-21-smb devstack@keystone.service[81638]: spawned uWSGI worker 2 (pid: 81649, cores: 1) Sep 29 01:56:59.253089 dv-cinder-740146-21-smb devstack@keystone.service[81638]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 29 01:57:03.552608 dv-cinder-740146-21-smb devstack@keystone.service[81649]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 29 01:57:03.552608 dv-cinder-740146-21-smb devstack@keystone.service[81649]: from cryptography.utils import int_from_bytes Sep 29 01:57:03.553440 dv-cinder-740146-21-smb devstack@keystone.service[81649]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 29 01:57:03.553440 dv-cinder-740146-21-smb devstack@keystone.service[81649]: from cryptography.utils import int_from_bytes Sep 29 01:57:03.553912 dv-cinder-740146-21-smb devstack@keystone.service[81648]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 29 01:57:03.553912 dv-cinder-740146-21-smb devstack@keystone.service[81648]: from cryptography.utils import int_from_bytes Sep 29 01:57:03.554377 dv-cinder-740146-21-smb devstack@keystone.service[81648]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 29 01:57:03.554377 dv-cinder-740146-21-smb devstack@keystone.service[81648]: from cryptography.utils import int_from_bytes Sep 29 01:57:03.603240 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 29 01:57:03.603411 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 29 01:57:03.603601 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] command line args: [] {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 29 01:57:03.603866 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 29 01:57:03.603944 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 29 01:57:03.604041 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ================================================================================ {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 29 01:57:03.604125 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 29 01:57:03.604238 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] command line args: [] {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 29 01:57:03.604315 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] admin_token = **** {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:03.604511 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 29 01:57:03.604595 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] config_dir = [] {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:03.604672 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] ================================================================================ {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 29 01:57:03.604750 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:03.604858 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] config_source = [] {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:03.604941 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] admin_token = **** {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:03.605020 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] debug = True {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:03.605164 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] config_dir = [] {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:03.605241 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:03.605495 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:03.605565 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] config_source = [] {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:03.605627 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:03.605759 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] debug = True {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:03.605859 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:03.605974 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:03.606099 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:03.606194 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:03.606286 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:03.606391 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:03.606493 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] list_limit = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:03.606593 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:03.606687 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] log_config_append = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:03.606786 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:03.606890 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:03.606984 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] log_dir = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:03.607084 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] list_limit = None {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:03.607178 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] log_file = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:03.607298 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] log_config_append = None {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:03.607399 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:03.607500 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:03.607500 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] log_dir = None {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:03.607688 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:03.607806 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] log_file = None {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:03.607880 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:03.607993 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:03.608067 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:03.608190 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:03.608275 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:03.608349 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:03.608471 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:03.608545 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:03.608659 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:03.608742 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:03.608813 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:03.608936 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:03.609017 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:03.609122 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:03.609212 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:03.609389 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:03.609470 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:03.609628 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:03.609747 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:03.609860 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:03.609944 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:03.610092 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:03.610176 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:03.610323 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:03.610401 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:03.610568 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:03.610813 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:03.610897 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.49/identity {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:03.611017 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] publish_errors = False {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:03.611095 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:03.611215 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:03.611441 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:03.611603 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.49/identity {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:03.611738 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:03.612314 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] publish_errors = False {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:03.612449 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:03.612573 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:03.612682 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:03.612808 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:03.612902 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] standard_threads = False {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:03.612984 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:03.613135 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:03.613213 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:03.613392 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:03.613473 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:03.613555 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:03.613691 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] standard_threads = False {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:03.613775 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] use_journal = False {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:03.613893 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] use_json = False {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:03.613968 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:03.614087 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] use_stderr = False {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:03.614217 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:03.614291 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] use_syslog = False {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:03.614361 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:03.614430 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:03.614499 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] use_journal = False {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:03.614641 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] use_json = False {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:03.614729 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.614808 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] use_stderr = False {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:03.614906 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.614984 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] use_syslog = False {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:03.615162 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.615245 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 01:57:03.615398 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.615476 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.615643 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.615727 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.615878 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.615956 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.616123 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.616201 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.616354 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.616443 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.616601 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.616721 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.616840 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.616928 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.617075 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.617151 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.617305 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.617410 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.617573 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.617652 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.617808 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.617885 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.618043 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.618138 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.618287 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.618365 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.618520 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.618595 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.618767 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.618844 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.619013 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.619096 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.619246 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.619327 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.619478 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.619635 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.619730 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.619808 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.619973 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.620054 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.620212 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.620296 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.620454 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.620536 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.620683 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.620760 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.620910 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.621000 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.621137 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.621215 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.621390 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.621471 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.621638 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.621734 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.621867 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.621942 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.622096 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.622171 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.622323 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.622407 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.622566 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.622644 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.622794 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.622875 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.623025 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.623109 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.623267 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.623349 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.623496 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.623573 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.623727 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.623811 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.623959 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.624035 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.624185 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.624266 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.624411 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.624497 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.624637 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.624720 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.624864 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.624940 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.625094 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.625262 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.625386 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.625460 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.625565 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.625644 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.625798 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.625882 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.626024 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.626101 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.626256 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.626333 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.626488 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.626575 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.626721 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.626797 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.626947 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.627022 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.627180 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.627317 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.627555 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.627632 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.627962 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.628052 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.628113 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.628180 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.628239 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.628407 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.628520 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.628630 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.628711 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.628878 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.628964 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.629111 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.629203 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.629367 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.629471 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.629598 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.629677 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.629856 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.629939 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.630087 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.630215 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.630300 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.630428 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.630535 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.630619 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.630767 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.630844 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.631011 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.631095 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.631246 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.631324 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.631488 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.631568 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.631732 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.631864 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.631951 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.632024 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.632158 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.632273 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.632387 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.632474 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.632632 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.632711 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.632866 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.632946 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.633096 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.633220 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.633358 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.633481 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.633620 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.633711 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.633839 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.633925 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.634071 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.634150 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.634302 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.634378 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.634533 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.634619 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.634765 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.634848 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.634996 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.635073 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.635248 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.635373 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.635452 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.635568 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.635705 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.635782 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.635942 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.636027 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.636160 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.636241 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.636400 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.636477 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.636633 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.636789 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.636864 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.636935 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.637085 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.637164 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.637327 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.637419 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.637562 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.637642 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.637790 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.637867 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.638017 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.638093 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.638244 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.638322 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.638477 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.638554 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.638708 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.638785 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.638948 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.639026 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.639181 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.639265 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.639429 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.639519 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.639664 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.639743 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.639903 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.639980 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.640132 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] auth.external = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.640238 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.640362 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.640448 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.640606 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] auth.external = None {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.640691 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.640841 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.640919 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.641088 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] auth.password = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.641165 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.641333 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] auth.token = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.641415 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.641577 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.641655 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] auth.password = None {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.641811 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.641892 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] auth.token = None {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.642050 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.642129 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.642276 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.642353 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.642521 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.642603 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.642750 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.642875 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.643033 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.643112 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.643281 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.643388 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] credential.caching = True {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.643506 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.643630 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.643740 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] credential.caching = True {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.643870 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.643985 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.644115 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.644233 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.644355 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.644481 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.644596 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.644723 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.644831 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.644967 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.645075 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.645204 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.645340 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.645474 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.645580 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.645729 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.645848 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.645968 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.646099 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.646220 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.646344 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.646501 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.646605 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.646753 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.646838 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.647015 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.647094 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.647258 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.647338 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] federation.caching = True {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.647513 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.647592 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.647749 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] federation.caching = True {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.647827 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.647985 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.648065 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.648211 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.648288 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.648455 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.648540 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.648684 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.648761 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.648929 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.649012 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.649163 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.649251 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.649437 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.649517 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.649673 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.649761 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.649920 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.650006 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.650157 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.650234 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] identity.caching = True {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.650400 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.650477 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.650635 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] identity.caching = True {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.650788 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.650866 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.650936 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.651092 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.651171 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.651337 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.651427 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.651565 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.651644 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.651811 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.651897 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.652028 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.652121 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.652267 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.652346 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.652494 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.652571 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.652723 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.652808 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.652958 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.653036 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.653189 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.653266 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.653446 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.653608 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.653690 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.653762 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.653926 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.654005 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.654167 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.654252 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.654419 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.654497 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.654657 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.654735 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.654893 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.654979 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.655123 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.655202 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.655358 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.655436 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.655585 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.655674 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.655819 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.655898 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.656048 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.656125 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.656282 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.656368 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.656524 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.656601 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.656749 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.656826 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.656994 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.657085 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.657225 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.657302 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.657501 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.657580 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.657750 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.657831 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.657988 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.658073 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.658227 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.658305 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.658978 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.659071 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.659223 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.659330 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.659454 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.659535 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.659683 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.659825 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.659905 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.660066 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.660146 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.660301 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.660389 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.660591 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.660670 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.660885 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.660963 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.661133 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.661220 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.661385 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.661466 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.661617 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.661698 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.661863 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.661951 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.662109 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.662187 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.662343 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.662421 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.662578 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.662666 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.662813 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.662891 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.663039 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ldap.user = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.663118 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.663269 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] ldap.user = None {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.663355 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.663510 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.663590 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.663744 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.663822 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.663989 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.664075 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.664233 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.664312 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.664476 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.664556 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.664709 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.664796 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.664937 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.665016 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.665165 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.665242 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.665418 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.665510 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.665919 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.666002 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.666147 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.666225 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.666374 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.666460 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.666622 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.666700 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.666865 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.666943 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.667106 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.667194 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.667349 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.667427 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.667576 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.667654 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.667813 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.667899 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.668044 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.668122 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.668277 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.668356 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.668509 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.668596 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.668741 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.668820 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.668977 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.669055 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.669217 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.669304 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.669473 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.669553 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.669711 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.669789 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.669938 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.670029 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.670180 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.670260 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.670414 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.670493 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.670646 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.670734 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.670880 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.670959 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.671114 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.671191 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.671348 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.671434 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.671575 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.671655 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.671806 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.671884 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.672045 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.672142 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] resource.caching = True {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.672288 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] resource.caching = True {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.672377 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.672531 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.672619 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.672763 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.672862 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.672999 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.673086 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.673242 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.673348 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.673504 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.673593 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.673746 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.673835 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.673980 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.674069 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.674756 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.675006 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.675139 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.675269 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] role.caching = True {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.675397 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] role.caching = True {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.675524 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] role.driver = sql {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.675670 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] role.driver = sql {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.675800 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.675927 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.676056 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.676184 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.676310 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.676456 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.676585 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.676712 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.676839 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.676966 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.677095 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.677229 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.677377 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.677500 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.677628 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.677755 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.677881 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.678018 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.678159 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.678292 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.678418 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.678545 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.678671 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.678806 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.678940 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.679068 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.679196 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.679323 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.679449 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.679583 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.679710 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.679851 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.679978 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.680106 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.680238 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.680377 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.680504 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.680630 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.680757 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.680884 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.681019 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.681147 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.681275 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.681415 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.681539 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.681679 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.681817 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.681944 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.682070 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.682194 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.682323 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.682449 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.682583 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.682711 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.682837 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.682964 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.683090 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.683216 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.683361 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.683543 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.683684 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.683819 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.683946 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.684082 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.684216 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.684345 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.684473 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] token.caching = True {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.684599 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] token.caching = True {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.684725 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.684851 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.684986 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.685113 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.685249 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.685412 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.685538 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.685662 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.685796 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.685924 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.686053 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.686176 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.686299 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.686421 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.686554 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.686678 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.686800 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.686932 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.687056 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.687178 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.687308 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.687437 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.687561 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.687682 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.687805 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.687926 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.688057 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.688185 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.688308 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.688439 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.688575 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.688718 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.688847 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.688970 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.689094 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] database.connection = **** {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.689224 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] database.connection = **** {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.689403 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.689529 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.689659 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.689741 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.689867 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.690005 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.690130 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.690261 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.690261 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.690388 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.690566 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.690703 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.690831 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.690959 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.691084 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.691211 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.691337 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.691471 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.691471 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.691713 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.691840 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.691968 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.692094 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.692237 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.692366 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.692493 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.692618 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.692745 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.692872 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.693008 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.693135 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.693261 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.693400 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.693523 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.693650 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.693650 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 29 01:57:03.693913 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 01:57:03.693913 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 29 01:57:03.720924 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81648) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:03.721768 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81649) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:03.721917 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81648) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:03.722046 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81649) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:03.722174 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81648) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:03.722301 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81649) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:03.730464 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81649) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:03.730635 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81648) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:03.758913 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81648) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:03.759042 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81649) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:03.759175 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81648) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:03.759256 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81649) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:03.813638 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81649) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:03.813984 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81648) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:03.862708 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81649) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:03.862934 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81649) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:03.863465 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81648) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:03.863704 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81648) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:04.019537 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81648) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:04.019728 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81649) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:04.019840 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81648) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:04.019919 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81649) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:04.020017 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81648) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:04.020095 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81649) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:04.020170 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81648) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:04.020243 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81649) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:04.020387 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81648) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:04.020479 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81649) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:04.020604 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81648) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:04.020687 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81649) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:04.043749 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81649) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:04.043906 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81648) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:04.043991 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81649) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:04.044143 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81648) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:04.044265 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81649) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:04.044374 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81648) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:04.044455 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81649) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:04.044604 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81648) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:04.044694 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81649) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:04.044817 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81649) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:04.044897 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81648) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:04.045039 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81648) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:04.045121 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81649) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:04.045244 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81648) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:04.056710 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81649) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:04.057109 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81648) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:04.069607 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81649) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:04.069721 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81648) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:04.069799 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81649) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:04.069886 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81648) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:04.069994 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81649) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:04.070105 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81648) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:04.070214 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81649) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:04.070333 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81648) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:04.070424 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81649) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:04.070556 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81648) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:04.070639 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81649) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:04.070773 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81648) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:04.070855 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81649) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:04.070987 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81648) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 29 01:57:04.088127 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.088339 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 29 01:57:04.088619 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81648) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.088701 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.088836 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81648) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 29 01:57:04.088935 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 29 01:57:04.089124 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.089204 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81648) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.089395 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81648) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 29 01:57:04.089479 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.089667 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.089748 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81648) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.089926 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.090006 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81648) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.090188 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81648) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.090453 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81648) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.099575 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.099853 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.100128 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.100210 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81648) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.100412 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.100513 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81648) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.100682 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81648) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.100966 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81648) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.107363 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81649) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 29 01:57:04.107918 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81648) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 29 01:57:04.110390 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81649) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 29 01:57:04.110675 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.110846 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81648) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 29 01:57:04.110958 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.111136 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81648) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.111242 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.111423 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81648) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.111527 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.111787 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81648) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.111868 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.112091 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.112237 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81648) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.112363 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.112511 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81648) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.112632 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.112790 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81648) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.112905 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.113072 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81648) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.113174 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.113382 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81648) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.113666 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81648) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.113938 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81648) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.136414 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.137149 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81648) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.137978 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81649) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 29 01:57:04.138262 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.138640 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81648) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 29 01:57:04.138929 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81648) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.143012 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81649) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 29 01:57:04.143304 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.143654 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81648) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 29 01:57:04.143738 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.143946 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81648) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.144231 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81648) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.150000 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81649) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 29 01:57:04.150289 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.150592 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81648) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 29 01:57:04.150882 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81648) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.155849 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81649) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 29 01:57:04.156149 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.156439 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.156520 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81648) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 29 01:57:04.156727 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.156820 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81648) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.157005 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.157087 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81648) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.157283 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.157378 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81648) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.157581 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.157665 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81648) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.157851 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.157933 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81648) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.158122 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81648) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.158396 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81648) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.174085 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.174438 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.174668 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81648) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.175035 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81648) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.178300 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81649) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 29 01:57:04.178927 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81648) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 29 01:57:04.181555 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.181854 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.182195 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81648) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.182494 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81648) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.186079 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81649) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 29 01:57:04.186742 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81648) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 29 01:57:04.189185 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81649) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 29 01:57:04.190425 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81648) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 29 01:57:04.193039 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.193355 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.193647 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.193796 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81648) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.193935 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.194100 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81648) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.194240 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.194390 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81648) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.194530 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.194680 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81648) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.194992 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81648) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.195286 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81648) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.211811 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81649) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 29 01:57:04.212106 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.212224 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81648) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 29 01:57:04.212460 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81648) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.212566 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.212755 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81648) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.212881 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.213139 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81648) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.222042 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81648) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.222361 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.223997 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81648) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.224666 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.225612 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81648) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.225902 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81648) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.226519 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.226979 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.229062 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81648) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 29 01:57:04.229398 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81648) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.229798 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81648) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.230134 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81648) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.230416 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81649) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 29 01:57:04.230599 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81648) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.230725 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.231015 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.231344 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.231997 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.243604 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81648) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 29 01:57:04.243929 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81648) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.244366 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81648) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.244687 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81648) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.245078 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81648) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.245416 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81648) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.245679 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81648) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.246151 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81649) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 29 01:57:04.246588 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.246890 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.247338 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.247791 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.248096 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.248516 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.263191 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81648) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 29 01:57:04.266150 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81648) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 29 01:57:04.266764 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81649) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 29 01:57:04.269630 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81648) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.270480 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81649) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 29 01:57:04.271183 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81648) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.272719 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81648) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 29 01:57:04.273006 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81648) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.273396 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.273481 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81648) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.274827 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.276296 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81649) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 29 01:57:04.276582 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.276969 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.279786 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81648) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.281263 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81648) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 29 01:57:04.283314 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.284224 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81648) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.284606 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81648) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.284898 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81648) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.284989 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81649) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 29 01:57:04.285181 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81648) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.287845 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.288243 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.288529 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.288808 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.293276 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81648) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 29 01:57:04.293597 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81648) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.293886 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81648) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.296851 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81649) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 29 01:57:04.297142 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.297450 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.300776 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81648) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 29 01:57:04.301064 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81648) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.301369 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81648) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.301653 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81648) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.301936 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81648) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.302209 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81648) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.302492 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81648) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.302790 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81648) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.303065 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81648) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.303345 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81648) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.303619 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81648) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.303889 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81648) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.304157 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81648) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.304428 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81648) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.304589 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81649) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 29 01:57:04.304872 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.305153 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.305455 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.305732 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.306003 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.306286 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.306572 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.306842 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.307118 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.307397 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.307656 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.307919 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.308201 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81649) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 29 01:57:04.339605 dv-cinder-740146-21-smb devstack@keystone.service[81648]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55b1dd1eb9c0 pid: 81648 (default app) Sep 29 01:57:04.342893 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee58cb5-127d-40d4-84c1-2b9825aa8356 None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:04.343182 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee58cb5-127d-40d4-84c1-2b9825aa8356 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:04.343266 dv-cinder-740146-21-smb devstack@keystone.service[81649]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55b1dd1eb9c0 pid: 81649 (default app) Sep 29 01:57:04.343457 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee58cb5-127d-40d4-84c1-2b9825aa8356 None None] PATH_INFO: `/v3` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:04.347820 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1/1] 10.222.0.49 () {50 vars in 791 bytes} [Thu Sep 29 01:57:04 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:11.152052 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa33b093-d27f-45f6-b736-976c6172a5d8 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:11.152577 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa33b093-d27f-45f6-b736-976c6172a5d8 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:11.152577 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa33b093-d27f-45f6-b736-976c6172a5d8 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:11.156921 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1/2] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:57:11 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 29 01:57:11.162685 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8233c451-d1f4-4f92-a956-43784748c180 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:11.163164 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8233c451-d1f4-4f92-a956-43784748c180 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:11.163257 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8233c451-d1f4-4f92-a956-43784748c180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:11.233489 dv-cinder-740146-21-smb devstack@keystone.service[81648]: INFO dbcounter [None req-8233c451-d1f4-4f92-a956-43784748c180 None None] Registered counter for database keystone Sep 29 01:57:11.252840 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG oslo_db.sqlalchemy.engines [None req-8233c451-d1f4-4f92-a956-43784748c180 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81648) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 29 01:57:11.259008 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writer thread running {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 29 01:57:11.440947 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG passlib.handlers.bcrypt [None req-8233c451-d1f4-4f92-a956-43784748c180 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81648) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 29 01:57:11.441259 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG passlib.handlers.bcrypt [None req-8233c451-d1f4-4f92-a956-43784748c180 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81648) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 29 01:57:11.499171 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-8233c451-d1f4-4f92-a956-43784748c180 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:57:11.500782 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-8233c451-d1f4-4f92-a956-43784748c180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:57:11.641817 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 2/3] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:57:11 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 480 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Sep 29 01:57:11.955455 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa33b093-d27f-45f6-b736-976c6172a5d8 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:12.027535 dv-cinder-740146-21-smb devstack@keystone.service[81649]: INFO dbcounter [None req-aa33b093-d27f-45f6-b736-976c6172a5d8 None None] Registered counter for database keystone Sep 29 01:57:12.049602 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG oslo_db.sqlalchemy.engines [None req-aa33b093-d27f-45f6-b736-976c6172a5d8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81649) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 29 01:57:12.055734 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writer thread running {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 29 01:57:12.174225 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa33b093-d27f-45f6-b736-976c6172a5d8 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:12.178529 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6598be-42c8-404a-84e3-3afc87436e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:12.179149 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6598be-42c8-404a-84e3-3afc87436e1a admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:12.179427 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6598be-42c8-404a-84e3-3afc87436e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:12.179696 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6598be-42c8-404a-84e3-3afc87436e1a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:12.188062 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6598be-42c8-404a-84e3-3afc87436e1a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:12.239428 dv-cinder-740146-21-smb devstack@keystone.service[81649]: WARNING keystone.common.rbac_enforcer.enforcer [None req-9c6598be-42c8-404a-84e3-3afc87436e1a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 29 01:57:12.240444 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6598be-42c8-404a-84e3-3afc87436e1a admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:12.250139 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 2/4] 10.222.0.49 () {58 vars in 1324 bytes} [Thu Sep 29 01:57:11 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 29 01:57:12.256197 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8233c451-d1f4-4f92-a956-43784748c180 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:12.273353 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8233c451-d1f4-4f92-a956-43784748c180 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:12.277837 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13da800-1b4e-4cc0-8b01-d9566a4365b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:12.278936 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13da800-1b4e-4cc0-8b01-d9566a4365b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:12.279218 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13da800-1b4e-4cc0-8b01-d9566a4365b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:12.279487 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13da800-1b4e-4cc0-8b01-d9566a4365b5 admin admin] PATH_INFO: `/v3/projects/3a47c9ae604c439cb80f84e69bc4f995` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:12.281085 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13da800-1b4e-4cc0-8b01-d9566a4365b5 admin admin] RBAC: Authorizing `identity:get_project(project_id=3a47c9ae604c439cb80f84e69bc4f995)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:12.334485 dv-cinder-740146-21-smb devstack@keystone.service[81648]: WARNING keystone.common.rbac_enforcer.enforcer [None req-d13da800-1b4e-4cc0-8b01-d9566a4365b5 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 29 01:57:12.334842 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13da800-1b4e-4cc0-8b01-d9566a4365b5 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:12.339870 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 3/5] 10.222.0.49 () {56 vars in 1207 bytes} [Thu Sep 29 01:57:12 2022] GET /identity/v3/projects/3a47c9ae604c439cb80f84e69bc4f995 => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:14.450575 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478380ab-481a-4d39-bef5-9a6704f5991e None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:14.451168 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478380ab-481a-4d39-bef5-9a6704f5991e None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:14.451168 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478380ab-481a-4d39-bef5-9a6704f5991e None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:14.455258 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 3/6] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:57:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:57:14.461107 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c0939-c033-4ca5-90c1-aeff38ae4709 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:14.461547 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c0939-c033-4ca5-90c1-aeff38ae4709 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:14.461688 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c0939-c033-4ca5-90c1-aeff38ae4709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:14.481998 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-f47c0939-c033-4ca5-90c1-aeff38ae4709 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:57:14.483530 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-f47c0939-c033-4ca5-90c1-aeff38ae4709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:57:14.491394 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 4/7] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:57:14 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 29 01:57:14.756862 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478380ab-481a-4d39-bef5-9a6704f5991e None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:14.769854 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478380ab-481a-4d39-bef5-9a6704f5991e None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:14.774074 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0813114-ae5e-4280-ab20-cfd12e1e0769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:14.774698 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0813114-ae5e-4280-ab20-cfd12e1e0769 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:14.774976 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0813114-ae5e-4280-ab20-cfd12e1e0769 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:14.775250 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0813114-ae5e-4280-ab20-cfd12e1e0769 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:14.782811 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0813114-ae5e-4280-ab20-cfd12e1e0769 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:14.784924 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0813114-ae5e-4280-ab20-cfd12e1e0769 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:14.793984 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 4/8] 10.222.0.49 () {58 vars in 1324 bytes} [Thu Sep 29 01:57:14 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 29 01:57:14.799651 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47c0939-c033-4ca5-90c1-aeff38ae4709 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:14.808820 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47c0939-c033-4ca5-90c1-aeff38ae4709 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:14.813069 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3295df6-6c13-45fe-9f39-d043a36e2280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:14.813732 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3295df6-6c13-45fe-9f39-d043a36e2280 admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:14.814009 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3295df6-6c13-45fe-9f39-d043a36e2280 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:14.814280 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3295df6-6c13-45fe-9f39-d043a36e2280 admin admin] PATH_INFO: `/v3/users/d04b7db4290a4ee3872fe98d8aad0254` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:14.816145 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3295df6-6c13-45fe-9f39-d043a36e2280 admin admin] RBAC: Authorizing `identity:get_user(user_id=d04b7db4290a4ee3872fe98d8aad0254)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:14.817989 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3295df6-6c13-45fe-9f39-d043a36e2280 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:14.819494 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 5/9] 10.222.0.49 () {56 vars in 1198 bytes} [Thu Sep 29 01:57:14 2022] GET /identity/v3/users/d04b7db4290a4ee3872fe98d8aad0254 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:57:17.035843 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bda4c2a-601e-47e6-b4ab-d87b329dfa35 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:17.036383 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bda4c2a-601e-47e6-b4ab-d87b329dfa35 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:17.036383 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bda4c2a-601e-47e6-b4ab-d87b329dfa35 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:17.037722 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 5/10] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:57:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:57:17.043218 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1314d016-044d-4f1c-91c2-95d8e8ca10f3 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:17.043657 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1314d016-044d-4f1c-91c2-95d8e8ca10f3 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:17.043760 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1314d016-044d-4f1c-91c2-95d8e8ca10f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:17.062708 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-1314d016-044d-4f1c-91c2-95d8e8ca10f3 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:57:17.063912 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-1314d016-044d-4f1c-91c2-95d8e8ca10f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:57:17.091870 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929c4492-7cb3-4e51-a1e0-0c12cfb6d8e4 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:17.092149 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929c4492-7cb3-4e51-a1e0-0c12cfb6d8e4 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:17.092424 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929c4492-7cb3-4e51-a1e0-0c12cfb6d8e4 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:17.093753 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 6/11] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:57:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 29 01:57:17.099187 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bcb632-6cd6-49ec-9327-faafc89e346b None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:17.099469 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bcb632-6cd6-49ec-9327-faafc89e346b None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:17.099740 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bcb632-6cd6-49ec-9327-faafc89e346b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:17.141572 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG passlib.handlers.bcrypt [None req-88bcb632-6cd6-49ec-9327-faafc89e346b None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81649) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 29 01:57:17.141962 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG passlib.handlers.bcrypt [None req-88bcb632-6cd6-49ec-9327-faafc89e346b None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81649) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 29 01:57:17.146043 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 6/12] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:57:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:57:17.191661 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-88bcb632-6cd6-49ec-9327-faafc89e346b None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:57:17.193181 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-88bcb632-6cd6-49ec-9327-faafc89e346b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:57:17.291957 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 7/13] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:57:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 29 01:57:17.414882 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1314d016-044d-4f1c-91c2-95d8e8ca10f3 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:17.440445 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:17.522001 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1314d016-044d-4f1c-91c2-95d8e8ca10f3 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:17.556349 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bcb632-6cd6-49ec-9327-faafc89e346b None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:17.556898 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e29973-bfdb-4839-b9ff-37b72d5889a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:17.557578 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e29973-bfdb-4839-b9ff-37b72d5889a5 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:17.557862 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e29973-bfdb-4839-b9ff-37b72d5889a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:17.558139 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e29973-bfdb-4839-b9ff-37b72d5889a5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:17.569810 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e29973-bfdb-4839-b9ff-37b72d5889a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:57:17.578731 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-a9e29973-bfdb-4839-b9ff-37b72d5889a5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 01:57:17.578731 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:57:17.578731 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:57:17.578731 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:57:17.578731 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:57:17.578731 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:57:17.578731 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:57:17.578731 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:57:17.578731 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:57:17.578731 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:57:17.578731 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:57:17.578731 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:57:17.578731 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:57:17.578731 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:57:17.578731 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:57:17.578731 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:57:17.579628 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:57:17.579628 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:57:17.579628 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:57:17.579628 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:57:17.579628 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:57:17.579628 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:57:17.579628 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:57:17.579628 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:57:17.579628 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:57:17.579628 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:57:17.579628 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:57:17.579628 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:57:17.579628 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:57:17.579628 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:57:17.579628 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:57:17.579628 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:57:17.580520 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:57:17.580520 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:57:17.580520 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:57:17.580520 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:57:17.580520 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:57:17.580520 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:57:17.580520 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:57:17.580520 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:57:17.580520 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:57:17.580520 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:57:17.580520 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 01:57:17.580520 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:57:17.580520 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 7/14] 10.222.0.49 () {56 vars in 1096 bytes} [Thu Sep 29 01:57:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:57:17.586176 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e29973-bfdb-4839-b9ff-37b72d5889a5 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:17.659273 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bcb632-6cd6-49ec-9327-faafc89e346b None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:17.661581 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:17.673930 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:17.693854 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e29973-bfdb-4839-b9ff-37b72d5889a5 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:17.698357 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65d3ce7-de92-4f31-a224-213bd23e55c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:17.699219 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d3ce7-de92-4f31-a224-213bd23e55c9 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:17.699500 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d3ce7-de92-4f31-a224-213bd23e55c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:17.699770 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d3ce7-de92-4f31-a224-213bd23e55c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:17.727602 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9214f625-3803-4908-aede-6aef663ad98b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:17.728221 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9214f625-3803-4908-aede-6aef663ad98b None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:17.728505 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9214f625-3803-4908-aede-6aef663ad98b None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:17.728778 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9214f625-3803-4908-aede-6aef663ad98b None admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:17.729483 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9214f625-3803-4908-aede-6aef663ad98b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:57:17.729791 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9214f625-3803-4908-aede-6aef663ad98b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:17.731192 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9214f625-3803-4908-aede-6aef663ad98b None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:17.742686 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 8/15] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Sep 29 01:57:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:57:17.748928 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9214f625-3803-4908-aede-6aef663ad98b None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:17.767667 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65d3ce7-de92-4f31-a224-213bd23e55c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:17.769593 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65d3ce7-de92-4f31-a224-213bd23e55c9 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:17.849396 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9214f625-3803-4908-aede-6aef663ad98b None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:17.868281 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 8/16] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Sep 29 01:57:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 29 01:57:17.873583 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65d3ce7-de92-4f31-a224-213bd23e55c9 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:17.876203 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:17.883537 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fb22a2-986c-4210-b7ea-0bac5ff622aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:17.884171 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb22a2-986c-4210-b7ea-0bac5ff622aa None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:17.884453 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb22a2-986c-4210-b7ea-0bac5ff622aa None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:17.884726 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb22a2-986c-4210-b7ea-0bac5ff622aa None admin] PATH_INFO: `/v3/users/d04b7db4290a4ee3872fe98d8aad0254` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:17.885891 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fb22a2-986c-4210-b7ea-0bac5ff622aa None admin] RBAC: Authorizing `identity:get_user(user_id=d04b7db4290a4ee3872fe98d8aad0254)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:17.887360 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fb22a2-986c-4210-b7ea-0bac5ff622aa None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:17.888912 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 9/17] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Sep 29 01:57:17 2022] GET /identity/v3/users/d04b7db4290a4ee3872fe98d8aad0254 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:57:17.894240 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fb22a2-986c-4210-b7ea-0bac5ff622aa None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:17.909498 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:17.976745 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65d3ce7-de92-4f31-a224-213bd23e55c9 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:17.993806 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fb22a2-986c-4210-b7ea-0bac5ff622aa None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:18.010389 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7c281f-0f47-4455-abf3-dbbcb6301708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:18.011237 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7c281f-0f47-4455-abf3-dbbcb6301708 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:18.011517 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7c281f-0f47-4455-abf3-dbbcb6301708 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:18.011792 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7c281f-0f47-4455-abf3-dbbcb6301708 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:18.026829 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854eb85b-7e7e-4429-befc-94e57d33361d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:18.027462 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854eb85b-7e7e-4429-befc-94e57d33361d None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:18.027746 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854eb85b-7e7e-4429-befc-94e57d33361d None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:18.028021 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854eb85b-7e7e-4429-befc-94e57d33361d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:18.029145 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854eb85b-7e7e-4429-befc-94e57d33361d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:18.030421 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7c281f-0f47-4455-abf3-dbbcb6301708 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:18.030637 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854eb85b-7e7e-4429-befc-94e57d33361d None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:18.031857 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7c281f-0f47-4455-abf3-dbbcb6301708 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:18.032368 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 10/18] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 01:57:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:57:18.038336 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854eb85b-7e7e-4429-befc-94e57d33361d None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:18.050946 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-ed7c281f-0f47-4455-abf3-dbbcb6301708 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:57:18.050946 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:57:18.050946 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:57:18.050946 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:57:18.050946 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:57:18.050946 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:57:18.050946 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:57:18.050946 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:57:18.050946 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:57:18.050946 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:57:18.050946 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:57:18.050946 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:57:18.050946 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:57:18.050946 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:57:18.050946 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:57:18.050946 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:57:18.052335 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:57:18.052335 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:57:18.052335 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:57:18.052335 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:57:18.052335 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:57:18.052335 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:57:18.052335 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:57:18.052335 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:57:18.052335 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:57:18.052335 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:57:18.052335 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:57:18.052335 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:57:18.052335 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:57:18.052335 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:57:18.052335 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:57:18.052335 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:57:18.052335 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:57:18.053110 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:57:18.053110 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:57:18.053110 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:57:18.053110 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 9/19] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 01:57:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 01:57:18.057757 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7c281f-0f47-4455-abf3-dbbcb6301708 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:18.114756 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:18.123994 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:18.144013 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854eb85b-7e7e-4429-befc-94e57d33361d None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:18.160729 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7c281f-0f47-4455-abf3-dbbcb6301708 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:18.177601 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b478d1-21b9-4303-a73f-5c6fc57d00d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:18.178208 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b478d1-21b9-4303-a73f-5c6fc57d00d1 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:18.178487 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b478d1-21b9-4303-a73f-5c6fc57d00d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:18.178759 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b478d1-21b9-4303-a73f-5c6fc57d00d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:18.179475 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b478d1-21b9-4303-a73f-5c6fc57d00d1 None admin] RBAC: Adding query filter params (role.id=fe9bbc67742f4f5893f39b18eb31d59a, scope.domain.id=default, user.id=d04b7db4290a4ee3872fe98d8aad0254) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:57:18.179777 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b478d1-21b9-4303-a73f-5c6fc57d00d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:18.181209 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b478d1-21b9-4303-a73f-5c6fc57d00d1 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:18.187676 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 11/20] 10.222.0.49 () {56 vars in 1322 bytes} [Thu Sep 29 01:57:18 2022] GET /identity/v3/role_assignments?user.id=d04b7db4290a4ee3872fe98d8aad0254&scope.domain.id=default&role.id=fe9bbc67742f4f5893f39b18eb31d59a => generated 233 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:57:18.193526 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac19568-c8cb-4448-bae1-806b5a0bceb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:18.194155 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac19568-c8cb-4448-bae1-806b5a0bceb6 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:18.194438 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac19568-c8cb-4448-bae1-806b5a0bceb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:18.194711 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac19568-c8cb-4448-bae1-806b5a0bceb6 None admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:18.195372 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac19568-c8cb-4448-bae1-806b5a0bceb6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:57:18.195677 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac19568-c8cb-4448-bae1-806b5a0bceb6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:18.197117 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac19568-c8cb-4448-bae1-806b5a0bceb6 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:18.217248 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 10/21] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Sep 29 01:57:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:57:20.466241 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e93e5e-0f85-49fc-9b9d-ea5f587caa47 None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:20.467226 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e93e5e-0f85-49fc-9b9d-ea5f587caa47 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:20.467697 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e93e5e-0f85-49fc-9b9d-ea5f587caa47 None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:20.469449 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 12/22] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:57:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:57:20.481991 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b962e250-7859-4365-8e1d-5c2e7475ecaa None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:20.482882 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b962e250-7859-4365-8e1d-5c2e7475ecaa None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:20.483350 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b962e250-7859-4365-8e1d-5c2e7475ecaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:20.506377 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-b962e250-7859-4365-8e1d-5c2e7475ecaa None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:57:20.507602 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-b962e250-7859-4365-8e1d-5c2e7475ecaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:57:20.594301 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 11/23] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:57:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:57:20.907303 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762ea3f0-2c12-4ddc-91cb-c30528b2f125 None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:20.907303 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762ea3f0-2c12-4ddc-91cb-c30528b2f125 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:20.907303 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762ea3f0-2c12-4ddc-91cb-c30528b2f125 None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:20.907684 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 13/24] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:57:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:57:20.913780 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15333040-5920-43da-bd2d-73bb255b7873 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:20.914067 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15333040-5920-43da-bd2d-73bb255b7873 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:20.914338 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15333040-5920-43da-bd2d-73bb255b7873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:20.942290 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-15333040-5920-43da-bd2d-73bb255b7873 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:57:20.943727 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-15333040-5920-43da-bd2d-73bb255b7873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:57:21.003464 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:21.018856 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762ea3f0-2c12-4ddc-91cb-c30528b2f125 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:21.063197 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 12/25] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:57:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:57:21.186624 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762ea3f0-2c12-4ddc-91cb-c30528b2f125 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:21.235644 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e979d43-9a06-4491-a8a0-17502a3a8e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:21.236553 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e979d43-9a06-4491-a8a0-17502a3a8e73 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:21.237770 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e979d43-9a06-4491-a8a0-17502a3a8e73 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:21.238234 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e979d43-9a06-4491-a8a0-17502a3a8e73 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:21.258399 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e979d43-9a06-4491-a8a0-17502a3a8e73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:57:21.263939 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-2e979d43-9a06-4491-a8a0-17502a3a8e73 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 01:57:21.263939 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:57:21.263939 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:57:21.263939 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:57:21.263939 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:57:21.263939 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:57:21.263939 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:57:21.263939 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:57:21.263939 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:57:21.263939 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:57:21.263939 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:57:21.263939 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:57:21.263939 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:57:21.263939 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:57:21.263939 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:57:21.263939 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:57:21.265006 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:57:21.265006 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:57:21.265006 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:57:21.265006 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:57:21.265006 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:57:21.265006 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:57:21.265006 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:57:21.265006 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:57:21.265006 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:57:21.265006 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:57:21.265006 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:57:21.265006 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:57:21.265006 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:57:21.265006 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:57:21.265006 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:57:21.265006 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:57:21.266058 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:57:21.266058 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:57:21.266058 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:57:21.266058 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:57:21.266058 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:57:21.266058 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:57:21.266058 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:57:21.266058 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:57:21.266058 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:57:21.266058 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:57:21.266058 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 01:57:21.266058 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:57:21.268971 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 14/26] 10.222.0.49 () {56 vars in 1096 bytes} [Thu Sep 29 01:57:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:57:21.275131 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15333040-5920-43da-bd2d-73bb255b7873 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:21.382279 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54047b56-cef2-4b0d-b9c4-7c5ab0026a58 None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:21.382922 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54047b56-cef2-4b0d-b9c4-7c5ab0026a58 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:21.383398 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54047b56-cef2-4b0d-b9c4-7c5ab0026a58 None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:21.385571 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 15/27] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:57:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 29 01:57:21.390849 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b1bbf3-9ef6-403c-bca3-c676af9fe2e7 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:21.391357 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b1bbf3-9ef6-403c-bca3-c676af9fe2e7 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:21.391848 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b1bbf3-9ef6-403c-bca3-c676af9fe2e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:21.400158 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:21.413150 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-75b1bbf3-9ef6-403c-bca3-c676af9fe2e7 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:57:21.414698 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-75b1bbf3-9ef6-403c-bca3-c676af9fe2e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:57:21.419437 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15333040-5920-43da-bd2d-73bb255b7873 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:21.494260 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a706ce4-f805-4ed2-add2-e22ea9c03a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:21.494854 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a706ce4-f805-4ed2-add2-e22ea9c03a5c None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:21.495126 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a706ce4-f805-4ed2-add2-e22ea9c03a5c None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:21.495317 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a706ce4-f805-4ed2-add2-e22ea9c03a5c None admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:21.495980 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a706ce4-f805-4ed2-add2-e22ea9c03a5c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:57:21.496274 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a706ce4-f805-4ed2-add2-e22ea9c03a5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:21.497684 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a706ce4-f805-4ed2-add2-e22ea9c03a5c None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:21.524400 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 13/28] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Sep 29 01:57:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:21.525685 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f960c-7ce0-4160-89ce-0589e7475c22 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:21.525968 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f960c-7ce0-4160-89ce-0589e7475c22 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:21.526246 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f960c-7ce0-4160-89ce-0589e7475c22 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:21.535224 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 14/29] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:57:21 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:57:21.536114 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83f960c-7ce0-4160-89ce-0589e7475c22 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:21.542110 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 16/30] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:57:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 29 01:57:21.543153 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b1bbf3-9ef6-403c-bca3-c676af9fe2e7 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:21.619766 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:21.658049 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b1bbf3-9ef6-403c-bca3-c676af9fe2e7 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:21.711732 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae9d39b-63cd-4050-b98a-b486257bb476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:21.712521 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae9d39b-63cd-4050-b98a-b486257bb476 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:21.712801 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae9d39b-63cd-4050-b98a-b486257bb476 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:21.713077 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae9d39b-63cd-4050-b98a-b486257bb476 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:21.724724 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae9d39b-63cd-4050-b98a-b486257bb476 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:21.726396 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae9d39b-63cd-4050-b98a-b486257bb476 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:21.738102 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:21.751657 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-dae9d39b-63cd-4050-b98a-b486257bb476 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:57:21.751657 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:57:21.751657 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:57:21.751657 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:57:21.751657 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:57:21.751657 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:57:21.751657 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:57:21.751657 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:57:21.751657 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:57:21.751657 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:57:21.751657 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:57:21.751657 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:57:21.751657 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:57:21.751657 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:57:21.751657 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:57:21.751657 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:57:21.752819 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:57:21.752819 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:57:21.752819 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:57:21.752819 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:57:21.752819 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:57:21.752819 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:57:21.752819 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:57:21.752819 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:57:21.752819 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:57:21.752819 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:57:21.752819 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:57:21.752819 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:57:21.752819 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:57:21.752819 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:57:21.752819 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:57:21.752819 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:57:21.752819 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:57:21.753710 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:57:21.753710 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:57:21.753710 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:57:21.753710 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 17/31] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 01:57:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:57:21.757334 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f4d0b-7612-4bfc-8d6c-e3ae20c51ef1 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:21.757334 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f4d0b-7612-4bfc-8d6c-e3ae20c51ef1 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:21.757334 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f4d0b-7612-4bfc-8d6c-e3ae20c51ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:21.765343 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83f960c-7ce0-4160-89ce-0589e7475c22 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:21.797718 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-190f4d0b-7612-4bfc-8d6c-e3ae20c51ef1 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:57:21.798935 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-190f4d0b-7612-4bfc-8d6c-e3ae20c51ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:57:21.822418 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd93f5c1-aa67-450c-a16f-f12db07407d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:21.823053 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd93f5c1-aa67-450c-a16f-f12db07407d4 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:21.823327 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd93f5c1-aa67-450c-a16f-f12db07407d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:21.823591 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd93f5c1-aa67-450c-a16f-f12db07407d4 None admin] PATH_INFO: `/v3/users/d04b7db4290a4ee3872fe98d8aad0254` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:21.825796 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd93f5c1-aa67-450c-a16f-f12db07407d4 None admin] RBAC: Authorizing `identity:get_user(user_id=d04b7db4290a4ee3872fe98d8aad0254)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:21.827424 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd93f5c1-aa67-450c-a16f-f12db07407d4 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:21.829131 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 15/32] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Sep 29 01:57:21 2022] GET /identity/v3/users/d04b7db4290a4ee3872fe98d8aad0254 => generated 247 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:21.830101 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd93f5c1-aa67-450c-a16f-f12db07407d4 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:21.895107 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 18/33] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:57:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:57:21.896319 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190f4d0b-7612-4bfc-8d6c-e3ae20c51ef1 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:22.005069 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd93f5c1-aa67-450c-a16f-f12db07407d4 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:22.016777 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:22.070834 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190f4d0b-7612-4bfc-8d6c-e3ae20c51ef1 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:22.073818 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e204925-d96a-4bd0-bc45-ab44a09f474b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:22.074459 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e204925-d96a-4bd0-bc45-ab44a09f474b None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:22.074736 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e204925-d96a-4bd0-bc45-ab44a09f474b None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:22.075006 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e204925-d96a-4bd0-bc45-ab44a09f474b None admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:22.075678 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e204925-d96a-4bd0-bc45-ab44a09f474b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:57:22.076151 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e204925-d96a-4bd0-bc45-ab44a09f474b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:22.078971 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e204925-d96a-4bd0-bc45-ab44a09f474b None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:22.104877 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 16/34] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Sep 29 01:57:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:22.105742 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e204925-d96a-4bd0-bc45-ab44a09f474b None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:22.106683 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:22.128117 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc03818-12dd-4b1a-bb4f-dacfbe8bafce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:22.129031 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc03818-12dd-4b1a-bb4f-dacfbe8bafce None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:22.129499 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc03818-12dd-4b1a-bb4f-dacfbe8bafce None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:22.129914 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc03818-12dd-4b1a-bb4f-dacfbe8bafce None admin] PATH_INFO: `/v3/domains/default` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:22.131200 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc03818-12dd-4b1a-bb4f-dacfbe8bafce None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:22.132802 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc03818-12dd-4b1a-bb4f-dacfbe8bafce None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:22.134653 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 19/35] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 01:57:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:22.135758 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc03818-12dd-4b1a-bb4f-dacfbe8bafce None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:22.279088 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc03818-12dd-4b1a-bb4f-dacfbe8bafce None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:22.285067 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e204925-d96a-4bd0-bc45-ab44a09f474b None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:22.320625 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1184922b-6efa-4edd-9d5d-999ba8f875a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:22.320996 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66de7d58-31a0-4ee2-8b2c-3fcb8e79d886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:22.321240 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1184922b-6efa-4edd-9d5d-999ba8f875a0 None admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:22.321548 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1184922b-6efa-4edd-9d5d-999ba8f875a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:22.321640 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de7d58-31a0-4ee2-8b2c-3fcb8e79d886 None admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:22.321820 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1184922b-6efa-4edd-9d5d-999ba8f875a0 None admin] PATH_INFO: `/v3/projects` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:22.321910 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de7d58-31a0-4ee2-8b2c-3fcb8e79d886 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:22.322123 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de7d58-31a0-4ee2-8b2c-3fcb8e79d886 None admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:22.322464 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1184922b-6efa-4edd-9d5d-999ba8f875a0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:22.322791 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66de7d58-31a0-4ee2-8b2c-3fcb8e79d886 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:22.323916 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1184922b-6efa-4edd-9d5d-999ba8f875a0 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:22.324146 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66de7d58-31a0-4ee2-8b2c-3fcb8e79d886 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:22.446931 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 17/36] 10.222.0.49 () {60 vars in 1131 bytes} [Thu Sep 29 01:57:22 2022] POST /identity/v3/roles => generated 219 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 01:57:22.448232 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66de7d58-31a0-4ee2-8b2c-3fcb8e79d886 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:22.473343 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 20/37] 10.222.0.49 () {60 vars in 1141 bytes} [Thu Sep 29 01:57:22 2022] POST /identity/v3/projects => generated 301 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 01:57:22.473343 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212fb09-37b6-47ca-babb-7898f59c8f3a None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:22.473343 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212fb09-37b6-47ca-babb-7898f59c8f3a None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:22.473343 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212fb09-37b6-47ca-babb-7898f59c8f3a None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:22.473343 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 21/38] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:57:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:57:22.473343 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c212fb09-37b6-47ca-babb-7898f59c8f3a None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:22.527744 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:22.684128 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:22.709018 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66de7d58-31a0-4ee2-8b2c-3fcb8e79d886 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:22.755539 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ea93ed-c7c4-4e66-90c5-61387b559174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:22.756221 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ea93ed-c7c4-4e66-90c5-61387b559174 None admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:22.756502 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ea93ed-c7c4-4e66-90c5-61387b559174 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:22.756782 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ea93ed-c7c4-4e66-90c5-61387b559174 None admin] PATH_INFO: `/v3/domains/default/users/d04b7db4290a4ee3872fe98d8aad0254/roles/fe9bbc67742f4f5893f39b18eb31d59a` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:22.758944 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ea93ed-c7c4-4e66-90c5-61387b559174 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=d04b7db4290a4ee3872fe98d8aad0254, role_id=fe9bbc67742f4f5893f39b18eb31d59a)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:22.760519 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ea93ed-c7c4-4e66-90c5-61387b559174 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:22.770454 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c212fb09-37b6-47ca-babb-7898f59c8f3a None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:22.778231 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 18/39] 10.222.0.49 () {58 vars in 1361 bytes} [Thu Sep 29 01:57:22 2022] PUT /identity/v3/domains/default/users/d04b7db4290a4ee3872fe98d8aad0254/roles/fe9bbc67742f4f5893f39b18eb31d59a => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 01:57:22.779636 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a334bc27-9bae-4c95-9feb-e8509289bff5 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:22.779929 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a334bc27-9bae-4c95-9feb-e8509289bff5 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:22.780207 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a334bc27-9bae-4c95-9feb-e8509289bff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:22.801462 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-a334bc27-9bae-4c95-9feb-e8509289bff5 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:57:22.803096 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-a334bc27-9bae-4c95-9feb-e8509289bff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:57:22.812250 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105d114d-3fdd-4406-92b5-b1be07980b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:22.813201 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d114d-3fdd-4406-92b5-b1be07980b1e None admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:22.813741 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d114d-3fdd-4406-92b5-b1be07980b1e None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:22.814246 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d114d-3fdd-4406-92b5-b1be07980b1e None admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:22.815202 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105d114d-3fdd-4406-92b5-b1be07980b1e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:22.817251 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105d114d-3fdd-4406-92b5-b1be07980b1e None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:22.837362 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 22/40] 10.222.0.49 () {60 vars in 1131 bytes} [Thu Sep 29 01:57:22 2022] POST /identity/v3/roles => generated 225 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 01:57:22.839203 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e622c-3c04-4b5a-9846-1361c16942f1 None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:22.839667 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e622c-3c04-4b5a-9846-1361c16942f1 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:22.840117 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e622c-3c04-4b5a-9846-1361c16942f1 None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:22.841868 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 23/41] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:57:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:57:22.849172 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83485f70-46d9-4ed3-918b-43ee33d5110c None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:22.849549 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83485f70-46d9-4ed3-918b-43ee33d5110c None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:22.849771 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83485f70-46d9-4ed3-918b-43ee33d5110c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:22.878246 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-83485f70-46d9-4ed3-918b-43ee33d5110c None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:57:22.881663 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-83485f70-46d9-4ed3-918b-43ee33d5110c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:57:22.891497 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 19/42] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:57:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:57:22.982204 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 24/43] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:57:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 29 01:57:23.175616 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a334bc27-9bae-4c95-9feb-e8509289bff5 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:23.193438 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:23.278962 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a334bc27-9bae-4c95-9feb-e8509289bff5 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:23.287760 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83485f70-46d9-4ed3-918b-43ee33d5110c None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:23.316145 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8201cf-cfad-42c4-98e5-29f2de5900dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:23.316764 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8201cf-cfad-42c4-98e5-29f2de5900dd None admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:23.317040 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8201cf-cfad-42c4-98e5-29f2de5900dd None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:23.317320 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8201cf-cfad-42c4-98e5-29f2de5900dd None admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:23.318008 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8201cf-cfad-42c4-98e5-29f2de5900dd None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:23.319385 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8201cf-cfad-42c4-98e5-29f2de5900dd None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:23.326991 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:23.341990 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 20/44] 10.222.0.49 () {60 vars in 1131 bytes} [Thu Sep 29 01:57:23 2022] POST /identity/v3/roles => generated 223 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 29 01:57:23.415303 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83485f70-46d9-4ed3-918b-43ee33d5110c None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:23.452335 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122756da-2a5b-4842-bb1f-d3dfddce3096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:23.452984 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122756da-2a5b-4842-bb1f-d3dfddce3096 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:23.453264 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122756da-2a5b-4842-bb1f-d3dfddce3096 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:23.453564 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122756da-2a5b-4842-bb1f-d3dfddce3096 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:23.454691 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122756da-2a5b-4842-bb1f-d3dfddce3096 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:23.456710 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122756da-2a5b-4842-bb1f-d3dfddce3096 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:23.458660 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 25/45] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 01:57:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:57:23.464258 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8201cf-cfad-42c4-98e5-29f2de5900dd None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:23.551094 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:23.575890 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8201cf-cfad-42c4-98e5-29f2de5900dd None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:23.616909 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95446d7-8d21-4ff9-8dcd-6458d8e1ffd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:23.617548 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95446d7-8d21-4ff9-8dcd-6458d8e1ffd8 None admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:23.617850 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95446d7-8d21-4ff9-8dcd-6458d8e1ffd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:23.618273 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95446d7-8d21-4ff9-8dcd-6458d8e1ffd8 None admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:23.619176 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95446d7-8d21-4ff9-8dcd-6458d8e1ffd8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:23.620629 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95446d7-8d21-4ff9-8dcd-6458d8e1ffd8 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:23.649726 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 21/46] 10.222.0.49 () {60 vars in 1141 bytes} [Thu Sep 29 01:57:23 2022] POST /identity/v3/projects => generated 312 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 01:57:24.995262 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4919451e-38a6-4c50-a32f-8aedd4a1d36c None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:24.995797 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4919451e-38a6-4c50-a32f-8aedd4a1d36c None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:24.995797 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4919451e-38a6-4c50-a32f-8aedd4a1d36c None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:24.997138 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 26/47] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:57:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:57:25.002402 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b74015a-cbd2-4c32-b5bf-43f1c6fce355 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:25.003357 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b74015a-cbd2-4c32-b5bf-43f1c6fce355 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:25.003677 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b74015a-cbd2-4c32-b5bf-43f1c6fce355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:25.022257 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-1b74015a-cbd2-4c32-b5bf-43f1c6fce355 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:57:25.023449 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-1b74015a-cbd2-4c32-b5bf-43f1c6fce355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:57:25.088814 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 22/48] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:57:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:57:25.358368 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4919451e-38a6-4c50-a32f-8aedd4a1d36c None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:25.453561 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:25.461755 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4919451e-38a6-4c50-a32f-8aedd4a1d36c None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:25.495940 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b164b93-faf0-4308-9395-7448b36ef4da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:25.496571 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b164b93-faf0-4308-9395-7448b36ef4da None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:25.496848 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b164b93-faf0-4308-9395-7448b36ef4da None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:25.497118 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b164b93-faf0-4308-9395-7448b36ef4da None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:25.506961 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b164b93-faf0-4308-9395-7448b36ef4da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:57:25.511884 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-4b164b93-faf0-4308-9395-7448b36ef4da None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 01:57:25.511884 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:57:25.511884 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:57:25.511884 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:57:25.511884 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:57:25.511884 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:57:25.511884 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:57:25.511884 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:57:25.511884 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:57:25.511884 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:57:25.511884 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:57:25.511884 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:57:25.511884 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:57:25.511884 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:57:25.511884 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:57:25.511884 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:57:25.512713 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:57:25.512713 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:57:25.512713 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:57:25.512713 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:57:25.512713 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:57:25.512713 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:57:25.512713 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:57:25.512713 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:57:25.512713 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:57:25.512713 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:57:25.512713 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:57:25.512713 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:57:25.512713 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:57:25.512713 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:57:25.512713 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:57:25.512713 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:57:25.513469 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:57:25.513469 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:57:25.513469 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:57:25.513469 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:57:25.513469 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:57:25.513469 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:57:25.513469 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:57:25.513469 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:57:25.513469 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:57:25.513469 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:57:25.513469 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 01:57:25.513469 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:57:25.513469 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 27/49] 10.222.0.49 () {56 vars in 1096 bytes} [Thu Sep 29 01:57:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:57:25.519410 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b74015a-cbd2-4c32-b5bf-43f1c6fce355 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:25.591456 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:25.631753 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b74015a-cbd2-4c32-b5bf-43f1c6fce355 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:25.665807 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03d4eb4-60a3-4500-b629-b45de56985b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:25.666424 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d4eb4-60a3-4500-b629-b45de56985b0 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:25.666970 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d4eb4-60a3-4500-b629-b45de56985b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:25.667244 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d4eb4-60a3-4500-b629-b45de56985b0 None admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:25.667917 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03d4eb4-60a3-4500-b629-b45de56985b0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:57:25.668225 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03d4eb4-60a3-4500-b629-b45de56985b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:25.669643 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03d4eb4-60a3-4500-b629-b45de56985b0 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:25.677918 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 23/50] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Sep 29 01:57:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:25.684755 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b164b93-faf0-4308-9395-7448b36ef4da None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:25.788300 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b164b93-faf0-4308-9395-7448b36ef4da None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:25.821479 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9801690a-0cec-47a0-ac78-0fbe285606f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:25.822116 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9801690a-0cec-47a0-ac78-0fbe285606f4 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:25.822397 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9801690a-0cec-47a0-ac78-0fbe285606f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:25.822952 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9801690a-0cec-47a0-ac78-0fbe285606f4 None admin] PATH_INFO: `/v3/users/d04b7db4290a4ee3872fe98d8aad0254` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:25.824076 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9801690a-0cec-47a0-ac78-0fbe285606f4 None admin] RBAC: Authorizing `identity:get_user(user_id=d04b7db4290a4ee3872fe98d8aad0254)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:25.825564 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9801690a-0cec-47a0-ac78-0fbe285606f4 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:25.827150 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 28/51] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Sep 29 01:57:25 2022] GET /identity/v3/users/d04b7db4290a4ee3872fe98d8aad0254 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:57:25.833104 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03d4eb4-60a3-4500-b629-b45de56985b0 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:25.853035 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81625413-ad30-4723-8820-8c04d7202776 None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:25.853334 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81625413-ad30-4723-8820-8c04d7202776 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:25.853642 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81625413-ad30-4723-8820-8c04d7202776 None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:25.854985 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 29/52] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:57:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 29 01:57:25.859985 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f781e1-f1e8-46d2-9e5b-485bf022e6e8 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:25.860270 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f781e1-f1e8-46d2-9e5b-485bf022e6e8 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:25.860563 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f781e1-f1e8-46d2-9e5b-485bf022e6e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:25.879888 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-a2f781e1-f1e8-46d2-9e5b-485bf022e6e8 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:57:25.881109 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-a2f781e1-f1e8-46d2-9e5b-485bf022e6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:57:25.898750 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:25.953732 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 30/53] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:57:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 29 01:57:26.047210 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03d4eb4-60a3-4500-b629-b45de56985b0 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:26.066737 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:26.080212 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701ea883-c69a-4424-97d6-6c29dfece0f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:26.081448 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ea883-c69a-4424-97d6-6c29dfece0f9 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:26.081725 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ea883-c69a-4424-97d6-6c29dfece0f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:26.082000 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ea883-c69a-4424-97d6-6c29dfece0f9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:26.083099 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701ea883-c69a-4424-97d6-6c29dfece0f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:26.084519 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701ea883-c69a-4424-97d6-6c29dfece0f9 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:26.086254 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 24/54] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 01:57:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:26.091822 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f781e1-f1e8-46d2-9e5b-485bf022e6e8 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:26.187026 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f781e1-f1e8-46d2-9e5b-485bf022e6e8 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:26.220244 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334db1d1-dc77-41b6-99e8-ee08d697e57f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:26.220839 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334db1d1-dc77-41b6-99e8-ee08d697e57f None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:26.221115 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334db1d1-dc77-41b6-99e8-ee08d697e57f None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:26.221452 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334db1d1-dc77-41b6-99e8-ee08d697e57f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:26.222168 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334db1d1-dc77-41b6-99e8-ee08d697e57f None admin] RBAC: Adding query filter params (role.id=fe9bbc67742f4f5893f39b18eb31d59a, scope.domain.id=default, user.id=d04b7db4290a4ee3872fe98d8aad0254) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:57:26.222474 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334db1d1-dc77-41b6-99e8-ee08d697e57f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:26.223890 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334db1d1-dc77-41b6-99e8-ee08d697e57f None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:26.229025 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701ea883-c69a-4424-97d6-6c29dfece0f9 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:26.230273 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 31/55] 10.222.0.49 () {56 vars in 1322 bytes} [Thu Sep 29 01:57:26 2022] GET /identity/v3/role_assignments?user.id=d04b7db4290a4ee3872fe98d8aad0254&scope.domain.id=default&role.id=fe9bbc67742f4f5893f39b18eb31d59a => generated 530 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:26.335395 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701ea883-c69a-4424-97d6-6c29dfece0f9 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:26.369967 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d541ed6a-87d1-4d56-8359-3582caa9d890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:26.370609 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541ed6a-87d1-4d56-8359-3582caa9d890 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:26.370890 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541ed6a-87d1-4d56-8359-3582caa9d890 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:26.371162 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541ed6a-87d1-4d56-8359-3582caa9d890 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:26.372312 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d541ed6a-87d1-4d56-8359-3582caa9d890 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:26.373805 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d541ed6a-87d1-4d56-8359-3582caa9d890 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:26.375427 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 25/56] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 01:57:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:57:26.381395 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334db1d1-dc77-41b6-99e8-ee08d697e57f None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:26.401040 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:26.483771 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334db1d1-dc77-41b6-99e8-ee08d697e57f None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:26.516931 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541faa29-7b81-41e7-9f44-9f9b4bcf08c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:26.517558 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541faa29-7b81-41e7-9f44-9f9b4bcf08c4 None admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:26.517837 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541faa29-7b81-41e7-9f44-9f9b4bcf08c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:26.518107 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541faa29-7b81-41e7-9f44-9f9b4bcf08c4 None admin] PATH_INFO: `/v3/projects` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:26.518834 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541faa29-7b81-41e7-9f44-9f9b4bcf08c4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:26.520276 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541faa29-7b81-41e7-9f44-9f9b4bcf08c4 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:26.545583 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 32/57] 10.222.0.49 () {60 vars in 1140 bytes} [Thu Sep 29 01:57:26 2022] POST /identity/v3/projects => generated 298 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 01:57:28.672533 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc5eb71-e7b4-4f48-8b39-537197b0e38c None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:28.673046 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc5eb71-e7b4-4f48-8b39-537197b0e38c None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:28.673134 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc5eb71-e7b4-4f48-8b39-537197b0e38c None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:28.674959 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 26/58] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:57:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:57:28.680202 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4912b2e3-6855-4bec-a0da-470102021614 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:28.680623 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4912b2e3-6855-4bec-a0da-470102021614 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:28.680768 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4912b2e3-6855-4bec-a0da-470102021614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:28.699611 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-4912b2e3-6855-4bec-a0da-470102021614 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:57:28.700824 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-4912b2e3-6855-4bec-a0da-470102021614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:57:28.760855 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:28.766567 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 33/59] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:57:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:57:29.038140 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc5eb71-e7b4-4f48-8b39-537197b0e38c None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:29.094741 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:29.137208 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc5eb71-e7b4-4f48-8b39-537197b0e38c None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:29.169245 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5341ad1b-7be4-4b78-b84e-3bc0d88ed1ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:29.169881 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5341ad1b-7be4-4b78-b84e-3bc0d88ed1ee None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:29.170159 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5341ad1b-7be4-4b78-b84e-3bc0d88ed1ee None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:29.170431 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5341ad1b-7be4-4b78-b84e-3bc0d88ed1ee None admin] PATH_INFO: `/v3/domains/default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:29.171540 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5341ad1b-7be4-4b78-b84e-3bc0d88ed1ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:29.172959 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5341ad1b-7be4-4b78-b84e-3bc0d88ed1ee None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:29.174542 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 27/60] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 01:57:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:29.180033 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4912b2e3-6855-4bec-a0da-470102021614 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:29.276079 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4912b2e3-6855-4bec-a0da-470102021614 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:29.309262 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e979f8-c4c5-401d-b801-aaeca49b17a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:29.309889 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e979f8-c4c5-401d-b801-aaeca49b17a7 None admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:29.310171 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e979f8-c4c5-401d-b801-aaeca49b17a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:29.310440 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e979f8-c4c5-401d-b801-aaeca49b17a7 None admin] PATH_INFO: `/v3/users` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:29.311096 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e979f8-c4c5-401d-b801-aaeca49b17a7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:29.312545 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e979f8-c4c5-401d-b801-aaeca49b17a7 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:29.338561 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 34/61] 10.222.0.49 () {60 vars in 1132 bytes} [Thu Sep 29 01:57:29 2022] POST /identity/v3/users => generated 275 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 01:57:32.593781 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29faf2a-90ba-48c8-8585-17ec8d6007d8 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:32.594740 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29faf2a-90ba-48c8-8585-17ec8d6007d8 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:32.595238 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29faf2a-90ba-48c8-8585-17ec8d6007d8 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:32.597597 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 28/62] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:57:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:57:32.607011 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1259bf7-f675-4ed1-9d7c-236530c5b314 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:32.608268 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1259bf7-f675-4ed1-9d7c-236530c5b314 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:32.608268 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1259bf7-f675-4ed1-9d7c-236530c5b314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:32.634595 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-a1259bf7-f675-4ed1-9d7c-236530c5b314 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:57:32.636169 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-a1259bf7-f675-4ed1-9d7c-236530c5b314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:57:32.707372 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:32.727445 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 35/63] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:57:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:57:32.879955 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ecd486-4101-4417-b846-7e97a3552ae1 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:32.880558 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ecd486-4101-4417-b846-7e97a3552ae1 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:32.881027 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ecd486-4101-4417-b846-7e97a3552ae1 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:32.881187 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9247ec47-de77-4a47-aca8-3c4ebb3d65ea None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:32.881659 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9247ec47-de77-4a47-aca8-3c4ebb3d65ea None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:32.882079 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9247ec47-de77-4a47-aca8-3c4ebb3d65ea None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:32.882919 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 29/64] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:57:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:57:32.884051 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 36/65] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:57:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:57:32.888650 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3a5cdd-2b59-4fb0-bae9-5b510ac160e1 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:32.888927 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3a5cdd-2b59-4fb0-bae9-5b510ac160e1 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:32.889381 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3a5cdd-2b59-4fb0-bae9-5b510ac160e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:32.892738 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86935728-4970-4835-9bc2-3cedbc12035c None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:32.893033 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86935728-4970-4835-9bc2-3cedbc12035c None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:32.893494 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86935728-4970-4835-9bc2-3cedbc12035c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:32.928121 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-7e3a5cdd-2b59-4fb0-bae9-5b510ac160e1 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:57:32.929410 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-86935728-4970-4835-9bc2-3cedbc12035c None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:57:32.929896 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-7e3a5cdd-2b59-4fb0-bae9-5b510ac160e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:57:32.930596 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-86935728-4970-4835-9bc2-3cedbc12035c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:57:33.034776 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 30/66] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:57:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:57:33.057330 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 37/67] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:57:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:57:33.153210 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3a5cdd-2b59-4fb0-bae9-5b510ac160e1 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:33.227438 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:33.238477 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2971fe79-1eb3-4bb0-97bf-91b305300e0f None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:33.239259 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2971fe79-1eb3-4bb0-97bf-91b305300e0f None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:33.239797 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2971fe79-1eb3-4bb0-97bf-91b305300e0f None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:33.241814 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 38/68] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:57:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:57:33.246992 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a79dc23-bc97-4458-a262-867d2dad3f60 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:33.247500 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a79dc23-bc97-4458-a262-867d2dad3f60 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:33.247993 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a79dc23-bc97-4458-a262-867d2dad3f60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:33.267706 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-3a79dc23-bc97-4458-a262-867d2dad3f60 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:57:33.269245 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-3a79dc23-bc97-4458-a262-867d2dad3f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:57:33.309440 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3a5cdd-2b59-4fb0-bae9-5b510ac160e1 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:33.357299 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556456c3-3976-442a-85c2-e8b973ccd90b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:33.358318 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556456c3-3976-442a-85c2-e8b973ccd90b None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:33.358845 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556456c3-3976-442a-85c2-e8b973ccd90b None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:33.359254 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556456c3-3976-442a-85c2-e8b973ccd90b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:33.365052 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 39/69] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:57:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 29 01:57:33.366638 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d74fac4-f619-46b4-bb0d-857a0c8a9774 None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:33.367052 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d74fac4-f619-46b4-bb0d-857a0c8a9774 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:33.367431 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d74fac4-f619-46b4-bb0d-857a0c8a9774 None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:33.368883 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 40/70] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:57:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:57:33.373633 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556456c3-3976-442a-85c2-e8b973ccd90b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:57:33.380188 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2370daf7-a554-4670-ab58-f65affce676d None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:33.380579 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2370daf7-a554-4670-ab58-f65affce676d None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:33.380961 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2370daf7-a554-4670-ab58-f65affce676d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:33.381397 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-556456c3-3976-442a-85c2-e8b973ccd90b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 29 01:57:33.381397 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:57:33.381397 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:57:33.381397 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:57:33.381397 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:57:33.381397 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:57:33.381397 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:57:33.381397 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:57:33.381397 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:57:33.381397 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:57:33.381397 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:57:33.381397 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:57:33.381397 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:57:33.381397 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:57:33.381397 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:57:33.381397 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:57:33.382405 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:57:33.382405 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:57:33.382405 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:57:33.382405 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:57:33.382405 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:57:33.382405 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:57:33.382405 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:57:33.382405 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:57:33.382405 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:57:33.382405 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:57:33.382405 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:57:33.382405 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:57:33.382405 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:57:33.382405 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:57:33.382405 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:57:33.382405 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:57:33.383347 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:57:33.383347 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:57:33.383347 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:57:33.383347 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:57:33.383347 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:57:33.383347 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:57:33.383347 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:57:33.383347 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:57:33.383347 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:57:33.383347 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:57:33.383347 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 29 01:57:33.383347 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:57:33.385255 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 31/71] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Sep 29 01:57:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:57:33.394334 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556456c3-3976-442a-85c2-e8b973ccd90b None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:33.415024 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-2370daf7-a554-4670-ab58-f65affce676d None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:57:33.416263 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-2370daf7-a554-4670-ab58-f65affce676d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:57:33.461529 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:33.490652 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 41/72] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:57:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 29 01:57:33.492488 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2370daf7-a554-4670-ab58-f65affce676d None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:33.515640 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556456c3-3976-442a-85c2-e8b973ccd90b None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:33.532616 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:33.558799 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8cce05-c488-4067-8a16-20285380642f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:33.559907 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8cce05-c488-4067-8a16-20285380642f None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:33.560339 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8cce05-c488-4067-8a16-20285380642f None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:33.560758 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8cce05-c488-4067-8a16-20285380642f None admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:33.561663 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8cce05-c488-4067-8a16-20285380642f None admin] RBAC: Adding query filter params (name=member) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:57:33.562185 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8cce05-c488-4067-8a16-20285380642f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:33.563703 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8cce05-c488-4067-8a16-20285380642f None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:33.574340 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 32/73] 10.222.0.49 () {56 vars in 1101 bytes} [Thu Sep 29 01:57:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:33.575573 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8cce05-c488-4067-8a16-20285380642f None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:33.619904 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2370daf7-a554-4670-ab58-f65affce676d None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:33.656235 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dfc967-2aa1-48d8-adae-c33fdc9135cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:33.656869 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dfc967-2aa1-48d8-adae-c33fdc9135cd None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:33.657149 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dfc967-2aa1-48d8-adae-c33fdc9135cd None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:33.657446 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dfc967-2aa1-48d8-adae-c33fdc9135cd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:33.668859 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dfc967-2aa1-48d8-adae-c33fdc9135cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:57:33.673657 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-b8dfc967-2aa1-48d8-adae-c33fdc9135cd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 29 01:57:33.673657 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:57:33.673657 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:57:33.673657 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:57:33.673657 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:57:33.673657 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:57:33.673657 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:57:33.673657 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:57:33.673657 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:57:33.673657 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:57:33.673657 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:57:33.673657 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:57:33.673657 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:57:33.673657 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:57:33.673657 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:57:33.673657 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:57:33.674474 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:57:33.674474 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:57:33.674474 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:57:33.674474 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:57:33.674474 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:57:33.674474 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:57:33.674474 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:57:33.674474 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:57:33.674474 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:57:33.674474 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:57:33.674474 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:57:33.674474 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:57:33.674474 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:57:33.674474 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:57:33.674474 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:57:33.674474 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:57:33.675304 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:57:33.675304 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:57:33.675304 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:57:33.675304 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:57:33.675304 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:57:33.675304 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:57:33.675304 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:57:33.675304 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:57:33.675304 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:57:33.675304 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:57:33.675304 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 29 01:57:33.675304 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:57:33.675304 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 42/74] 10.222.0.49 () {56 vars in 1114 bytes} [Thu Sep 29 01:57:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:57:33.675917 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dfc967-2aa1-48d8-adae-c33fdc9135cd None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:33.702723 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8cce05-c488-4067-8a16-20285380642f None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:33.710985 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:33.743048 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8e6f17-cbe6-489c-8688-6b7af817d006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:33.743680 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8e6f17-cbe6-489c-8688-6b7af817d006 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:33.743959 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8e6f17-cbe6-489c-8688-6b7af817d006 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:33.744228 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8e6f17-cbe6-489c-8688-6b7af817d006 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:33.756258 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8e6f17-cbe6-489c-8688-6b7af817d006 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:57:33.761542 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-5a8e6f17-cbe6-489c-8688-6b7af817d006 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 01:57:33.761542 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:57:33.761542 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:57:33.761542 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:57:33.761542 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:57:33.761542 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:57:33.761542 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:57:33.761542 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:57:33.761542 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:57:33.761542 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:57:33.761542 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:57:33.761542 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:57:33.761542 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:57:33.761542 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:57:33.761542 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:57:33.761542 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:57:33.762359 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:57:33.762359 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:57:33.762359 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:57:33.762359 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:57:33.762359 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:57:33.762359 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:57:33.762359 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:57:33.762359 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:57:33.762359 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:57:33.762359 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:57:33.762359 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:57:33.762359 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:57:33.762359 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:57:33.762359 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:57:33.762359 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:57:33.762359 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:57:33.763098 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:57:33.763098 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:57:33.763098 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:57:33.763098 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:57:33.763098 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:57:33.763098 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:57:33.763098 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:57:33.763098 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:57:33.763098 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:57:33.763098 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:57:33.763098 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 01:57:33.763098 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:57:33.763098 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 33/75] 10.222.0.49 () {56 vars in 1096 bytes} [Thu Sep 29 01:57:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:57:33.763710 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8e6f17-cbe6-489c-8688-6b7af817d006 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:33.786581 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dfc967-2aa1-48d8-adae-c33fdc9135cd None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:33.797323 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:33.821536 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90d374c-fa79-4a74-a4ab-abdbe19219b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:33.822165 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d374c-fa79-4a74-a4ab-abdbe19219b9 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:33.822444 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d374c-fa79-4a74-a4ab-abdbe19219b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:33.822717 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d374c-fa79-4a74-a4ab-abdbe19219b9 None admin] PATH_INFO: `/v3/users/a64bc3897f184f0bb688c7deb7e88f66` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:33.836676 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90d374c-fa79-4a74-a4ab-abdbe19219b9 None admin] RBAC: Authorizing `identity:get_user(user_id=a64bc3897f184f0bb688c7deb7e88f66)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:33.838176 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90d374c-fa79-4a74-a4ab-abdbe19219b9 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:33.839791 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 43/76] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Sep 29 01:57:33 2022] GET /identity/v3/users/a64bc3897f184f0bb688c7deb7e88f66 => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:33.840558 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90d374c-fa79-4a74-a4ab-abdbe19219b9 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:33.866602 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8e6f17-cbe6-489c-8688-6b7af817d006 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:33.899838 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f66c5f4-2c7c-48d0-a124-90684c55a9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:33.900780 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f66c5f4-2c7c-48d0-a124-90684c55a9c3 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:33.901213 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f66c5f4-2c7c-48d0-a124-90684c55a9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:33.901519 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f66c5f4-2c7c-48d0-a124-90684c55a9c3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:33.912410 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f66c5f4-2c7c-48d0-a124-90684c55a9c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:57:33.918019 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-9f66c5f4-2c7c-48d0-a124-90684c55a9c3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 29 01:57:33.918019 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:57:33.918019 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:57:33.918019 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:57:33.918019 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:57:33.918019 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:57:33.918019 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:57:33.918019 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:57:33.918019 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:57:33.918019 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:57:33.918019 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:57:33.918019 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:57:33.918019 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:57:33.918019 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:57:33.918019 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:57:33.918019 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:57:33.918849 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:57:33.918849 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:57:33.918849 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:57:33.918849 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:57:33.918849 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:57:33.918849 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:57:33.918849 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:57:33.918849 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:57:33.918849 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:57:33.918849 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:57:33.918849 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:57:33.918849 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:57:33.918849 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:57:33.918849 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:57:33.918849 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:57:33.918849 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:57:33.919621 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:57:33.919621 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:57:33.919621 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:57:33.919621 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:57:33.919621 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:57:33.919621 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:57:33.919621 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:57:33.919621 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:57:33.919621 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:57:33.919621 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:57:33.919621 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 29 01:57:33.919621 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:57:33.919621 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 34/77] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Sep 29 01:57:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:57:33.920343 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f66c5f4-2c7c-48d0-a124-90684c55a9c3 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:33.933181 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:33.943435 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90d374c-fa79-4a74-a4ab-abdbe19219b9 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:33.976031 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfffafbe-1b0e-41aa-97b6-5b454cda2bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:33.976641 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfffafbe-1b0e-41aa-97b6-5b454cda2bf0 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:33.976921 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfffafbe-1b0e-41aa-97b6-5b454cda2bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:33.977205 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfffafbe-1b0e-41aa-97b6-5b454cda2bf0 None admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:33.977893 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfffafbe-1b0e-41aa-97b6-5b454cda2bf0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:57:33.978202 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfffafbe-1b0e-41aa-97b6-5b454cda2bf0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:33.979607 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfffafbe-1b0e-41aa-97b6-5b454cda2bf0 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:33.987935 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 44/78] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Sep 29 01:57:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:33.988728 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfffafbe-1b0e-41aa-97b6-5b454cda2bf0 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:34.020296 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:34.026854 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f66c5f4-2c7c-48d0-a124-90684c55a9c3 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:34.060551 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df7bee0-cdad-473c-a4cf-07515dc19655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:34.061155 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df7bee0-cdad-473c-a4cf-07515dc19655 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:34.061470 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df7bee0-cdad-473c-a4cf-07515dc19655 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:34.061746 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df7bee0-cdad-473c-a4cf-07515dc19655 None admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:34.062403 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df7bee0-cdad-473c-a4cf-07515dc19655 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:57:34.062712 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df7bee0-cdad-473c-a4cf-07515dc19655 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:34.064090 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df7bee0-cdad-473c-a4cf-07515dc19655 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:34.073641 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 35/79] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Sep 29 01:57:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:34.074443 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df7bee0-cdad-473c-a4cf-07515dc19655 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:34.090316 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfffafbe-1b0e-41aa-97b6-5b454cda2bf0 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:34.123341 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596c4d6f-631e-4633-a283-cfee60e00efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:34.123972 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c4d6f-631e-4633-a283-cfee60e00efa None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:34.124251 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c4d6f-631e-4633-a283-cfee60e00efa None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:34.124526 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c4d6f-631e-4633-a283-cfee60e00efa None admin] PATH_INFO: `/v3/domains/default` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:34.125659 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596c4d6f-631e-4633-a283-cfee60e00efa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:34.127124 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596c4d6f-631e-4633-a283-cfee60e00efa None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:34.129421 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 45/80] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 01:57:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:34.130105 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596c4d6f-631e-4633-a283-cfee60e00efa None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:34.154435 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:34.173800 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df7bee0-cdad-473c-a4cf-07515dc19655 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:34.207251 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60646eb8-0aaf-4924-bffa-e9c4cf41cd0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:34.207852 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60646eb8-0aaf-4924-bffa-e9c4cf41cd0a None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:34.208127 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60646eb8-0aaf-4924-bffa-e9c4cf41cd0a None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:34.208403 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60646eb8-0aaf-4924-bffa-e9c4cf41cd0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:34.230036 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596c4d6f-631e-4633-a283-cfee60e00efa None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:34.235834 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:34.263108 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cb37e5-ec89-4e8d-aed8-7109ee25ace1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:34.263713 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cb37e5-ec89-4e8d-aed8-7109ee25ace1 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:34.264001 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cb37e5-ec89-4e8d-aed8-7109ee25ace1 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:34.264279 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cb37e5-ec89-4e8d-aed8-7109ee25ace1 None admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:34.264938 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cb37e5-ec89-4e8d-aed8-7109ee25ace1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:57:34.265244 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cb37e5-ec89-4e8d-aed8-7109ee25ace1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:34.266661 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cb37e5-ec89-4e8d-aed8-7109ee25ace1 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:34.274846 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 46/81] 10.222.0.49 () {56 vars in 1101 bytes} [Thu Sep 29 01:57:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:34.275410 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cb37e5-ec89-4e8d-aed8-7109ee25ace1 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:34.277589 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60646eb8-0aaf-4924-bffa-e9c4cf41cd0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:34.279063 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60646eb8-0aaf-4924-bffa-e9c4cf41cd0a None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:34.364319 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:34.378973 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 36/82] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Sep 29 01:57:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 29 01:57:34.379579 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cb37e5-ec89-4e8d-aed8-7109ee25ace1 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:34.379824 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60646eb8-0aaf-4924-bffa-e9c4cf41cd0a None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:34.416407 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d06fb6a-352d-48ec-9760-12812ef862b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:34.417299 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d06fb6a-352d-48ec-9760-12812ef862b4 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:34.417759 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d06fb6a-352d-48ec-9760-12812ef862b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:34.418037 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d06fb6a-352d-48ec-9760-12812ef862b4 None admin] PATH_INFO: `/v3/users/a64bc3897f184f0bb688c7deb7e88f66` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:34.419156 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d06fb6a-352d-48ec-9760-12812ef862b4 None admin] RBAC: Authorizing `identity:get_user(user_id=a64bc3897f184f0bb688c7deb7e88f66)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:34.420617 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d06fb6a-352d-48ec-9760-12812ef862b4 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:34.422215 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 47/83] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Sep 29 01:57:34 2022] GET /identity/v3/users/a64bc3897f184f0bb688c7deb7e88f66 => generated 275 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:34.422956 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d06fb6a-352d-48ec-9760-12812ef862b4 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:34.437341 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:34.481573 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60646eb8-0aaf-4924-bffa-e9c4cf41cd0a None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:34.515607 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90802dac-483c-49cf-94b6-bab4eea40967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:34.516231 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90802dac-483c-49cf-94b6-bab4eea40967 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:34.516507 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90802dac-483c-49cf-94b6-bab4eea40967 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:34.516781 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90802dac-483c-49cf-94b6-bab4eea40967 None admin] PATH_INFO: `/v3/users/d04b7db4290a4ee3872fe98d8aad0254` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:34.517908 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90802dac-483c-49cf-94b6-bab4eea40967 None admin] RBAC: Authorizing `identity:get_user(user_id=d04b7db4290a4ee3872fe98d8aad0254)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:34.519891 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90802dac-483c-49cf-94b6-bab4eea40967 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:34.521474 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 37/84] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Sep 29 01:57:34 2022] GET /identity/v3/users/d04b7db4290a4ee3872fe98d8aad0254 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:34.522231 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90802dac-483c-49cf-94b6-bab4eea40967 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:34.522906 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d06fb6a-352d-48ec-9760-12812ef862b4 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:34.558686 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbbc5a7-462f-42cc-a62d-ce6833485b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:34.559292 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbbc5a7-462f-42cc-a62d-ce6833485b56 None admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:34.559570 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbbc5a7-462f-42cc-a62d-ce6833485b56 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:34.559843 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbbc5a7-462f-42cc-a62d-ce6833485b56 None admin] PATH_INFO: `/v3/users` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:34.560483 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbbc5a7-462f-42cc-a62d-ce6833485b56 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:34.561963 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbbc5a7-462f-42cc-a62d-ce6833485b56 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:34.582736 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 48/85] 10.222.0.49 () {60 vars in 1132 bytes} [Thu Sep 29 01:57:34 2022] POST /identity/v3/users => generated 289 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 01:57:34.583620 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbbc5a7-462f-42cc-a62d-ce6833485b56 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:34.595155 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:34.641798 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90802dac-483c-49cf-94b6-bab4eea40967 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:34.679285 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:34.690254 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed05769-8359-4333-9d75-6f175977f9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:34.691533 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed05769-8359-4333-9d75-6f175977f9dd None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:34.691849 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed05769-8359-4333-9d75-6f175977f9dd None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:34.692102 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed05769-8359-4333-9d75-6f175977f9dd None admin] PATH_INFO: `/v3/users/a64bc3897f184f0bb688c7deb7e88f66` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:34.693745 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed05769-8359-4333-9d75-6f175977f9dd None admin] RBAC: Authorizing `identity:get_user(user_id=a64bc3897f184f0bb688c7deb7e88f66)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:34.694868 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed05769-8359-4333-9d75-6f175977f9dd None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:34.696521 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 38/86] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Sep 29 01:57:34 2022] GET /identity/v3/users/a64bc3897f184f0bb688c7deb7e88f66 => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:34.697348 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed05769-8359-4333-9d75-6f175977f9dd None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:34.720537 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbbc5a7-462f-42cc-a62d-ce6833485b56 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:34.767062 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8a887d-fcf4-4ba6-a9c9-69417818f799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:34.767709 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8a887d-fcf4-4ba6-a9c9-69417818f799 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:34.767991 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8a887d-fcf4-4ba6-a9c9-69417818f799 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:34.768320 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8a887d-fcf4-4ba6-a9c9-69417818f799 None admin] PATH_INFO: `/v3/projects/ca184432008d4efaa18beac740258875` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:34.770264 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8a887d-fcf4-4ba6-a9c9-69417818f799 None admin] RBAC: Authorizing `identity:get_project(project_id=ca184432008d4efaa18beac740258875)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:34.771755 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8a887d-fcf4-4ba6-a9c9-69417818f799 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:34.773482 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 49/87] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Sep 29 01:57:34 2022] GET /identity/v3/projects/ca184432008d4efaa18beac740258875 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:34.778241 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8a887d-fcf4-4ba6-a9c9-69417818f799 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:34.826312 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed05769-8359-4333-9d75-6f175977f9dd None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:34.879213 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f109788-52f0-4748-9e2d-913592618f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:34.879843 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f109788-52f0-4748-9e2d-913592618f79 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:34.880266 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f109788-52f0-4748-9e2d-913592618f79 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:34.880467 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f109788-52f0-4748-9e2d-913592618f79 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:34.880928 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:34.923673 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8a887d-fcf4-4ba6-a9c9-69417818f799 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:34.975464 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:34.976722 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65303a5-6a6a-4bf5-814f-bef1bfeec2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:34.978324 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65303a5-6a6a-4bf5-814f-bef1bfeec2da None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:34.978324 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65303a5-6a6a-4bf5-814f-bef1bfeec2da None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:34.978324 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65303a5-6a6a-4bf5-814f-bef1bfeec2da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:34.988406 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f109788-52f0-4748-9e2d-913592618f79 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:34.990363 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f109788-52f0-4748-9e2d-913592618f79 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:35.063827 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65303a5-6a6a-4bf5-814f-bef1bfeec2da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:35.065573 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65303a5-6a6a-4bf5-814f-bef1bfeec2da None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:35.123209 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 39/88] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Sep 29 01:57:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 29 01:57:35.124329 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f109788-52f0-4748-9e2d-913592618f79 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:35.167729 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:35.202377 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 50/89] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Sep 29 01:57:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 29 01:57:35.203280 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65303a5-6a6a-4bf5-814f-bef1bfeec2da None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:35.258797 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:35.267933 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f109788-52f0-4748-9e2d-913592618f79 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:35.314545 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed4b380-8461-4685-a69e-3a660ec9cf1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:35.315475 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed4b380-8461-4685-a69e-3a660ec9cf1c None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:35.315757 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed4b380-8461-4685-a69e-3a660ec9cf1c None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:35.316665 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed4b380-8461-4685-a69e-3a660ec9cf1c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:35.333095 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65303a5-6a6a-4bf5-814f-bef1bfeec2da None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:35.374898 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612af466-119c-4cb2-88df-ed085c59475b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:35.375517 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612af466-119c-4cb2-88df-ed085c59475b None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:35.375797 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612af466-119c-4cb2-88df-ed085c59475b None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:35.376069 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612af466-119c-4cb2-88df-ed085c59475b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:35.376930 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612af466-119c-4cb2-88df-ed085c59475b None admin] RBAC: Adding query filter params (role.id=f157f905c9c94ccfbfb46e52d443e8f2, scope.project.id=ca184432008d4efaa18beac740258875, user.id=a64bc3897f184f0bb688c7deb7e88f66) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:57:35.377237 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612af466-119c-4cb2-88df-ed085c59475b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:35.378905 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612af466-119c-4cb2-88df-ed085c59475b None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:35.385181 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 51/90] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Sep 29 01:57:35 2022] GET /identity/v3/role_assignments?user.id=a64bc3897f184f0bb688c7deb7e88f66&scope.project.id=ca184432008d4efaa18beac740258875&role.id=f157f905c9c94ccfbfb46e52d443e8f2 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:35.387303 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612af466-119c-4cb2-88df-ed085c59475b None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:35.409497 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed4b380-8461-4685-a69e-3a660ec9cf1c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:35.410349 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed4b380-8461-4685-a69e-3a660ec9cf1c None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:35.477432 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:35.527856 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:35.543024 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 40/91] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Sep 29 01:57:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 29 01:57:35.544049 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed4b380-8461-4685-a69e-3a660ec9cf1c None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:35.600175 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612af466-119c-4cb2-88df-ed085c59475b None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:35.675126 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4657c463-46dd-4858-a73d-0f01902bcf49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:35.675792 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4657c463-46dd-4858-a73d-0f01902bcf49 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:35.676072 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4657c463-46dd-4858-a73d-0f01902bcf49 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:35.676348 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4657c463-46dd-4858-a73d-0f01902bcf49 None admin] PATH_INFO: `/v3/projects/ca184432008d4efaa18beac740258875` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:35.678159 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4657c463-46dd-4858-a73d-0f01902bcf49 None admin] RBAC: Authorizing `identity:get_project(project_id=ca184432008d4efaa18beac740258875)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:35.680192 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4657c463-46dd-4858-a73d-0f01902bcf49 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:35.681769 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 52/92] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Sep 29 01:57:35 2022] GET /identity/v3/projects/ca184432008d4efaa18beac740258875 => generated 298 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:35.682449 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4657c463-46dd-4858-a73d-0f01902bcf49 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:35.730368 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed4b380-8461-4685-a69e-3a660ec9cf1c None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:35.775725 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39796de9-e93a-4fbe-a3b4-105a766eb051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:35.776376 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39796de9-e93a-4fbe-a3b4-105a766eb051 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:35.776658 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39796de9-e93a-4fbe-a3b4-105a766eb051 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:35.776935 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39796de9-e93a-4fbe-a3b4-105a766eb051 None admin] PATH_INFO: `/v3/projects/ca184432008d4efaa18beac740258875` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:35.780665 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39796de9-e93a-4fbe-a3b4-105a766eb051 None admin] RBAC: Authorizing `identity:get_project(project_id=ca184432008d4efaa18beac740258875)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:35.782931 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39796de9-e93a-4fbe-a3b4-105a766eb051 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:35.786808 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 41/93] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Sep 29 01:57:35 2022] GET /identity/v3/projects/ca184432008d4efaa18beac740258875 => generated 298 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:35.787608 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39796de9-e93a-4fbe-a3b4-105a766eb051 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:35.888391 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4657c463-46dd-4858-a73d-0f01902bcf49 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:35.912088 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:35.921820 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:35.946675 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aa64e0-a8cd-49a6-a85f-13ebdc00d8ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:35.947365 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aa64e0-a8cd-49a6-a85f-13ebdc00d8ac None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:35.947647 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aa64e0-a8cd-49a6-a85f-13ebdc00d8ac None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:35.947922 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aa64e0-a8cd-49a6-a85f-13ebdc00d8ac None admin] PATH_INFO: `/v3/projects/18a24e8d1f9f48a7accddadf2965dea9` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:35.949094 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aa64e0-a8cd-49a6-a85f-13ebdc00d8ac None admin] RBAC: Authorizing `identity:get_project(project_id=18a24e8d1f9f48a7accddadf2965dea9)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:35.951100 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aa64e0-a8cd-49a6-a85f-13ebdc00d8ac None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:35.952904 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 53/94] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Sep 29 01:57:35 2022] GET /identity/v3/projects/18a24e8d1f9f48a7accddadf2965dea9 => generated 312 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:35.954078 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aa64e0-a8cd-49a6-a85f-13ebdc00d8ac None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:36.010053 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39796de9-e93a-4fbe-a3b4-105a766eb051 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:36.079200 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc61f663-3d1f-4273-967b-919fff387f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:36.081126 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc61f663-3d1f-4273-967b-919fff387f07 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:36.082218 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc61f663-3d1f-4273-967b-919fff387f07 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:36.082853 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc61f663-3d1f-4273-967b-919fff387f07 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:36.084885 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aa64e0-a8cd-49a6-a85f-13ebdc00d8ac None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:36.085885 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc61f663-3d1f-4273-967b-919fff387f07 None admin] RBAC: Adding query filter params (role.id=8de931d79c9d4c8daf717aaea348dda9, scope.project.id=ca184432008d4efaa18beac740258875, user.id=a64bc3897f184f0bb688c7deb7e88f66) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:57:36.086423 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc61f663-3d1f-4273-967b-919fff387f07 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:36.088078 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc61f663-3d1f-4273-967b-919fff387f07 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:36.106702 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 42/95] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Sep 29 01:57:35 2022] GET /identity/v3/role_assignments?user.id=a64bc3897f184f0bb688c7deb7e88f66&scope.project.id=ca184432008d4efaa18beac740258875&role.id=8de931d79c9d4c8daf717aaea348dda9 => generated 259 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:36.110895 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc61f663-3d1f-4273-967b-919fff387f07 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:36.169722 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71097f1-5958-46e1-8ab8-34a63bb8637c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:36.172101 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71097f1-5958-46e1-8ab8-34a63bb8637c None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:36.172594 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71097f1-5958-46e1-8ab8-34a63bb8637c None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:36.173093 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71097f1-5958-46e1-8ab8-34a63bb8637c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:36.175348 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71097f1-5958-46e1-8ab8-34a63bb8637c None admin] RBAC: Adding query filter params (role.id=fe9bbc67742f4f5893f39b18eb31d59a, scope.project.id=ca184432008d4efaa18beac740258875, user.id=d04b7db4290a4ee3872fe98d8aad0254) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:57:36.177618 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71097f1-5958-46e1-8ab8-34a63bb8637c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:36.179635 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71097f1-5958-46e1-8ab8-34a63bb8637c None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:36.198659 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 54/96] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Sep 29 01:57:35 2022] GET /identity/v3/role_assignments?user.id=d04b7db4290a4ee3872fe98d8aad0254&scope.project.id=ca184432008d4efaa18beac740258875&role.id=fe9bbc67742f4f5893f39b18eb31d59a => generated 259 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:36.271503 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc61f663-3d1f-4273-967b-919fff387f07 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:36.301245 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:36.311596 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cafa25-14bf-4cd5-b167-8b24d8632dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:36.312619 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cafa25-14bf-4cd5-b167-8b24d8632dde None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:36.313104 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cafa25-14bf-4cd5-b167-8b24d8632dde None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:36.313606 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cafa25-14bf-4cd5-b167-8b24d8632dde None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:36.314544 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cafa25-14bf-4cd5-b167-8b24d8632dde None admin] RBAC: Adding query filter params (role.id=f157f905c9c94ccfbfb46e52d443e8f2, scope.project.id=18a24e8d1f9f48a7accddadf2965dea9, user.id=a64bc3897f184f0bb688c7deb7e88f66) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:57:36.315084 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cafa25-14bf-4cd5-b167-8b24d8632dde None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:36.316811 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cafa25-14bf-4cd5-b167-8b24d8632dde None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:36.323573 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 43/97] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Sep 29 01:57:36 2022] GET /identity/v3/role_assignments?user.id=a64bc3897f184f0bb688c7deb7e88f66&scope.project.id=18a24e8d1f9f48a7accddadf2965dea9&role.id=f157f905c9c94ccfbfb46e52d443e8f2 => generated 259 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:37.315721 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b118158-b8e1-4093-bdec-55a43265c232 None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:37.316720 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b118158-b8e1-4093-bdec-55a43265c232 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:37.317245 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b118158-b8e1-4093-bdec-55a43265c232 None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:37.318821 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 55/98] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:57:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:57:37.343144 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca3d31-2a3d-49f8-90f9-50d77beda9cc None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:37.344074 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca3d31-2a3d-49f8-90f9-50d77beda9cc None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:37.344552 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca3d31-2a3d-49f8-90f9-50d77beda9cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:37.374299 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-a2ca3d31-2a3d-49f8-90f9-50d77beda9cc None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:57:37.375867 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-a2ca3d31-2a3d-49f8-90f9-50d77beda9cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:57:37.467896 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 44/99] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:57:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:57:37.700863 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e97a26-191e-45e1-ae77-ea8705bb382b None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:37.701536 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e97a26-191e-45e1-ae77-ea8705bb382b None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:37.702022 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e97a26-191e-45e1-ae77-ea8705bb382b None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:37.703816 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 56/100] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:57:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:57:37.710151 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a116227-89d1-409f-bc2e-3e9f39cabfb8 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:37.710678 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a116227-89d1-409f-bc2e-3e9f39cabfb8 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:37.711152 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a116227-89d1-409f-bc2e-3e9f39cabfb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:37.734273 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-4a116227-89d1-409f-bc2e-3e9f39cabfb8 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:57:37.735800 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-4a116227-89d1-409f-bc2e-3e9f39cabfb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:57:37.827132 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 45/101] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:57:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:57:37.991491 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e97a26-191e-45e1-ae77-ea8705bb382b None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:38.045079 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:38.142910 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e97a26-191e-45e1-ae77-ea8705bb382b None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:38.194014 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ed2bdb-952a-45a9-8a13-0ea2bc44280c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:38.195001 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed2bdb-952a-45a9-8a13-0ea2bc44280c None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:38.195490 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed2bdb-952a-45a9-8a13-0ea2bc44280c None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:38.195963 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed2bdb-952a-45a9-8a13-0ea2bc44280c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:38.210180 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ed2bdb-952a-45a9-8a13-0ea2bc44280c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:57:38.215476 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-82ed2bdb-952a-45a9-8a13-0ea2bc44280c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 29 01:57:38.215476 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:57:38.215476 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:57:38.215476 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:57:38.215476 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:57:38.215476 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:57:38.215476 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:57:38.215476 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:57:38.215476 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:57:38.215476 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:57:38.215476 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:57:38.215476 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:57:38.215476 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:57:38.215476 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:57:38.215476 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:57:38.215476 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:57:38.216338 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:57:38.216338 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:57:38.216338 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:57:38.216338 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:57:38.216338 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:57:38.216338 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:57:38.216338 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:57:38.216338 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:57:38.216338 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:57:38.216338 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:57:38.216338 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:57:38.216338 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:57:38.216338 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:57:38.216338 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:57:38.216338 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:57:38.216338 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:57:38.217079 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:57:38.217079 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:57:38.217079 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:57:38.217079 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:57:38.217079 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:57:38.217079 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:57:38.217079 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:57:38.217079 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:57:38.217079 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:57:38.217079 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:57:38.217079 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 29 01:57:38.217079 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:57:38.219300 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 57/102] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Sep 29 01:57:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:57:38.225718 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a116227-89d1-409f-bc2e-3e9f39cabfb8 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:38.282168 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:38.342816 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a116227-89d1-409f-bc2e-3e9f39cabfb8 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:38.365771 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ed2bdb-952a-45a9-8a13-0ea2bc44280c None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:38.408019 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05631a96-14c4-4656-83d5-9df2733e51be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:38.408814 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05631a96-14c4-4656-83d5-9df2733e51be None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:38.409656 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05631a96-14c4-4656-83d5-9df2733e51be None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:38.409992 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05631a96-14c4-4656-83d5-9df2733e51be None admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:38.410676 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05631a96-14c4-4656-83d5-9df2733e51be None admin] RBAC: Adding query filter params (name=reader) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:57:38.410982 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05631a96-14c4-4656-83d5-9df2733e51be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:38.412368 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05631a96-14c4-4656-83d5-9df2733e51be None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:38.438331 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 46/103] 10.222.0.49 () {56 vars in 1101 bytes} [Thu Sep 29 01:57:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:38.446345 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05631a96-14c4-4656-83d5-9df2733e51be None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:38.571189 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ed2bdb-952a-45a9-8a13-0ea2bc44280c None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:38.576596 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:38.625631 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05631a96-14c4-4656-83d5-9df2733e51be None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:38.639848 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:38.647774 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f655477-b386-4936-bb71-c2661cc16aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:38.648442 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f655477-b386-4936-bb71-c2661cc16aad None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:38.648729 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f655477-b386-4936-bb71-c2661cc16aad None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:38.649008 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f655477-b386-4936-bb71-c2661cc16aad None admin] PATH_INFO: `/v3/domains/default` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:38.653986 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f655477-b386-4936-bb71-c2661cc16aad None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:38.655470 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f655477-b386-4936-bb71-c2661cc16aad None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:38.661350 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 58/104] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 01:57:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:57:38.661350 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0bf55-c504-42a8-8a95-b28f0daa6139 None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:38.661350 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0bf55-c504-42a8-8a95-b28f0daa6139 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:38.661350 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0bf55-c504-42a8-8a95-b28f0daa6139 None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:38.667369 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 59/105] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:57:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:57:38.667369 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c0bf55-c504-42a8-8a95-b28f0daa6139 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:38.672948 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42ba781-bce6-49ee-8385-6eed7448342e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:38.673920 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ba781-bce6-49ee-8385-6eed7448342e None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:38.674450 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ba781-bce6-49ee-8385-6eed7448342e None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:38.674919 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ba781-bce6-49ee-8385-6eed7448342e None admin] PATH_INFO: `/v3/users/92d2696b0e0445b1a01e8875b26e8224` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:38.694829 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42ba781-bce6-49ee-8385-6eed7448342e None admin] RBAC: Authorizing `identity:get_user(user_id=92d2696b0e0445b1a01e8875b26e8224)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:38.696751 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42ba781-bce6-49ee-8385-6eed7448342e None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:38.698731 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 47/106] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Sep 29 01:57:38 2022] GET /identity/v3/users/92d2696b0e0445b1a01e8875b26e8224 => generated 289 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:38.700245 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1f903c-2cb1-4493-9fe1-ea71c7617544 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:38.700741 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1f903c-2cb1-4493-9fe1-ea71c7617544 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:38.701215 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1f903c-2cb1-4493-9fe1-ea71c7617544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:38.720391 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-ff1f903c-2cb1-4493-9fe1-ea71c7617544 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:57:38.722009 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-ff1f903c-2cb1-4493-9fe1-ea71c7617544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:57:38.795119 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 48/107] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:57:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:57:38.796295 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1f903c-2cb1-4493-9fe1-ea71c7617544 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:38.902664 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c0bf55-c504-42a8-8a95-b28f0daa6139 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:38.960726 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:38.967524 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1f903c-2cb1-4493-9fe1-ea71c7617544 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:38.990068 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3b51b9-d020-4184-8353-b65d64d2f074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:38.990705 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3b51b9-d020-4184-8353-b65d64d2f074 None admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:38.990996 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3b51b9-d020-4184-8353-b65d64d2f074 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:38.991275 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3b51b9-d020-4184-8353-b65d64d2f074 None admin] PATH_INFO: `/v3/projects` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:38.991945 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3b51b9-d020-4184-8353-b65d64d2f074 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:38.993442 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3b51b9-d020-4184-8353-b65d64d2f074 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:39.029294 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f45809-efa4-48cc-a978-8d891e431146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:39.030003 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f45809-efa4-48cc-a978-8d891e431146 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:39.030282 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f45809-efa4-48cc-a978-8d891e431146 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:39.033123 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f45809-efa4-48cc-a978-8d891e431146 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:39.057112 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 60/108] 10.222.0.49 () {60 vars in 1141 bytes} [Thu Sep 29 01:57:38 2022] POST /identity/v3/projects => generated 302 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 01:57:39.141372 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f45809-efa4-48cc-a978-8d891e431146 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:39.142883 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f45809-efa4-48cc-a978-8d891e431146 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:39.282065 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:39.288345 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 49/109] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Sep 29 01:57:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 29 01:57:39.292571 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3b51b9-d020-4184-8353-b65d64d2f074 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:39.334829 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:39.373372 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40934d6-158d-4057-9b83-6ac26b954454 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:39.373828 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40934d6-158d-4057-9b83-6ac26b954454 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:39.374117 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40934d6-158d-4057-9b83-6ac26b954454 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:39.375866 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 50/110] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:57:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 29 01:57:39.399608 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff5572-1915-452c-9776-96f1f0109ce2 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:39.399941 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff5572-1915-452c-9776-96f1f0109ce2 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:39.400162 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff5572-1915-452c-9776-96f1f0109ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:39.427144 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-6cff5572-1915-452c-9776-96f1f0109ce2 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:57:39.428357 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-6cff5572-1915-452c-9776-96f1f0109ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:57:39.448543 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3b51b9-d020-4184-8353-b65d64d2f074 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:39.517452 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea1f4d6-5a3d-48d4-87fc-2b3f726584b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:39.518109 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea1f4d6-5a3d-48d4-87fc-2b3f726584b6 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:39.518455 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea1f4d6-5a3d-48d4-87fc-2b3f726584b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:39.518942 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea1f4d6-5a3d-48d4-87fc-2b3f726584b6 None admin] PATH_INFO: `/v3/projects/ca184432008d4efaa18beac740258875` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:39.521221 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea1f4d6-5a3d-48d4-87fc-2b3f726584b6 None admin] RBAC: Authorizing `identity:get_project(project_id=ca184432008d4efaa18beac740258875)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:39.522766 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea1f4d6-5a3d-48d4-87fc-2b3f726584b6 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:39.524544 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 61/111] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Sep 29 01:57:39 2022] GET /identity/v3/projects/ca184432008d4efaa18beac740258875 => generated 298 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:39.530701 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea1f4d6-5a3d-48d4-87fc-2b3f726584b6 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:39.559776 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 51/112] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:57:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 29 01:57:39.565574 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dec3d3c-c532-444d-a3ab-944f7ff5e811 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:39.565574 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dec3d3c-c532-444d-a3ab-944f7ff5e811 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:39.565574 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dec3d3c-c532-444d-a3ab-944f7ff5e811 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:39.565574 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 52/113] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:57:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:57:39.565574 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dec3d3c-c532-444d-a3ab-944f7ff5e811 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:39.661836 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:39.676720 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea1f4d6-5a3d-48d4-87fc-2b3f726584b6 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:39.687884 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dec3d3c-c532-444d-a3ab-944f7ff5e811 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:39.715385 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2a13bd-5542-4679-b649-2a938729bda4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:39.716248 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a13bd-5542-4679-b649-2a938729bda4 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:39.716699 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a13bd-5542-4679-b649-2a938729bda4 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:39.717138 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a13bd-5542-4679-b649-2a938729bda4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:39.718128 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2a13bd-5542-4679-b649-2a938729bda4 None admin] RBAC: Adding query filter params (role.id=63a7737d5e4b42ccbfdd40451c4a1c77, scope.project.id=ca184432008d4efaa18beac740258875, user.id=92d2696b0e0445b1a01e8875b26e8224) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:57:39.718666 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2a13bd-5542-4679-b649-2a938729bda4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:39.720391 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2a13bd-5542-4679-b649-2a938729bda4 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:39.723558 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:39.727213 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 62/114] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Sep 29 01:57:39 2022] GET /identity/v3/role_assignments?user.id=92d2696b0e0445b1a01e8875b26e8224&scope.project.id=ca184432008d4efaa18beac740258875&role.id=63a7737d5e4b42ccbfdd40451c4a1c77 => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:39.728690 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4273c445-dd96-4094-949e-a1819e7c0a60 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:39.729111 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4273c445-dd96-4094-949e-a1819e7c0a60 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:39.729543 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4273c445-dd96-4094-949e-a1819e7c0a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:39.731188 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35e8a26-c71d-44f0-a3d5-8290b1733bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:39.732055 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35e8a26-c71d-44f0-a3d5-8290b1733bf1 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:39.732478 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35e8a26-c71d-44f0-a3d5-8290b1733bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:39.733197 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35e8a26-c71d-44f0-a3d5-8290b1733bf1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:39.747958 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35e8a26-c71d-44f0-a3d5-8290b1733bf1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:57:39.750391 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-4273c445-dd96-4094-949e-a1819e7c0a60 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:57:39.751816 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-4273c445-dd96-4094-949e-a1819e7c0a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:57:39.754510 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-a35e8a26-c71d-44f0-a3d5-8290b1733bf1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 29 01:57:39.754510 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:57:39.754510 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:57:39.754510 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:57:39.754510 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:57:39.754510 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:57:39.754510 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:57:39.754510 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:57:39.754510 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:57:39.754510 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:57:39.754510 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:57:39.754510 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:57:39.754510 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:57:39.754510 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:57:39.754510 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:57:39.754510 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:57:39.755376 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:57:39.755376 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:57:39.755376 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:57:39.755376 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:57:39.755376 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:57:39.755376 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:57:39.755376 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:57:39.755376 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:57:39.755376 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:57:39.755376 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:57:39.755376 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:57:39.755376 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:57:39.755376 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:57:39.755376 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:57:39.755376 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:57:39.755376 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:57:39.756114 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:57:39.756114 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:57:39.756114 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:57:39.756114 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:57:39.756114 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:57:39.756114 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:57:39.756114 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:57:39.756114 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:57:39.756114 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:57:39.756114 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:57:39.756114 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 29 01:57:39.756114 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:57:39.758584 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 53/115] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Sep 29 01:57:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:57:39.760212 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ba1aa-e3b0-4d74-87f9-57b659c3b488 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:39.760731 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ba1aa-e3b0-4d74-87f9-57b659c3b488 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:39.761178 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ba1aa-e3b0-4d74-87f9-57b659c3b488 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:39.763520 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 54/116] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:57:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:57:39.770347 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786fa62c-3a5f-4877-9a25-c58a1696f923 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:39.770848 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786fa62c-3a5f-4877-9a25-c58a1696f923 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:39.771304 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786fa62c-3a5f-4877-9a25-c58a1696f923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:39.791322 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-786fa62c-3a5f-4877-9a25-c58a1696f923 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:57:39.793165 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-786fa62c-3a5f-4877-9a25-c58a1696f923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:57:39.833487 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 63/117] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:57:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:57:39.834407 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4273c445-dd96-4094-949e-a1819e7c0a60 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:39.917601 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 55/118] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:57:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 29 01:57:39.964576 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786fa62c-3a5f-4877-9a25-c58a1696f923 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:40.033771 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:40.068143 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4273c445-dd96-4094-949e-a1819e7c0a60 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:40.115657 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786fa62c-3a5f-4877-9a25-c58a1696f923 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:40.136778 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:40.138607 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b5c094-fc22-4ae3-97e6-0d1808718e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:40.139307 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b5c094-fc22-4ae3-97e6-0d1808718e1a None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:40.139598 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b5c094-fc22-4ae3-97e6-0d1808718e1a None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:40.139953 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b5c094-fc22-4ae3-97e6-0d1808718e1a None admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:40.140676 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b5c094-fc22-4ae3-97e6-0d1808718e1a None admin] RBAC: Adding query filter params (name=member) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:57:40.140984 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b5c094-fc22-4ae3-97e6-0d1808718e1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:40.142477 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b5c094-fc22-4ae3-97e6-0d1808718e1a None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:40.157212 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 64/119] 10.222.0.49 () {56 vars in 1101 bytes} [Thu Sep 29 01:57:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:40.163135 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b5c094-fc22-4ae3-97e6-0d1808718e1a None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:40.174018 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b88b6a8-1ae9-4fb9-a2d3-caa545291b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:40.174870 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b88b6a8-1ae9-4fb9-a2d3-caa545291b51 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:40.175154 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b88b6a8-1ae9-4fb9-a2d3-caa545291b51 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:40.175454 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b88b6a8-1ae9-4fb9-a2d3-caa545291b51 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:40.189659 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b88b6a8-1ae9-4fb9-a2d3-caa545291b51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:57:40.195499 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-4b88b6a8-1ae9-4fb9-a2d3-caa545291b51 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 29 01:57:40.195499 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:57:40.195499 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:57:40.195499 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:57:40.195499 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:57:40.195499 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:57:40.195499 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:57:40.195499 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:57:40.195499 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:57:40.195499 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:57:40.195499 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:57:40.195499 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:57:40.195499 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:57:40.195499 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:57:40.195499 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:57:40.195499 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:57:40.196328 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:57:40.196328 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:57:40.196328 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:57:40.196328 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:57:40.196328 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:57:40.196328 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:57:40.196328 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:57:40.196328 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:57:40.196328 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:57:40.196328 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:57:40.196328 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:57:40.196328 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:57:40.196328 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:57:40.196328 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:57:40.196328 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:57:40.196328 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:57:40.197676 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:57:40.197676 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:57:40.197676 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:57:40.197676 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:57:40.197676 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:57:40.197676 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:57:40.197676 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:57:40.197676 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:57:40.197676 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:57:40.197676 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:57:40.197676 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 29 01:57:40.197676 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:57:40.197676 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 56/120] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Sep 29 01:57:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 01:57:40.202256 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b88b6a8-1ae9-4fb9-a2d3-caa545291b51 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:40.324737 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b5c094-fc22-4ae3-97e6-0d1808718e1a None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:40.349206 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b88b6a8-1ae9-4fb9-a2d3-caa545291b51 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:40.371397 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b808e46-fb5f-419f-b043-bbcc1f2d6e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:40.372800 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b808e46-fb5f-419f-b043-bbcc1f2d6e33 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:40.373554 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b808e46-fb5f-419f-b043-bbcc1f2d6e33 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:40.373978 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b808e46-fb5f-419f-b043-bbcc1f2d6e33 None admin] PATH_INFO: `/v3/users/a64bc3897f184f0bb688c7deb7e88f66` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:40.375963 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b808e46-fb5f-419f-b043-bbcc1f2d6e33 None admin] RBAC: Authorizing `identity:get_user(user_id=a64bc3897f184f0bb688c7deb7e88f66)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:40.378718 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b808e46-fb5f-419f-b043-bbcc1f2d6e33 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:40.381429 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 65/121] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Sep 29 01:57:40 2022] GET /identity/v3/users/a64bc3897f184f0bb688c7deb7e88f66 => generated 275 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:57:40.382974 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b808e46-fb5f-419f-b043-bbcc1f2d6e33 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:40.387211 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdff42a-847d-4b31-acc9-7eabe4ad6726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:40.387931 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdff42a-847d-4b31-acc9-7eabe4ad6726 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:40.388272 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdff42a-847d-4b31-acc9-7eabe4ad6726 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:40.388633 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdff42a-847d-4b31-acc9-7eabe4ad6726 None admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:40.389399 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdff42a-847d-4b31-acc9-7eabe4ad6726 None admin] RBAC: Adding query filter params (name=member) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:57:40.389769 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdff42a-847d-4b31-acc9-7eabe4ad6726 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:40.391312 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdff42a-847d-4b31-acc9-7eabe4ad6726 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:40.400583 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 57/122] 10.222.0.49 () {56 vars in 1101 bytes} [Thu Sep 29 01:57:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:57:40.402817 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:40.406047 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdff42a-847d-4b31-acc9-7eabe4ad6726 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:40.458109 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:40.522823 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdff42a-847d-4b31-acc9-7eabe4ad6726 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:40.531019 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b808e46-fb5f-419f-b043-bbcc1f2d6e33 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:40.562070 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43884b3d-e89d-48ee-9b81-441270952384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:40.562636 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43884b3d-e89d-48ee-9b81-441270952384 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:40.562894 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43884b3d-e89d-48ee-9b81-441270952384 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:40.563169 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43884b3d-e89d-48ee-9b81-441270952384 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:40.573968 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43884b3d-e89d-48ee-9b81-441270952384 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:57:40.578821 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5b30fd-1be8-44e3-8fa9-48d2a0171180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:40.579349 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-43884b3d-e89d-48ee-9b81-441270952384 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 01:57:40.579349 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:57:40.579349 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:57:40.579349 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:57:40.579349 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:57:40.579349 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:57:40.579349 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:57:40.579349 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:57:40.579349 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:57:40.579349 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:57:40.579349 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:57:40.579349 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:57:40.579349 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:57:40.579349 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:57:40.579349 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:57:40.579349 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:57:40.580169 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:57:40.580169 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:57:40.580169 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:57:40.580169 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:57:40.580169 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:57:40.580169 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:57:40.580169 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:57:40.580169 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:57:40.580169 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:57:40.580169 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:57:40.580169 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:57:40.580169 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:57:40.580169 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:57:40.580169 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:57:40.580169 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:57:40.580169 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:57:40.581478 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:57:40.581478 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:57:40.581478 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:57:40.581478 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:57:40.581478 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:57:40.581478 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:57:40.581478 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:57:40.581478 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:57:40.581478 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:57:40.581478 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:57:40.581478 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 01:57:40.581478 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:57:40.581478 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 58/123] 10.222.0.49 () {56 vars in 1096 bytes} [Thu Sep 29 01:57:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:57:40.582113 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43884b3d-e89d-48ee-9b81-441270952384 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:40.587664 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b30fd-1be8-44e3-8fa9-48d2a0171180 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:40.587664 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b30fd-1be8-44e3-8fa9-48d2a0171180 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:40.587664 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b30fd-1be8-44e3-8fa9-48d2a0171180 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:40.605982 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5b30fd-1be8-44e3-8fa9-48d2a0171180 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:57:40.614356 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-3f5b30fd-1be8-44e3-8fa9-48d2a0171180 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 29 01:57:40.614356 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:57:40.614356 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:57:40.614356 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:57:40.614356 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:57:40.614356 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:57:40.614356 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:57:40.614356 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:57:40.614356 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:57:40.614356 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:57:40.614356 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:57:40.614356 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:57:40.614356 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:57:40.614356 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:57:40.614356 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:57:40.614356 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:57:40.615265 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:57:40.615265 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:57:40.615265 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:57:40.615265 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:57:40.615265 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:57:40.615265 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:57:40.615265 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:57:40.615265 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:57:40.615265 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:57:40.615265 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:57:40.615265 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:57:40.615265 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:57:40.615265 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:57:40.615265 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:57:40.615265 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:57:40.615265 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:57:40.616009 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:57:40.616009 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:57:40.616009 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:57:40.616009 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:57:40.616009 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:57:40.616009 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:57:40.616009 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:57:40.616009 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:57:40.616009 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:57:40.616009 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:57:40.616009 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 29 01:57:40.616009 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:57:40.623900 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 66/124] 10.222.0.49 () {56 vars in 1114 bytes} [Thu Sep 29 01:57:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:57:40.623900 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5b30fd-1be8-44e3-8fa9-48d2a0171180 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:40.703235 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43884b3d-e89d-48ee-9b81-441270952384 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:40.704900 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:40.730464 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:40.747095 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682768e0-11be-4072-bd08-9def65ab8873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:40.748212 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682768e0-11be-4072-bd08-9def65ab8873 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:40.748692 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682768e0-11be-4072-bd08-9def65ab8873 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:40.749203 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682768e0-11be-4072-bd08-9def65ab8873 None admin] PATH_INFO: `/v3/projects/ca184432008d4efaa18beac740258875` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:40.750557 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682768e0-11be-4072-bd08-9def65ab8873 None admin] RBAC: Authorizing `identity:get_project(project_id=ca184432008d4efaa18beac740258875)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:40.760138 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682768e0-11be-4072-bd08-9def65ab8873 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:40.762297 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 59/125] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Sep 29 01:57:40 2022] GET /identity/v3/projects/ca184432008d4efaa18beac740258875 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:40.763453 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682768e0-11be-4072-bd08-9def65ab8873 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:40.768671 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5b30fd-1be8-44e3-8fa9-48d2a0171180 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:40.803616 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb7dec8-c863-4f7f-92db-50406e37e564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:40.804284 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb7dec8-c863-4f7f-92db-50406e37e564 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:40.804565 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb7dec8-c863-4f7f-92db-50406e37e564 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:40.804840 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb7dec8-c863-4f7f-92db-50406e37e564 None admin] PATH_INFO: `/v3/users/a64bc3897f184f0bb688c7deb7e88f66` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:40.806122 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb7dec8-c863-4f7f-92db-50406e37e564 None admin] RBAC: Authorizing `identity:get_user(user_id=a64bc3897f184f0bb688c7deb7e88f66)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:40.808040 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb7dec8-c863-4f7f-92db-50406e37e564 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:40.814126 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 67/126] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Sep 29 01:57:40 2022] GET /identity/v3/users/a64bc3897f184f0bb688c7deb7e88f66 => generated 275 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:40.815259 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb7dec8-c863-4f7f-92db-50406e37e564 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:40.882528 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682768e0-11be-4072-bd08-9def65ab8873 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:40.917588 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb7dec8-c863-4f7f-92db-50406e37e564 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:40.932560 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df1e695-d76a-4a50-af69-ffe2d603257e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:40.933526 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df1e695-d76a-4a50-af69-ffe2d603257e None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:40.934007 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df1e695-d76a-4a50-af69-ffe2d603257e None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:40.934527 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df1e695-d76a-4a50-af69-ffe2d603257e None admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:40.935569 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df1e695-d76a-4a50-af69-ffe2d603257e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:57:40.936068 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df1e695-d76a-4a50-af69-ffe2d603257e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:40.937755 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df1e695-d76a-4a50-af69-ffe2d603257e None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:40.952084 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 60/127] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Sep 29 01:57:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:40.952084 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df1e695-d76a-4a50-af69-ffe2d603257e None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:40.958218 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0c8875-7965-4d78-be7c-5d15e24369c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:40.959096 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c8875-7965-4d78-be7c-5d15e24369c4 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:40.959596 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c8875-7965-4d78-be7c-5d15e24369c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:40.960066 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c8875-7965-4d78-be7c-5d15e24369c4 None admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:40.961544 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0c8875-7965-4d78-be7c-5d15e24369c4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:57:40.962053 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0c8875-7965-4d78-be7c-5d15e24369c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:40.964608 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0c8875-7965-4d78-be7c-5d15e24369c4 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:40.983812 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 68/128] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Sep 29 01:57:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:40.983812 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0c8875-7965-4d78-be7c-5d15e24369c4 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:40.987311 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:40.991215 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:41.081776 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df1e695-d76a-4a50-af69-ffe2d603257e None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:41.116783 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0c8875-7965-4d78-be7c-5d15e24369c4 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:41.119233 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5c17ed-48f1-482c-ad11-6d023acb4b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:41.120104 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5c17ed-48f1-482c-ad11-6d023acb4b86 None admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:41.121107 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5c17ed-48f1-482c-ad11-6d023acb4b86 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:41.121107 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5c17ed-48f1-482c-ad11-6d023acb4b86 None admin] PATH_INFO: `/v3/projects/ca184432008d4efaa18beac740258875/users/a64bc3897f184f0bb688c7deb7e88f66/roles/f157f905c9c94ccfbfb46e52d443e8f2` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:41.123002 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5c17ed-48f1-482c-ad11-6d023acb4b86 None admin] RBAC: Authorizing `identity:create_grant(project_id=ca184432008d4efaa18beac740258875, user_id=a64bc3897f184f0bb688c7deb7e88f66, role_id=f157f905c9c94ccfbfb46e52d443e8f2)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:41.124785 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5c17ed-48f1-482c-ad11-6d023acb4b86 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:41.150472 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 61/129] 10.222.0.49 () {58 vars in 1439 bytes} [Thu Sep 29 01:57:40 2022] PUT /identity/v3/projects/ca184432008d4efaa18beac740258875/users/a64bc3897f184f0bb688c7deb7e88f66/roles/f157f905c9c94ccfbfb46e52d443e8f2 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 01:57:41.151234 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5c17ed-48f1-482c-ad11-6d023acb4b86 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:41.184724 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaf00a6-f40c-4942-aa88-8859affea457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:41.185489 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf00a6-f40c-4942-aa88-8859affea457 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:41.185778 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf00a6-f40c-4942-aa88-8859affea457 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:41.186055 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf00a6-f40c-4942-aa88-8859affea457 None admin] PATH_INFO: `/v3/projects/18a24e8d1f9f48a7accddadf2965dea9` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:41.189948 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaf00a6-f40c-4942-aa88-8859affea457 None admin] RBAC: Authorizing `identity:get_project(project_id=18a24e8d1f9f48a7accddadf2965dea9)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:41.194424 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaf00a6-f40c-4942-aa88-8859affea457 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:41.197096 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 69/130] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Sep 29 01:57:40 2022] GET /identity/v3/projects/18a24e8d1f9f48a7accddadf2965dea9 => generated 312 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:41.199988 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaf00a6-f40c-4942-aa88-8859affea457 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:41.303580 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:41.314347 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5c17ed-48f1-482c-ad11-6d023acb4b86 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:41.354405 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2ce5b6-0609-47b8-918a-de9a2361ae15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:41.355312 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2ce5b6-0609-47b8-918a-de9a2361ae15 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:41.355600 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2ce5b6-0609-47b8-918a-de9a2361ae15 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:41.355883 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2ce5b6-0609-47b8-918a-de9a2361ae15 None admin] PATH_INFO: `/v3/users/d04b7db4290a4ee3872fe98d8aad0254` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:41.357041 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2ce5b6-0609-47b8-918a-de9a2361ae15 None admin] RBAC: Authorizing `identity:get_user(user_id=d04b7db4290a4ee3872fe98d8aad0254)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:41.359036 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2ce5b6-0609-47b8-918a-de9a2361ae15 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:41.360723 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 62/131] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Sep 29 01:57:41 2022] GET /identity/v3/users/d04b7db4290a4ee3872fe98d8aad0254 => generated 247 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:41.361738 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2ce5b6-0609-47b8-918a-de9a2361ae15 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:41.391507 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:41.442229 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaf00a6-f40c-4942-aa88-8859affea457 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:41.484084 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fb5c55-c305-4e93-9012-c9d16b5762a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:41.484733 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fb5c55-c305-4e93-9012-c9d16b5762a3 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:41.485018 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fb5c55-c305-4e93-9012-c9d16b5762a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:41.485298 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fb5c55-c305-4e93-9012-c9d16b5762a3 None admin] PATH_INFO: `/v3/users/a64bc3897f184f0bb688c7deb7e88f66` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:41.486484 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fb5c55-c305-4e93-9012-c9d16b5762a3 None admin] RBAC: Authorizing `identity:get_user(user_id=a64bc3897f184f0bb688c7deb7e88f66)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:41.488882 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fb5c55-c305-4e93-9012-c9d16b5762a3 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:41.491213 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2ce5b6-0609-47b8-918a-de9a2361ae15 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:41.491668 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 70/132] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Sep 29 01:57:41 2022] GET /identity/v3/users/a64bc3897f184f0bb688c7deb7e88f66 => generated 275 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:41.492522 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fb5c55-c305-4e93-9012-c9d16b5762a3 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:41.535768 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ed0525-ebca-480c-b5dc-7fad05e43405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:41.536447 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed0525-ebca-480c-b5dc-7fad05e43405 None admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:41.537710 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed0525-ebca-480c-b5dc-7fad05e43405 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:41.537997 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed0525-ebca-480c-b5dc-7fad05e43405 None admin] PATH_INFO: `/v3/projects/18a24e8d1f9f48a7accddadf2965dea9/users/a64bc3897f184f0bb688c7deb7e88f66/roles/f157f905c9c94ccfbfb46e52d443e8f2` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:41.540590 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ed0525-ebca-480c-b5dc-7fad05e43405 None admin] RBAC: Authorizing `identity:create_grant(project_id=18a24e8d1f9f48a7accddadf2965dea9, user_id=a64bc3897f184f0bb688c7deb7e88f66, role_id=f157f905c9c94ccfbfb46e52d443e8f2)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:41.542415 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ed0525-ebca-480c-b5dc-7fad05e43405 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:41.563169 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 63/133] 10.222.0.49 () {58 vars in 1439 bytes} [Thu Sep 29 01:57:41 2022] PUT /identity/v3/projects/18a24e8d1f9f48a7accddadf2965dea9/users/a64bc3897f184f0bb688c7deb7e88f66/roles/f157f905c9c94ccfbfb46e52d443e8f2 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 01:57:41.564344 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ed0525-ebca-480c-b5dc-7fad05e43405 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:41.641730 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:41.661511 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fb5c55-c305-4e93-9012-c9d16b5762a3 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:41.687969 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ed0525-ebca-480c-b5dc-7fad05e43405 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:41.728331 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7bd4bf-065f-458c-aa18-502fa32ada1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:41.728942 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7bd4bf-065f-458c-aa18-502fa32ada1a None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:41.729233 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7bd4bf-065f-458c-aa18-502fa32ada1a None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:41.729535 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7bd4bf-065f-458c-aa18-502fa32ada1a None admin] PATH_INFO: `/v3/projects/ca184432008d4efaa18beac740258875` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:41.730773 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a5bda7-a924-44a4-9753-634fb109a23c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:41.730893 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7bd4bf-065f-458c-aa18-502fa32ada1a None admin] RBAC: Authorizing `identity:get_project(project_id=ca184432008d4efaa18beac740258875)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:41.731431 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a5bda7-a924-44a4-9753-634fb109a23c None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:41.731721 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a5bda7-a924-44a4-9753-634fb109a23c None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:41.732001 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a5bda7-a924-44a4-9753-634fb109a23c None admin] PATH_INFO: `/v3/projects/ca184432008d4efaa18beac740258875` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:41.732304 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7bd4bf-065f-458c-aa18-502fa32ada1a None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:41.733175 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a5bda7-a924-44a4-9753-634fb109a23c None admin] RBAC: Authorizing `identity:get_project(project_id=ca184432008d4efaa18beac740258875)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:41.734279 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 64/134] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Sep 29 01:57:41 2022] GET /identity/v3/projects/ca184432008d4efaa18beac740258875 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:41.734740 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a5bda7-a924-44a4-9753-634fb109a23c None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:41.736438 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 71/135] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Sep 29 01:57:41 2022] GET /identity/v3/projects/ca184432008d4efaa18beac740258875 => generated 298 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:41.740220 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7bd4bf-065f-458c-aa18-502fa32ada1a None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:41.742136 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a5bda7-a924-44a4-9753-634fb109a23c None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:41.760011 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:41.878305 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:41.885063 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a5bda7-a924-44a4-9753-634fb109a23c None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:41.885551 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7bd4bf-065f-458c-aa18-502fa32ada1a None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:41.925898 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8dcdfc-24a0-4d03-a16e-ff7b5c0e9163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:41.926690 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8dcdfc-24a0-4d03-a16e-ff7b5c0e9163 None admin] REQUEST_METHOD: `PUT` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:41.926980 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8dcdfc-24a0-4d03-a16e-ff7b5c0e9163 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:41.927264 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8dcdfc-24a0-4d03-a16e-ff7b5c0e9163 None admin] PATH_INFO: `/v3/projects/ca184432008d4efaa18beac740258875/users/d04b7db4290a4ee3872fe98d8aad0254/roles/fe9bbc67742f4f5893f39b18eb31d59a` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:41.928042 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efb76e2-d794-4a5b-8919-ff4b04949fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:41.928944 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb76e2-d794-4a5b-8919-ff4b04949fa4 None admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:41.929286 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb76e2-d794-4a5b-8919-ff4b04949fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:41.929511 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8dcdfc-24a0-4d03-a16e-ff7b5c0e9163 None admin] RBAC: Authorizing `identity:create_grant(project_id=ca184432008d4efaa18beac740258875, user_id=d04b7db4290a4ee3872fe98d8aad0254, role_id=fe9bbc67742f4f5893f39b18eb31d59a)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:41.929706 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb76e2-d794-4a5b-8919-ff4b04949fa4 None admin] PATH_INFO: `/v3/projects/ca184432008d4efaa18beac740258875/users/a64bc3897f184f0bb688c7deb7e88f66/roles/8de931d79c9d4c8daf717aaea348dda9` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:41.931435 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8dcdfc-24a0-4d03-a16e-ff7b5c0e9163 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:41.932087 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efb76e2-d794-4a5b-8919-ff4b04949fa4 None admin] RBAC: Authorizing `identity:create_grant(project_id=ca184432008d4efaa18beac740258875, user_id=a64bc3897f184f0bb688c7deb7e88f66, role_id=8de931d79c9d4c8daf717aaea348dda9)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:41.933686 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efb76e2-d794-4a5b-8919-ff4b04949fa4 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:41.951163 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 72/136] 10.222.0.49 () {58 vars in 1439 bytes} [Thu Sep 29 01:57:41 2022] PUT /identity/v3/projects/ca184432008d4efaa18beac740258875/users/d04b7db4290a4ee3872fe98d8aad0254/roles/fe9bbc67742f4f5893f39b18eb31d59a => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 01:57:41.953221 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 65/137] 10.222.0.49 () {58 vars in 1439 bytes} [Thu Sep 29 01:57:41 2022] PUT /identity/v3/projects/ca184432008d4efaa18beac740258875/users/a64bc3897f184f0bb688c7deb7e88f66/roles/8de931d79c9d4c8daf717aaea348dda9 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 01:57:42.326816 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7150a29e-6c6c-443f-84c0-d60e73a00f44 None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:42.327190 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7150a29e-6c6c-443f-84c0-d60e73a00f44 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:42.327385 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7150a29e-6c6c-443f-84c0-d60e73a00f44 None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:42.329046 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 73/138] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:57:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:57:42.335063 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17dfb2f-c793-4106-83f3-4064898188f3 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:42.335348 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17dfb2f-c793-4106-83f3-4064898188f3 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:42.335634 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17dfb2f-c793-4106-83f3-4064898188f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:42.358434 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-d17dfb2f-c793-4106-83f3-4064898188f3 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:57:42.359657 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-d17dfb2f-c793-4106-83f3-4064898188f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:57:42.397414 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11feab82-18c2-469e-bc11-aeaa21e430dd None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:42.397859 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11feab82-18c2-469e-bc11-aeaa21e430dd None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:42.398134 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11feab82-18c2-469e-bc11-aeaa21e430dd None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:42.400185 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 74/139] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:57:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:57:42.407247 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e92a41-eab5-4c45-89be-d23da62c3088 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:42.407524 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e92a41-eab5-4c45-89be-d23da62c3088 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:42.407799 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e92a41-eab5-4c45-89be-d23da62c3088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:42.432960 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-21e92a41-eab5-4c45-89be-d23da62c3088 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:57:42.434366 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-21e92a41-eab5-4c45-89be-d23da62c3088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:57:42.459138 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 66/140] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:57:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:57:42.538397 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:42.549623 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 75/141] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:57:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 29 01:57:43.009940 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17dfb2f-c793-4106-83f3-4064898188f3 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:43.062244 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e92a41-eab5-4c45-89be-d23da62c3088 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:43.134938 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17dfb2f-c793-4106-83f3-4064898188f3 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:43.137680 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:43.198003 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e8212b-306c-427a-b86c-2804a71fd637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:43.198564 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e8212b-306c-427a-b86c-2804a71fd637 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:43.198890 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e8212b-306c-427a-b86c-2804a71fd637 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:43.199166 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e8212b-306c-427a-b86c-2804a71fd637 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:43.215501 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e8212b-306c-427a-b86c-2804a71fd637 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:57:43.220374 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-c7e8212b-306c-427a-b86c-2804a71fd637 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 29 01:57:43.220374 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:57:43.220374 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:57:43.220374 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:57:43.220374 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:57:43.220374 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:57:43.220374 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:57:43.220374 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:57:43.220374 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:57:43.220374 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:57:43.220374 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:57:43.220374 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:57:43.220374 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:57:43.220374 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:57:43.220374 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:57:43.220374 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:57:43.221751 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:57:43.221751 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:57:43.221751 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:57:43.221751 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:57:43.221751 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:57:43.221751 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:57:43.221751 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:57:43.221751 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:57:43.221751 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:57:43.221751 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:57:43.221751 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:57:43.221751 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:57:43.221751 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:57:43.221751 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:57:43.221751 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:57:43.221751 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:57:43.222660 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:57:43.222660 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:57:43.222660 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:57:43.222660 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:57:43.222660 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:57:43.222660 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:57:43.222660 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:57:43.222660 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:57:43.222660 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:57:43.222660 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:57:43.222660 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 29 01:57:43.222660 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:57:43.229795 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 67/142] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Sep 29 01:57:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:57:43.235603 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e8212b-306c-427a-b86c-2804a71fd637 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:43.367431 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e92a41-eab5-4c45-89be-d23da62c3088 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:43.376425 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e8212b-306c-427a-b86c-2804a71fd637 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:43.432633 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368244cc-1f05-4069-84ee-cab9ad531e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:43.433249 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368244cc-1f05-4069-84ee-cab9ad531e26 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:43.433551 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368244cc-1f05-4069-84ee-cab9ad531e26 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:43.433822 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368244cc-1f05-4069-84ee-cab9ad531e26 None admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:43.434489 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368244cc-1f05-4069-84ee-cab9ad531e26 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:57:43.434792 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368244cc-1f05-4069-84ee-cab9ad531e26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:43.436153 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368244cc-1f05-4069-84ee-cab9ad531e26 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:43.445631 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:43.451782 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 68/143] 10.222.0.49 () {56 vars in 1101 bytes} [Thu Sep 29 01:57:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:57:43.457545 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368244cc-1f05-4069-84ee-cab9ad531e26 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:43.490058 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61639ec5-26cb-46cd-a6dc-bfa8348fdbad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:43.490726 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61639ec5-26cb-46cd-a6dc-bfa8348fdbad None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:43.491007 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61639ec5-26cb-46cd-a6dc-bfa8348fdbad None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:43.491282 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61639ec5-26cb-46cd-a6dc-bfa8348fdbad None admin] PATH_INFO: `/v3/domains/default` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:43.497988 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61639ec5-26cb-46cd-a6dc-bfa8348fdbad None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:43.499468 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61639ec5-26cb-46cd-a6dc-bfa8348fdbad None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:43.501045 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 76/144] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 01:57:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 439 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:57:43.533217 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61639ec5-26cb-46cd-a6dc-bfa8348fdbad None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:43.608366 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368244cc-1f05-4069-84ee-cab9ad531e26 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:43.675334 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:43.686506 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa61ab3a-2956-48a2-901c-78056c234265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:43.687155 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa61ab3a-2956-48a2-901c-78056c234265 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:43.687435 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa61ab3a-2956-48a2-901c-78056c234265 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:43.687710 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa61ab3a-2956-48a2-901c-78056c234265 None admin] PATH_INFO: `/v3/users/92d2696b0e0445b1a01e8875b26e8224` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:43.690977 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa61ab3a-2956-48a2-901c-78056c234265 None admin] RBAC: Authorizing `identity:get_user(user_id=92d2696b0e0445b1a01e8875b26e8224)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:43.692426 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa61ab3a-2956-48a2-901c-78056c234265 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:43.694062 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 69/145] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Sep 29 01:57:43 2022] GET /identity/v3/users/92d2696b0e0445b1a01e8875b26e8224 => generated 289 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:57:43.699642 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa61ab3a-2956-48a2-901c-78056c234265 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:43.757421 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61639ec5-26cb-46cd-a6dc-bfa8348fdbad None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:43.870832 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eecfb35-1847-42ad-83a6-b7ca7693aae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:43.871807 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eecfb35-1847-42ad-83a6-b7ca7693aae3 None admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:43.872281 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eecfb35-1847-42ad-83a6-b7ca7693aae3 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:43.872768 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eecfb35-1847-42ad-83a6-b7ca7693aae3 None admin] PATH_INFO: `/v3/users` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:43.873644 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eecfb35-1847-42ad-83a6-b7ca7693aae3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:43.875889 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eecfb35-1847-42ad-83a6-b7ca7693aae3 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:43.890619 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:43.949067 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 77/146] 10.222.0.49 () {60 vars in 1132 bytes} [Thu Sep 29 01:57:43 2022] POST /identity/v3/users => generated 283 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 01:57:44.005344 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa61ab3a-2956-48a2-901c-78056c234265 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:44.100024 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c095f11-30f8-42d6-a2ca-9aa2da57315a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:44.100738 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c095f11-30f8-42d6-a2ca-9aa2da57315a None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:44.101089 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c095f11-30f8-42d6-a2ca-9aa2da57315a None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:44.101385 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c095f11-30f8-42d6-a2ca-9aa2da57315a None admin] PATH_INFO: `/v3/projects/ca184432008d4efaa18beac740258875` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:44.102600 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c095f11-30f8-42d6-a2ca-9aa2da57315a None admin] RBAC: Authorizing `identity:get_project(project_id=ca184432008d4efaa18beac740258875)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:44.104067 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c095f11-30f8-42d6-a2ca-9aa2da57315a None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:44.105886 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 70/147] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Sep 29 01:57:43 2022] GET /identity/v3/projects/ca184432008d4efaa18beac740258875 => generated 298 bytes in 407 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:57:44.114460 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eecfb35-1847-42ad-83a6-b7ca7693aae3 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:44.319101 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eecfb35-1847-42ad-83a6-b7ca7693aae3 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:44.361547 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:44.396969 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a394db8-2a96-42f2-8002-9c1ed0a03a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:44.397687 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a394db8-2a96-42f2-8002-9c1ed0a03a83 None admin] REQUEST_METHOD: `PUT` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:44.397970 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a394db8-2a96-42f2-8002-9c1ed0a03a83 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:44.398247 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a394db8-2a96-42f2-8002-9c1ed0a03a83 None admin] PATH_INFO: `/v3/projects/ca184432008d4efaa18beac740258875/users/92d2696b0e0445b1a01e8875b26e8224/roles/63a7737d5e4b42ccbfdd40451c4a1c77` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:44.400287 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a394db8-2a96-42f2-8002-9c1ed0a03a83 None admin] RBAC: Authorizing `identity:create_grant(project_id=ca184432008d4efaa18beac740258875, user_id=92d2696b0e0445b1a01e8875b26e8224, role_id=63a7737d5e4b42ccbfdd40451c4a1c77)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:44.401788 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a394db8-2a96-42f2-8002-9c1ed0a03a83 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:44.429057 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 78/148] 10.222.0.49 () {58 vars in 1439 bytes} [Thu Sep 29 01:57:44 2022] PUT /identity/v3/projects/ca184432008d4efaa18beac740258875/users/92d2696b0e0445b1a01e8875b26e8224/roles/63a7737d5e4b42ccbfdd40451c4a1c77 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 01:57:44.533184 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0646b318-c555-4d31-8963-977063039413 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:44.533742 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0646b318-c555-4d31-8963-977063039413 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:44.534213 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0646b318-c555-4d31-8963-977063039413 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:44.536089 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 71/149] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:57:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:57:44.541502 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64420a71-1db1-4313-997a-9822f02241c1 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:44.541793 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64420a71-1db1-4313-997a-9822f02241c1 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:44.542317 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64420a71-1db1-4313-997a-9822f02241c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:44.571852 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-64420a71-1db1-4313-997a-9822f02241c1 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:57:44.573058 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-64420a71-1db1-4313-997a-9822f02241c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:57:44.666084 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 79/150] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:57:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:57:44.833196 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587a4911-6561-4ee7-b77f-79759046ac41 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:44.833633 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587a4911-6561-4ee7-b77f-79759046ac41 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:44.833752 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587a4911-6561-4ee7-b77f-79759046ac41 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:44.835435 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 72/151] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:57:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:57:44.841181 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ff1d85-b609-4c0b-a87b-95a65403777b None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:44.841786 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ff1d85-b609-4c0b-a87b-95a65403777b None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:44.842245 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ff1d85-b609-4c0b-a87b-95a65403777b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:44.862334 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-b7ff1d85-b609-4c0b-a87b-95a65403777b None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:57:44.863894 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-b7ff1d85-b609-4c0b-a87b-95a65403777b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:57:44.941383 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 80/152] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:57:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:57:45.121935 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587a4911-6561-4ee7-b77f-79759046ac41 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:45.257643 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587a4911-6561-4ee7-b77f-79759046ac41 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:45.262215 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c82c81-6440-4a33-9f29-3364ee8c3884 None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:45.263181 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c82c81-6440-4a33-9f29-3364ee8c3884 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:45.263658 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c82c81-6440-4a33-9f29-3364ee8c3884 None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:45.269770 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 81/153] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:57:45 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:57:45.272869 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b327eb-b5c7-4e60-8185-4d11acc99bb7 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:45.273401 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b327eb-b5c7-4e60-8185-4d11acc99bb7 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:45.273896 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b327eb-b5c7-4e60-8185-4d11acc99bb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:45.295759 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-81b327eb-b5c7-4e60-8185-4d11acc99bb7 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:57:45.297449 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-81b327eb-b5c7-4e60-8185-4d11acc99bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:57:45.297643 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a43a32-e068-44c3-b93e-22e72cb91fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:45.298227 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a43a32-e068-44c3-b93e-22e72cb91fec None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:45.298503 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a43a32-e068-44c3-b93e-22e72cb91fec None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:45.298770 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a43a32-e068-44c3-b93e-22e72cb91fec None admin] PATH_INFO: `/v3/roles/member` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:45.307103 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:45.314614 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a43a32-e068-44c3-b93e-22e72cb91fec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:57:45.320438 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-a1a43a32-e068-44c3-b93e-22e72cb91fec None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 29 01:57:45.320438 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:57:45.320438 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:57:45.320438 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:57:45.320438 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:57:45.320438 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:57:45.320438 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:57:45.320438 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:57:45.320438 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:57:45.320438 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:57:45.320438 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:57:45.320438 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:57:45.320438 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:57:45.320438 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:57:45.320438 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:57:45.320438 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:57:45.321387 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:57:45.321387 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:57:45.321387 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:57:45.321387 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:57:45.321387 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:57:45.321387 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:57:45.321387 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:57:45.321387 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:57:45.321387 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:57:45.321387 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:57:45.321387 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:57:45.321387 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:57:45.321387 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:57:45.321387 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:57:45.321387 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:57:45.321387 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:57:45.322189 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:57:45.322189 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:57:45.322189 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:57:45.322189 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:57:45.322189 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:57:45.322189 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:57:45.322189 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:57:45.322189 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:57:45.322189 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:57:45.322189 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:57:45.322189 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 29 01:57:45.322189 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:57:45.324589 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 73/154] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Sep 29 01:57:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:57:45.334427 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a43a32-e068-44c3-b93e-22e72cb91fec None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:45.361669 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:45.430636 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 82/155] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:57:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:57:45.431622 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b327eb-b5c7-4e60-8185-4d11acc99bb7 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:45.484569 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a43a32-e068-44c3-b93e-22e72cb91fec None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:45.523726 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52a438d-cadc-4ba9-a785-5e826c35a90d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:45.524584 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52a438d-cadc-4ba9-a785-5e826c35a90d None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:45.525189 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52a438d-cadc-4ba9-a785-5e826c35a90d None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:45.525627 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52a438d-cadc-4ba9-a785-5e826c35a90d None admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:45.527422 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52a438d-cadc-4ba9-a785-5e826c35a90d None admin] RBAC: Adding query filter params (name=member) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:57:45.527874 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52a438d-cadc-4ba9-a785-5e826c35a90d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:45.529425 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52a438d-cadc-4ba9-a785-5e826c35a90d None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:45.540940 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 74/156] 10.222.0.49 () {56 vars in 1101 bytes} [Thu Sep 29 01:57:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:45.542875 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d602267e-09cf-4852-ba29-934f94620b3a None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:45.543456 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d602267e-09cf-4852-ba29-934f94620b3a None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:45.543872 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d602267e-09cf-4852-ba29-934f94620b3a None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:45.545545 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 75/157] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:57:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:57:45.546486 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d602267e-09cf-4852-ba29-934f94620b3a None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:45.621627 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:45.664421 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b327eb-b5c7-4e60-8185-4d11acc99bb7 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:45.680535 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d602267e-09cf-4852-ba29-934f94620b3a None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:45.720009 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae010e2-9274-48e2-824a-736056af7fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:45.721050 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae010e2-9274-48e2-824a-736056af7fdb None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:45.722217 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae010e2-9274-48e2-824a-736056af7fdb None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:45.722672 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae010e2-9274-48e2-824a-736056af7fdb None admin] PATH_INFO: `/v3/users/a64bc3897f184f0bb688c7deb7e88f66` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:45.724271 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae010e2-9274-48e2-824a-736056af7fdb None admin] RBAC: Authorizing `identity:get_user(user_id=a64bc3897f184f0bb688c7deb7e88f66)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:45.726385 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae010e2-9274-48e2-824a-736056af7fdb None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:45.728715 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 76/158] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Sep 29 01:57:45 2022] GET /identity/v3/users/a64bc3897f184f0bb688c7deb7e88f66 => generated 275 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:45.730566 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4800564-890c-4c16-99af-6a68199d78f8 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:45.731003 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4800564-890c-4c16-99af-6a68199d78f8 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:45.731568 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4800564-890c-4c16-99af-6a68199d78f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:45.751404 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc02d08-f0fc-4494-acf3-227e6bda1a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:45.752312 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc02d08-f0fc-4494-acf3-227e6bda1a29 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:45.752714 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc02d08-f0fc-4494-acf3-227e6bda1a29 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:45.753236 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc02d08-f0fc-4494-acf3-227e6bda1a29 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:45.753876 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-c4800564-890c-4c16-99af-6a68199d78f8 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:57:45.755280 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-c4800564-890c-4c16-99af-6a68199d78f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:57:45.785870 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc02d08-f0fc-4494-acf3-227e6bda1a29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:57:45.791273 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-5bc02d08-f0fc-4494-acf3-227e6bda1a29 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 29 01:57:45.791273 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:57:45.791273 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:57:45.791273 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:57:45.791273 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:57:45.791273 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:57:45.791273 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:57:45.791273 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:57:45.791273 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:57:45.791273 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:57:45.791273 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:57:45.791273 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:57:45.791273 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:57:45.791273 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:57:45.791273 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:57:45.791273 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:57:45.792655 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:57:45.792655 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:57:45.792655 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:57:45.792655 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:57:45.792655 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:57:45.792655 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:57:45.792655 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:57:45.792655 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:57:45.792655 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:57:45.792655 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:57:45.792655 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:57:45.792655 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:57:45.792655 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:57:45.792655 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:57:45.792655 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:57:45.792655 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:57:45.793581 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:57:45.793581 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:57:45.793581 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:57:45.793581 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:57:45.793581 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:57:45.793581 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:57:45.793581 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:57:45.793581 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:57:45.793581 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:57:45.793581 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:57:45.793581 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 29 01:57:45.793581 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:57:45.798310 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 83/159] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Sep 29 01:57:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 367 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:57:45.799846 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc02d08-f0fc-4494-acf3-227e6bda1a29 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:45.839691 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 77/160] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:57:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:57:45.840989 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4800564-890c-4c16-99af-6a68199d78f8 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:45.853665 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:45.933711 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:45.957499 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4800564-890c-4c16-99af-6a68199d78f8 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:45.995277 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9d0610-f54b-4baa-800a-9ae56778b5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:45.996009 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d0610-f54b-4baa-800a-9ae56778b5e7 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:45.996354 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d0610-f54b-4baa-800a-9ae56778b5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:45.996690 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d0610-f54b-4baa-800a-9ae56778b5e7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:46.009168 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9d0610-f54b-4baa-800a-9ae56778b5e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:57:46.014781 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-af9d0610-f54b-4baa-800a-9ae56778b5e7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 01:57:46.014781 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:57:46.014781 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:57:46.014781 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:57:46.014781 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:57:46.014781 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:57:46.014781 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:57:46.014781 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:57:46.014781 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:57:46.014781 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:57:46.014781 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:57:46.014781 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:57:46.014781 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:57:46.014781 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:57:46.014781 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:57:46.014781 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:57:46.015907 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:57:46.015907 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:57:46.015907 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:57:46.015907 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:57:46.015907 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:57:46.015907 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:57:46.015907 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:57:46.015907 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:57:46.015907 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:57:46.015907 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:57:46.015907 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:57:46.015907 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:57:46.015907 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:57:46.015907 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:57:46.015907 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:57:46.015907 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:57:46.016876 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:57:46.016876 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:57:46.016876 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:57:46.016876 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:57:46.016876 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:57:46.016876 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:57:46.016876 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:57:46.016876 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:57:46.016876 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:57:46.016876 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:57:46.016876 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 01:57:46.016876 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:57:46.019601 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 78/161] 10.222.0.49 () {56 vars in 1096 bytes} [Thu Sep 29 01:57:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:57:46.020200 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9d0610-f54b-4baa-800a-9ae56778b5e7 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:46.021557 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc02d08-f0fc-4494-acf3-227e6bda1a29 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:46.095374 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35996ceb-24f7-4faa-be36-0f7d2ca7912d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:46.096006 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35996ceb-24f7-4faa-be36-0f7d2ca7912d None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:46.096946 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35996ceb-24f7-4faa-be36-0f7d2ca7912d None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:46.097402 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35996ceb-24f7-4faa-be36-0f7d2ca7912d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:46.155081 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9d0610-f54b-4baa-800a-9ae56778b5e7 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:46.193686 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:46.215757 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608fe386-6563-4793-8da8-954718c40433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:46.216381 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608fe386-6563-4793-8da8-954718c40433 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:46.216723 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608fe386-6563-4793-8da8-954718c40433 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:46.217002 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608fe386-6563-4793-8da8-954718c40433 None admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:46.221735 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608fe386-6563-4793-8da8-954718c40433 None admin] RBAC: Adding query filter params (name=member) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:57:46.221735 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608fe386-6563-4793-8da8-954718c40433 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:46.221735 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608fe386-6563-4793-8da8-954718c40433 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:46.230234 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 79/162] 10.222.0.49 () {56 vars in 1101 bytes} [Thu Sep 29 01:57:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:46.230601 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35996ceb-24f7-4faa-be36-0f7d2ca7912d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:46.231165 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608fe386-6563-4793-8da8-954718c40433 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:46.232535 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35996ceb-24f7-4faa-be36-0f7d2ca7912d None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:46.319101 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:46.425226 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608fe386-6563-4793-8da8-954718c40433 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:46.498036 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 84/163] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Sep 29 01:57:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 699 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 29 01:57:46.499227 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35996ceb-24f7-4faa-be36-0f7d2ca7912d None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:46.499691 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5e380d-978e-4464-acd4-1fdbf00988a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:46.500576 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e380d-978e-4464-acd4-1fdbf00988a2 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:46.501094 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e380d-978e-4464-acd4-1fdbf00988a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:46.501590 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e380d-978e-4464-acd4-1fdbf00988a2 None admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:46.502493 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5e380d-978e-4464-acd4-1fdbf00988a2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:57:46.503014 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5e380d-978e-4464-acd4-1fdbf00988a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:46.504832 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5e380d-978e-4464-acd4-1fdbf00988a2 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:46.522760 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 80/164] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Sep 29 01:57:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:46.523894 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5e380d-978e-4464-acd4-1fdbf00988a2 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:46.607905 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:46.708954 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35996ceb-24f7-4faa-be36-0f7d2ca7912d None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:46.746261 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5e380d-978e-4464-acd4-1fdbf00988a2 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:46.773697 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:46.782000 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1a8837-fd89-4287-b404-9e26ac5331a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:46.782659 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1a8837-fd89-4287-b404-9e26ac5331a3 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:46.782938 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1a8837-fd89-4287-b404-9e26ac5331a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:46.783209 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1a8837-fd89-4287-b404-9e26ac5331a3 None admin] PATH_INFO: `/v3/users/a64bc3897f184f0bb688c7deb7e88f66` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:46.784944 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1a8837-fd89-4287-b404-9e26ac5331a3 None admin] RBAC: Authorizing `identity:get_user(user_id=a64bc3897f184f0bb688c7deb7e88f66)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:46.786444 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1a8837-fd89-4287-b404-9e26ac5331a3 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:46.788051 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 85/165] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Sep 29 01:57:46 2022] GET /identity/v3/users/a64bc3897f184f0bb688c7deb7e88f66 => generated 275 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:46.788935 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1a8837-fd89-4287-b404-9e26ac5331a3 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:46.836354 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610bea30-aac6-4898-a5d7-df20266098cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:46.837261 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610bea30-aac6-4898-a5d7-df20266098cf None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:46.837804 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610bea30-aac6-4898-a5d7-df20266098cf None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:46.838312 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610bea30-aac6-4898-a5d7-df20266098cf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:46.866208 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610bea30-aac6-4898-a5d7-df20266098cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:57:46.871840 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-610bea30-aac6-4898-a5d7-df20266098cf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 29 01:57:46.871840 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:57:46.871840 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:57:46.871840 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:57:46.871840 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:57:46.871840 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:57:46.871840 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:57:46.871840 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:57:46.871840 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:57:46.871840 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:57:46.871840 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:57:46.871840 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:57:46.871840 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:57:46.871840 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:57:46.871840 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:57:46.871840 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:57:46.872858 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:57:46.872858 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:57:46.872858 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:57:46.872858 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:57:46.872858 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:57:46.872858 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:57:46.872858 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:57:46.872858 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:57:46.872858 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:57:46.872858 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:57:46.872858 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:57:46.872858 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:57:46.872858 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:57:46.872858 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:57:46.872858 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:57:46.872858 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:57:46.873857 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:57:46.873857 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:57:46.873857 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:57:46.873857 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:57:46.873857 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:57:46.873857 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:57:46.873857 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:57:46.873857 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:57:46.873857 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:57:46.873857 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:57:46.873857 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 29 01:57:46.873857 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:57:46.881725 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 81/166] 10.222.0.49 () {56 vars in 1114 bytes} [Thu Sep 29 01:57:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:57:46.882757 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610bea30-aac6-4898-a5d7-df20266098cf None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:46.992916 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1a8837-fd89-4287-b404-9e26ac5331a3 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:47.053730 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfbe845-0ed3-42b8-8f1d-6f75cc9b1b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:47.054747 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfbe845-0ed3-42b8-8f1d-6f75cc9b1b6f None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:47.055258 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfbe845-0ed3-42b8-8f1d-6f75cc9b1b6f None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:47.055781 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfbe845-0ed3-42b8-8f1d-6f75cc9b1b6f None admin] PATH_INFO: `/v3/projects/ca184432008d4efaa18beac740258875` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:47.061977 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfbe845-0ed3-42b8-8f1d-6f75cc9b1b6f None admin] RBAC: Authorizing `identity:get_project(project_id=ca184432008d4efaa18beac740258875)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:47.063663 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfbe845-0ed3-42b8-8f1d-6f75cc9b1b6f None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:47.066414 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 86/167] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Sep 29 01:57:46 2022] GET /identity/v3/projects/ca184432008d4efaa18beac740258875 => generated 298 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:47.067523 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfbe845-0ed3-42b8-8f1d-6f75cc9b1b6f None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:47.180731 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:47.189674 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:47.195181 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610bea30-aac6-4898-a5d7-df20266098cf None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:47.198248 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfbe845-0ed3-42b8-8f1d-6f75cc9b1b6f None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:47.255414 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a717fd45-ce46-48f1-93b7-bdfc29852c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:47.256927 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a717fd45-ce46-48f1-93b7-bdfc29852c75 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:47.257471 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a717fd45-ce46-48f1-93b7-bdfc29852c75 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:47.257947 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a717fd45-ce46-48f1-93b7-bdfc29852c75 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:47.272154 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da48ea54-b58e-4136-a2d7-f49f3f4e8421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:47.272803 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da48ea54-b58e-4136-a2d7-f49f3f4e8421 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:47.273079 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da48ea54-b58e-4136-a2d7-f49f3f4e8421 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:47.273368 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da48ea54-b58e-4136-a2d7-f49f3f4e8421 None admin] PATH_INFO: `/v3/users/d04b7db4290a4ee3872fe98d8aad0254` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:47.275717 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da48ea54-b58e-4136-a2d7-f49f3f4e8421 None admin] RBAC: Authorizing `identity:get_user(user_id=d04b7db4290a4ee3872fe98d8aad0254)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:47.277161 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da48ea54-b58e-4136-a2d7-f49f3f4e8421 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:47.281340 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 82/168] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Sep 29 01:57:46 2022] GET /identity/v3/users/d04b7db4290a4ee3872fe98d8aad0254 => generated 247 bytes in 396 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:47.281340 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da48ea54-b58e-4136-a2d7-f49f3f4e8421 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:47.378319 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a717fd45-ce46-48f1-93b7-bdfc29852c75 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:47.380773 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a717fd45-ce46-48f1-93b7-bdfc29852c75 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:47.493698 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:47.561552 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da48ea54-b58e-4136-a2d7-f49f3f4e8421 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:47.572893 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 87/169] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Sep 29 01:57:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 29 01:57:47.573596 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a717fd45-ce46-48f1-93b7-bdfc29852c75 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:47.619991 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1985e109-f66c-4779-9a0c-8cb5882e26fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:47.621138 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1985e109-f66c-4779-9a0c-8cb5882e26fa None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:47.621449 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1985e109-f66c-4779-9a0c-8cb5882e26fa None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:47.621723 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1985e109-f66c-4779-9a0c-8cb5882e26fa None admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:47.622388 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1985e109-f66c-4779-9a0c-8cb5882e26fa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:57:47.622687 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1985e109-f66c-4779-9a0c-8cb5882e26fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:47.624206 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1985e109-f66c-4779-9a0c-8cb5882e26fa None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:47.634954 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 83/170] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Sep 29 01:57:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:47.635608 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1985e109-f66c-4779-9a0c-8cb5882e26fa None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:47.712205 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:47.743766 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a717fd45-ce46-48f1-93b7-bdfc29852c75 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:47.785240 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5f38a9-7603-4dfe-96ea-dbd38001f2f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:47.786175 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f38a9-7603-4dfe-96ea-dbd38001f2f0 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:47.787206 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f38a9-7603-4dfe-96ea-dbd38001f2f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:47.787657 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f38a9-7603-4dfe-96ea-dbd38001f2f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:47.788712 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5f38a9-7603-4dfe-96ea-dbd38001f2f0 None admin] RBAC: Adding query filter params (role.id=f157f905c9c94ccfbfb46e52d443e8f2, scope.project.id=ca184432008d4efaa18beac740258875, user.id=a64bc3897f184f0bb688c7deb7e88f66) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:57:47.789340 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5f38a9-7603-4dfe-96ea-dbd38001f2f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:47.791267 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5f38a9-7603-4dfe-96ea-dbd38001f2f0 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:47.798836 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 88/171] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Sep 29 01:57:47 2022] GET /identity/v3/role_assignments?user.id=a64bc3897f184f0bb688c7deb7e88f66&scope.project.id=ca184432008d4efaa18beac740258875&role.id=f157f905c9c94ccfbfb46e52d443e8f2 => generated 608 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:47.800958 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5f38a9-7603-4dfe-96ea-dbd38001f2f0 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:47.842214 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:47.880403 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1985e109-f66c-4779-9a0c-8cb5882e26fa None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:47.932374 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5f38a9-7603-4dfe-96ea-dbd38001f2f0 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:47.987850 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb7821d-823c-4ce9-86b2-6de4fe04409f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:47.988500 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb7821d-823c-4ce9-86b2-6de4fe04409f None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:47.988779 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb7821d-823c-4ce9-86b2-6de4fe04409f None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:47.989052 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb7821d-823c-4ce9-86b2-6de4fe04409f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:48.022754 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b63b0e-cb0b-46c2-8940-6000f8fb1f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:48.023412 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b63b0e-cb0b-46c2-8940-6000f8fb1f93 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:48.023692 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b63b0e-cb0b-46c2-8940-6000f8fb1f93 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:48.023962 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b63b0e-cb0b-46c2-8940-6000f8fb1f93 None admin] PATH_INFO: `/v3/projects/18a24e8d1f9f48a7accddadf2965dea9` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:48.026037 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b63b0e-cb0b-46c2-8940-6000f8fb1f93 None admin] RBAC: Authorizing `identity:get_project(project_id=18a24e8d1f9f48a7accddadf2965dea9)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:48.027528 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b63b0e-cb0b-46c2-8940-6000f8fb1f93 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:48.030696 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 89/172] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Sep 29 01:57:47 2022] GET /identity/v3/projects/18a24e8d1f9f48a7accddadf2965dea9 => generated 312 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:48.031500 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b63b0e-cb0b-46c2-8940-6000f8fb1f93 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:48.134807 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb7821d-823c-4ce9-86b2-6de4fe04409f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:48.137796 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb7821d-823c-4ce9-86b2-6de4fe04409f None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:48.210210 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:48.230325 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:48.238642 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b63b0e-cb0b-46c2-8940-6000f8fb1f93 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:48.281133 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb811411-329a-474e-9fb6-54f41b97874f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:48.282514 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb811411-329a-474e-9fb6-54f41b97874f None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:48.283046 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb811411-329a-474e-9fb6-54f41b97874f None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:48.283470 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb811411-329a-474e-9fb6-54f41b97874f None admin] PATH_INFO: `/v3/users/a64bc3897f184f0bb688c7deb7e88f66` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:48.284991 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb811411-329a-474e-9fb6-54f41b97874f None admin] RBAC: Authorizing `identity:get_user(user_id=a64bc3897f184f0bb688c7deb7e88f66)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:48.286590 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb811411-329a-474e-9fb6-54f41b97874f None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:48.288686 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 90/173] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Sep 29 01:57:48 2022] GET /identity/v3/users/a64bc3897f184f0bb688c7deb7e88f66 => generated 275 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:48.290033 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28698a04-b888-4719-a175-c68707b31501 None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:48.290460 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28698a04-b888-4719-a175-c68707b31501 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:48.290893 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28698a04-b888-4719-a175-c68707b31501 None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:48.292508 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 91/174] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:57:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:57:48.293361 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28698a04-b888-4719-a175-c68707b31501 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:48.333672 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 84/175] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Sep 29 01:57:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 698 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 29 01:57:48.339825 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fd0604-1f7f-46bf-b5ec-e3b9d0e9ea20 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:48.340344 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fd0604-1f7f-46bf-b5ec-e3b9d0e9ea20 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:48.340819 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fd0604-1f7f-46bf-b5ec-e3b9d0e9ea20 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:48.342322 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 85/176] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:57:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:57:48.343831 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f21e90-0282-4f19-93c0-237e837041f9 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:48.344312 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f21e90-0282-4f19-93c0-237e837041f9 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:48.344783 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f21e90-0282-4f19-93c0-237e837041f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:48.366351 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-43f21e90-0282-4f19-93c0-237e837041f9 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:57:48.367912 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-43f21e90-0282-4f19-93c0-237e837041f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:57:48.412994 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28698a04-b888-4719-a175-c68707b31501 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:48.445528 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 86/177] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:57:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:57:48.447613 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f21e90-0282-4f19-93c0-237e837041f9 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:48.455699 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caec01a-b378-42c3-9f5f-ae1ce42eac61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:48.456315 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caec01a-b378-42c3-9f5f-ae1ce42eac61 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:48.456593 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caec01a-b378-42c3-9f5f-ae1ce42eac61 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:48.456862 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caec01a-b378-42c3-9f5f-ae1ce42eac61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:48.458093 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caec01a-b378-42c3-9f5f-ae1ce42eac61 None admin] RBAC: Adding query filter params (role.id=f157f905c9c94ccfbfb46e52d443e8f2, scope.project.id=18a24e8d1f9f48a7accddadf2965dea9, user.id=a64bc3897f184f0bb688c7deb7e88f66) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:57:48.458403 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caec01a-b378-42c3-9f5f-ae1ce42eac61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:48.459837 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caec01a-b378-42c3-9f5f-ae1ce42eac61 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:48.471800 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 92/178] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Sep 29 01:57:48 2022] GET /identity/v3/role_assignments?user.id=a64bc3897f184f0bb688c7deb7e88f66&scope.project.id=18a24e8d1f9f48a7accddadf2965dea9&role.id=f157f905c9c94ccfbfb46e52d443e8f2 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:48.472929 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caec01a-b378-42c3-9f5f-ae1ce42eac61 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:48.550734 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:48.585755 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:48.676515 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f21e90-0282-4f19-93c0-237e837041f9 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:48.695109 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caec01a-b378-42c3-9f5f-ae1ce42eac61 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:48.734571 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1b9960-6acf-4cca-b88d-c7b6bc342439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:48.735667 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b9960-6acf-4cca-b88d-c7b6bc342439 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:48.736183 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b9960-6acf-4cca-b88d-c7b6bc342439 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:48.736649 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b9960-6acf-4cca-b88d-c7b6bc342439 None admin] PATH_INFO: `/v3/projects/ca184432008d4efaa18beac740258875` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:48.738305 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1b9960-6acf-4cca-b88d-c7b6bc342439 None admin] RBAC: Authorizing `identity:get_project(project_id=ca184432008d4efaa18beac740258875)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:48.740060 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1b9960-6acf-4cca-b88d-c7b6bc342439 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:48.742094 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 93/179] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Sep 29 01:57:48 2022] GET /identity/v3/projects/ca184432008d4efaa18beac740258875 => generated 298 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:48.747117 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa8dc76-7096-4691-b922-7e6586a378e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:48.747653 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa8dc76-7096-4691-b922-7e6586a378e9 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:48.747931 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa8dc76-7096-4691-b922-7e6586a378e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:48.748200 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa8dc76-7096-4691-b922-7e6586a378e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:48.749502 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b057da0b-52bc-4eeb-b4ff-6d6bab32489a None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:48.750013 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b057da0b-52bc-4eeb-b4ff-6d6bab32489a None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:48.750480 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b057da0b-52bc-4eeb-b4ff-6d6bab32489a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:48.772221 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-b057da0b-52bc-4eeb-b4ff-6d6bab32489a None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:57:48.773902 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-b057da0b-52bc-4eeb-b4ff-6d6bab32489a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:57:48.862425 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 94/180] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:57:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:57:48.863815 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44baf050-2e80-4904-a09c-98fbdfe8b25d None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:48.864099 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44baf050-2e80-4904-a09c-98fbdfe8b25d None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:48.864643 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44baf050-2e80-4904-a09c-98fbdfe8b25d None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:48.865992 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 95/181] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:57:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:57:48.866904 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44baf050-2e80-4904-a09c-98fbdfe8b25d None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:48.920020 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:48.920520 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa8dc76-7096-4691-b922-7e6586a378e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:48.922030 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa8dc76-7096-4691-b922-7e6586a378e9 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:48.994994 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:49.000649 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44baf050-2e80-4904-a09c-98fbdfe8b25d None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:49.048615 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 87/182] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Sep 29 01:57:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 602 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 29 01:57:49.051391 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d4ace-aabd-44c7-8c0f-57ba5e9e914e None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:49.051874 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d4ace-aabd-44c7-8c0f-57ba5e9e914e None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:49.052315 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d4ace-aabd-44c7-8c0f-57ba5e9e914e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:49.053781 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d11ccbc-b2f7-416a-868a-82880c81429e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:49.054477 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d11ccbc-b2f7-416a-868a-82880c81429e None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:49.054869 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d11ccbc-b2f7-416a-868a-82880c81429e None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:49.055147 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d11ccbc-b2f7-416a-868a-82880c81429e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:49.055906 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d11ccbc-b2f7-416a-868a-82880c81429e None admin] RBAC: Adding query filter params (role.id=fe9bbc67742f4f5893f39b18eb31d59a, scope.project.id=ca184432008d4efaa18beac740258875, user.id=d04b7db4290a4ee3872fe98d8aad0254) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:57:49.056196 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d11ccbc-b2f7-416a-868a-82880c81429e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:49.057712 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d11ccbc-b2f7-416a-868a-82880c81429e None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:49.065887 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 96/183] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Sep 29 01:57:48 2022] GET /identity/v3/role_assignments?user.id=d04b7db4290a4ee3872fe98d8aad0254&scope.project.id=ca184432008d4efaa18beac740258875&role.id=fe9bbc67742f4f5893f39b18eb31d59a => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:49.066809 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d11ccbc-b2f7-416a-868a-82880c81429e None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:49.072106 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-fe1d4ace-aabd-44c7-8c0f-57ba5e9e914e None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:57:49.073634 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-fe1d4ace-aabd-44c7-8c0f-57ba5e9e914e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:57:49.161262 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 88/184] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:57:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:57:49.161262 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3016d976-4944-40b8-b106-ffd12626f457 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:49.161262 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3016d976-4944-40b8-b106-ffd12626f457 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:49.161262 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3016d976-4944-40b8-b106-ffd12626f457 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:49.161674 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 89/185] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:57:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:57:49.162232 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3016d976-4944-40b8-b106-ffd12626f457 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:49.205862 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:49.222381 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d11ccbc-b2f7-416a-868a-82880c81429e None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:49.265010 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d16eb94-28f3-4907-aab2-48efb2126df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:49.266019 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d16eb94-28f3-4907-aab2-48efb2126df6 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:49.266293 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d16eb94-28f3-4907-aab2-48efb2126df6 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:49.266558 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d16eb94-28f3-4907-aab2-48efb2126df6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:49.279237 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d16eb94-28f3-4907-aab2-48efb2126df6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:57:49.285210 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-4d16eb94-28f3-4907-aab2-48efb2126df6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 29 01:57:49.285210 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:57:49.285210 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:57:49.285210 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:57:49.285210 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:57:49.285210 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:57:49.285210 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:57:49.285210 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:57:49.285210 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:57:49.285210 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:57:49.285210 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:57:49.285210 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:57:49.285210 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:57:49.285210 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:57:49.285210 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:57:49.285210 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:57:49.286980 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:57:49.286980 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:57:49.286980 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:57:49.286980 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:57:49.286980 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:57:49.286980 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:57:49.286980 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:57:49.286980 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:57:49.286980 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:57:49.286980 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:57:49.286980 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:57:49.286980 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:57:49.286980 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:57:49.286980 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:57:49.286980 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:57:49.286980 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:57:49.288575 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:57:49.288575 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:57:49.288575 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:57:49.288575 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:57:49.288575 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:57:49.288575 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:57:49.288575 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:57:49.288575 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:57:49.288575 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:57:49.288575 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:57:49.288575 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 29 01:57:49.288575 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:57:49.288575 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 97/186] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Sep 29 01:57:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:57:49.288575 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab5fce5-9649-48d4-82f0-0f476ad12ff1 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:49.291334 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab5fce5-9649-48d4-82f0-0f476ad12ff1 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:49.291334 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab5fce5-9649-48d4-82f0-0f476ad12ff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:49.305951 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:49.311359 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-eab5fce5-9649-48d4-82f0-0f476ad12ff1 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:57:49.312557 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-eab5fce5-9649-48d4-82f0-0f476ad12ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:57:49.317785 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3016d976-4944-40b8-b106-ffd12626f457 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:49.362659 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1735678-b443-4847-9050-d4b4f28ce9f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:49.363647 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1735678-b443-4847-9050-d4b4f28ce9f9 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:49.364176 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1735678-b443-4847-9050-d4b4f28ce9f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:49.364680 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1735678-b443-4847-9050-d4b4f28ce9f9 None admin] PATH_INFO: `/v3/projects/ca184432008d4efaa18beac740258875` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:49.366849 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1735678-b443-4847-9050-d4b4f28ce9f9 None admin] RBAC: Authorizing `identity:get_project(project_id=ca184432008d4efaa18beac740258875)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:49.370452 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1735678-b443-4847-9050-d4b4f28ce9f9 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:49.370452 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 90/187] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Sep 29 01:57:49 2022] GET /identity/v3/projects/ca184432008d4efaa18beac740258875 => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:49.371168 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1735678-b443-4847-9050-d4b4f28ce9f9 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:49.403870 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 98/188] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:57:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:57:49.404987 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab5fce5-9649-48d4-82f0-0f476ad12ff1 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:49.486423 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:49.508862 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1735678-b443-4847-9050-d4b4f28ce9f9 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:49.510429 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab5fce5-9649-48d4-82f0-0f476ad12ff1 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:49.545974 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509573bc-529e-4979-8498-218f94785e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:49.546383 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509573bc-529e-4979-8498-218f94785e18 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:49.546686 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509573bc-529e-4979-8498-218f94785e18 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:49.546983 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509573bc-529e-4979-8498-218f94785e18 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:49.547435 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129ec937-63e3-4162-afa2-a5a4d42926c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:49.548219 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ec937-63e3-4162-afa2-a5a4d42926c9 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:49.548637 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ec937-63e3-4162-afa2-a5a4d42926c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:49.549056 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ec937-63e3-4162-afa2-a5a4d42926c9 None admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:49.550051 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129ec937-63e3-4162-afa2-a5a4d42926c9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:57:49.550607 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129ec937-63e3-4162-afa2-a5a4d42926c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:49.552228 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129ec937-63e3-4162-afa2-a5a4d42926c9 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:49.558839 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509573bc-529e-4979-8498-218f94785e18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:57:49.561449 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 99/189] 10.222.0.49 () {56 vars in 1101 bytes} [Thu Sep 29 01:57:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:49.562393 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129ec937-63e3-4162-afa2-a5a4d42926c9 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:49.563882 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-509573bc-529e-4979-8498-218f94785e18 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 01:57:49.563882 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:57:49.563882 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:57:49.563882 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:57:49.563882 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:57:49.563882 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:57:49.563882 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:57:49.563882 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:57:49.563882 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:57:49.563882 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:57:49.563882 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:57:49.563882 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:57:49.563882 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:57:49.563882 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:57:49.563882 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:57:49.563882 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:57:49.564756 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:57:49.564756 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:57:49.564756 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:57:49.564756 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:57:49.564756 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:57:49.564756 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:57:49.564756 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:57:49.564756 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:57:49.564756 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:57:49.564756 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:57:49.564756 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:57:49.564756 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:57:49.564756 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:57:49.564756 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:57:49.564756 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:57:49.564756 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:57:49.565680 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:57:49.565680 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:57:49.565680 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:57:49.565680 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:57:49.565680 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:57:49.565680 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:57:49.565680 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:57:49.565680 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:57:49.565680 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:57:49.565680 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:57:49.565680 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 01:57:49.565680 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:57:49.565680 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 91/190] 10.222.0.49 () {56 vars in 1096 bytes} [Thu Sep 29 01:57:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:57:49.566591 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509573bc-529e-4979-8498-218f94785e18 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:49.589585 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:49.679761 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509573bc-529e-4979-8498-218f94785e18 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:49.680434 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129ec937-63e3-4162-afa2-a5a4d42926c9 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:49.713364 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb03a157-235e-4eee-b73b-755c4d7e8774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:49.713988 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb03a157-235e-4eee-b73b-755c4d7e8774 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:49.714265 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb03a157-235e-4eee-b73b-755c4d7e8774 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:49.714534 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb03a157-235e-4eee-b73b-755c4d7e8774 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:49.715840 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb03a157-235e-4eee-b73b-755c4d7e8774 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:49.717284 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb03a157-235e-4eee-b73b-755c4d7e8774 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:49.719061 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 92/191] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 01:57:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:49.719651 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb03a157-235e-4eee-b73b-755c4d7e8774 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:49.722858 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806ee2ca-adcc-4d87-9d55-e72ba1cf3b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:49.723479 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ee2ca-adcc-4d87-9d55-e72ba1cf3b51 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:49.723760 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ee2ca-adcc-4d87-9d55-e72ba1cf3b51 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:49.724170 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ee2ca-adcc-4d87-9d55-e72ba1cf3b51 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:49.724859 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806ee2ca-adcc-4d87-9d55-e72ba1cf3b51 None admin] RBAC: Adding query filter params (role.id=8de931d79c9d4c8daf717aaea348dda9, scope.project.id=ca184432008d4efaa18beac740258875, user.id=a64bc3897f184f0bb688c7deb7e88f66) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:57:49.725171 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806ee2ca-adcc-4d87-9d55-e72ba1cf3b51 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:49.726643 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806ee2ca-adcc-4d87-9d55-e72ba1cf3b51 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:49.732421 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 100/192] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Sep 29 01:57:49 2022] GET /identity/v3/role_assignments?user.id=a64bc3897f184f0bb688c7deb7e88f66&scope.project.id=ca184432008d4efaa18beac740258875&role.id=8de931d79c9d4c8daf717aaea348dda9 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:49.733611 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806ee2ca-adcc-4d87-9d55-e72ba1cf3b51 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:49.755465 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:49.819923 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:49.837727 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb03a157-235e-4eee-b73b-755c4d7e8774 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:49.863814 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806ee2ca-adcc-4d87-9d55-e72ba1cf3b51 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:49.879379 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db37692-434e-4b85-8eee-851c34277558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:49.880016 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db37692-434e-4b85-8eee-851c34277558 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:49.880298 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db37692-434e-4b85-8eee-851c34277558 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:49.880577 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db37692-434e-4b85-8eee-851c34277558 None admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:49.881263 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db37692-434e-4b85-8eee-851c34277558 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:57:49.881598 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db37692-434e-4b85-8eee-851c34277558 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:49.883027 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db37692-434e-4b85-8eee-851c34277558 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:49.892619 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 93/193] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Sep 29 01:57:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:49.894262 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db37692-434e-4b85-8eee-851c34277558 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:49.914498 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33df3845-e285-4f79-b0f1-eeb72584ba25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:49.915143 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33df3845-e285-4f79-b0f1-eeb72584ba25 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:49.916017 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33df3845-e285-4f79-b0f1-eeb72584ba25 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:49.916017 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33df3845-e285-4f79-b0f1-eeb72584ba25 None admin] PATH_INFO: `/v3/users/92d2696b0e0445b1a01e8875b26e8224` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:49.916792 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33df3845-e285-4f79-b0f1-eeb72584ba25 None admin] RBAC: Authorizing `identity:get_user(user_id=92d2696b0e0445b1a01e8875b26e8224)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:49.918541 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33df3845-e285-4f79-b0f1-eeb72584ba25 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:49.920137 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 101/194] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Sep 29 01:57:49 2022] GET /identity/v3/users/92d2696b0e0445b1a01e8875b26e8224 => generated 289 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:49.920880 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33df3845-e285-4f79-b0f1-eeb72584ba25 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:50.006637 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:50.018053 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db37692-434e-4b85-8eee-851c34277558 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:50.029130 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33df3845-e285-4f79-b0f1-eeb72584ba25 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:50.053032 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cc06f0-c8fd-42bc-8a95-af81d629cd64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:50.053686 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc06f0-c8fd-42bc-8a95-af81d629cd64 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:50.053962 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc06f0-c8fd-42bc-8a95-af81d629cd64 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:50.054228 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc06f0-c8fd-42bc-8a95-af81d629cd64 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:50.063407 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673ef72f-58aa-4a97-bb91-1277dc6c75b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:50.064017 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673ef72f-58aa-4a97-bb91-1277dc6c75b9 None admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:50.064116 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cc06f0-c8fd-42bc-8a95-af81d629cd64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:57:50.064298 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673ef72f-58aa-4a97-bb91-1277dc6c75b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:50.064568 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673ef72f-58aa-4a97-bb91-1277dc6c75b9 None admin] PATH_INFO: `/v3/users` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:50.065221 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673ef72f-58aa-4a97-bb91-1277dc6c75b9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:50.066688 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673ef72f-58aa-4a97-bb91-1277dc6c75b9 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:50.069402 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-f0cc06f0-c8fd-42bc-8a95-af81d629cd64 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 29 01:57:50.069402 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:57:50.069402 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:57:50.069402 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:57:50.069402 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:57:50.069402 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:57:50.069402 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:57:50.069402 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:57:50.069402 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:57:50.069402 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:57:50.069402 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:57:50.069402 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:57:50.069402 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:57:50.069402 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:57:50.069402 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:57:50.069402 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:57:50.070475 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:57:50.070475 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:57:50.070475 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:57:50.070475 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:57:50.070475 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:57:50.070475 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:57:50.070475 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:57:50.070475 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:57:50.070475 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:57:50.070475 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:57:50.070475 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:57:50.070475 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:57:50.070475 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:57:50.070475 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:57:50.070475 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:57:50.070475 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:57:50.071605 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:57:50.071605 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:57:50.071605 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:57:50.071605 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:57:50.071605 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:57:50.071605 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:57:50.071605 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:57:50.071605 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:57:50.071605 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:57:50.071605 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:57:50.071605 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 29 01:57:50.071605 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:57:50.071605 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 94/195] 10.222.0.49 () {56 vars in 1114 bytes} [Thu Sep 29 01:57:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:57:50.073387 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cc06f0-c8fd-42bc-8a95-af81d629cd64 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:50.084371 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:50.087817 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 102/196] 10.222.0.49 () {60 vars in 1132 bytes} [Thu Sep 29 01:57:49 2022] POST /identity/v3/users => generated 297 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 01:57:50.087817 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673ef72f-58aa-4a97-bb91-1277dc6c75b9 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:50.184014 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cc06f0-c8fd-42bc-8a95-af81d629cd64 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:50.208356 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673ef72f-58aa-4a97-bb91-1277dc6c75b9 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:50.227369 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e2467-64d4-41ad-94f2-62ae7a39cf82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:50.228364 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e2467-64d4-41ad-94f2-62ae7a39cf82 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:50.228831 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e2467-64d4-41ad-94f2-62ae7a39cf82 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:50.229283 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e2467-64d4-41ad-94f2-62ae7a39cf82 None admin] PATH_INFO: `/v3/users/f67ada6fef81410183cd5abb19dfd699` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:50.242538 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:50.247385 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3a838a-43b9-4a21-bb42-434a4893cdac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:50.248104 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3a838a-43b9-4a21-bb42-434a4893cdac None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:50.248637 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3a838a-43b9-4a21-bb42-434a4893cdac None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:50.248991 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3a838a-43b9-4a21-bb42-434a4893cdac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:50.250965 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950e2467-64d4-41ad-94f2-62ae7a39cf82 None admin] RBAC: Authorizing `identity:get_user(user_id=f67ada6fef81410183cd5abb19dfd699)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:50.253876 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950e2467-64d4-41ad-94f2-62ae7a39cf82 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:50.257907 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 95/197] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Sep 29 01:57:50 2022] GET /identity/v3/users/f67ada6fef81410183cd5abb19dfd699 => generated 283 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:50.258990 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e2467-64d4-41ad-94f2-62ae7a39cf82 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:50.337464 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3a838a-43b9-4a21-bb42-434a4893cdac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:50.339226 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3a838a-43b9-4a21-bb42-434a4893cdac None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:50.341296 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:50.381525 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e2467-64d4-41ad-94f2-62ae7a39cf82 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:50.428476 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa001ffb-89ef-4851-970a-fc05f7e1e32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:50.429412 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa001ffb-89ef-4851-970a-fc05f7e1e32a None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:50.429690 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa001ffb-89ef-4851-970a-fc05f7e1e32a None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:50.429955 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa001ffb-89ef-4851-970a-fc05f7e1e32a None admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:50.430623 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa001ffb-89ef-4851-970a-fc05f7e1e32a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:57:50.430925 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa001ffb-89ef-4851-970a-fc05f7e1e32a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:50.432283 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa001ffb-89ef-4851-970a-fc05f7e1e32a None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:50.441294 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 96/198] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Sep 29 01:57:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:50.442152 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa001ffb-89ef-4851-970a-fc05f7e1e32a None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:50.459594 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 103/199] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Sep 29 01:57:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 29 01:57:50.460473 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3a838a-43b9-4a21-bb42-434a4893cdac None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:50.495582 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:50.571282 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa001ffb-89ef-4851-970a-fc05f7e1e32a None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:50.594327 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3a838a-43b9-4a21-bb42-434a4893cdac None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:50.605218 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:50.617608 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14ea88d-98ba-4efd-9dcd-00207f952fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:50.618435 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ea88d-98ba-4efd-9dcd-00207f952fdf None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:50.618883 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ea88d-98ba-4efd-9dcd-00207f952fdf None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:50.619379 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ea88d-98ba-4efd-9dcd-00207f952fdf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:50.639048 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e202d27-5e2b-4e6f-9259-ad803b6dff4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:50.639968 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e202d27-5e2b-4e6f-9259-ad803b6dff4d None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:50.640252 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e202d27-5e2b-4e6f-9259-ad803b6dff4d None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:50.640529 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e202d27-5e2b-4e6f-9259-ad803b6dff4d None admin] PATH_INFO: `/v3/users/f67ada6fef81410183cd5abb19dfd699` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:50.641711 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e202d27-5e2b-4e6f-9259-ad803b6dff4d None admin] RBAC: Authorizing `identity:get_user(user_id=f67ada6fef81410183cd5abb19dfd699)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:50.644347 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e202d27-5e2b-4e6f-9259-ad803b6dff4d None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:50.646185 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 104/200] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Sep 29 01:57:50 2022] GET /identity/v3/users/f67ada6fef81410183cd5abb19dfd699 => generated 283 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:50.647277 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e202d27-5e2b-4e6f-9259-ad803b6dff4d None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:50.713251 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14ea88d-98ba-4efd-9dcd-00207f952fdf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:50.715132 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14ea88d-98ba-4efd-9dcd-00207f952fdf None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:50.770404 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:50.775398 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e202d27-5e2b-4e6f-9259-ad803b6dff4d None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:50.815076 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cd6d8a-eefe-4f7c-abe0-f313f602865b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:50.816256 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cd6d8a-eefe-4f7c-abe0-f313f602865b None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:50.816751 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cd6d8a-eefe-4f7c-abe0-f313f602865b None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:50.817304 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cd6d8a-eefe-4f7c-abe0-f313f602865b None admin] PATH_INFO: `/v3/projects/ca184432008d4efaa18beac740258875` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:50.818736 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cd6d8a-eefe-4f7c-abe0-f313f602865b None admin] RBAC: Authorizing `identity:get_project(project_id=ca184432008d4efaa18beac740258875)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:50.820507 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cd6d8a-eefe-4f7c-abe0-f313f602865b None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:50.822523 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 105/201] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Sep 29 01:57:50 2022] GET /identity/v3/projects/ca184432008d4efaa18beac740258875 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:50.823641 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cd6d8a-eefe-4f7c-abe0-f313f602865b None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:50.828113 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 97/202] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Sep 29 01:57:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 29 01:57:50.828523 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14ea88d-98ba-4efd-9dcd-00207f952fdf None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:50.862426 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:50.938530 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14ea88d-98ba-4efd-9dcd-00207f952fdf None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:50.945275 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cd6d8a-eefe-4f7c-abe0-f313f602865b None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:50.975836 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea32c2a-1013-4b2b-9622-478c68e5bdc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:50.976446 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea32c2a-1013-4b2b-9622-478c68e5bdc7 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:50.976724 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea32c2a-1013-4b2b-9622-478c68e5bdc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:50.976997 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea32c2a-1013-4b2b-9622-478c68e5bdc7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:50.977752 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea32c2a-1013-4b2b-9622-478c68e5bdc7 None admin] RBAC: Adding query filter params (role.id=63a7737d5e4b42ccbfdd40451c4a1c77, scope.project.id=ca184432008d4efaa18beac740258875, user.id=92d2696b0e0445b1a01e8875b26e8224) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:57:50.978060 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea32c2a-1013-4b2b-9622-478c68e5bdc7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:50.979491 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea32c2a-1013-4b2b-9622-478c68e5bdc7 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:50.985112 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced1bc2b-cc4c-4fd6-ac36-f1257acb330c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:50.985586 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 98/203] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Sep 29 01:57:50 2022] GET /identity/v3/role_assignments?user.id=92d2696b0e0445b1a01e8875b26e8224&scope.project.id=ca184432008d4efaa18beac740258875&role.id=63a7737d5e4b42ccbfdd40451c4a1c77 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:50.986225 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced1bc2b-cc4c-4fd6-ac36-f1257acb330c None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:50.986435 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea32c2a-1013-4b2b-9622-478c68e5bdc7 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:50.987314 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced1bc2b-cc4c-4fd6-ac36-f1257acb330c None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:50.987823 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced1bc2b-cc4c-4fd6-ac36-f1257acb330c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:51.029423 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:51.071056 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced1bc2b-cc4c-4fd6-ac36-f1257acb330c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:51.072979 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced1bc2b-cc4c-4fd6-ac36-f1257acb330c None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:51.089242 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:51.098875 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea32c2a-1013-4b2b-9622-478c68e5bdc7 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:51.184057 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ac5c1-1487-4983-9df1-99a79f26e870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:51.186208 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ac5c1-1487-4983-9df1-99a79f26e870 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:51.186652 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ac5c1-1487-4983-9df1-99a79f26e870 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:51.187344 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ac5c1-1487-4983-9df1-99a79f26e870 None admin] PATH_INFO: `/v3/projects/7ed8ec70d1f649c6b36156f0f44f2271` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:51.191005 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8ac5c1-1487-4983-9df1-99a79f26e870 None admin] RBAC: Authorizing `identity:get_project(project_id=7ed8ec70d1f649c6b36156f0f44f2271)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:51.195432 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8ac5c1-1487-4983-9df1-99a79f26e870 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:51.200042 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 99/204] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Sep 29 01:57:50 2022] GET /identity/v3/projects/7ed8ec70d1f649c6b36156f0f44f2271 => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:51.206727 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ac5c1-1487-4983-9df1-99a79f26e870 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:51.249296 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 106/205] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Sep 29 01:57:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 29 01:57:51.258321 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced1bc2b-cc4c-4fd6-ac36-f1257acb330c None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:51.336157 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ac5c1-1487-4983-9df1-99a79f26e870 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:51.353916 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:51.395467 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3ad1df-bdf4-4072-9118-eaa8133d3fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:51.396132 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ad1df-bdf4-4072-9118-eaa8133d3fb8 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:51.396343 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ad1df-bdf4-4072-9118-eaa8133d3fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:51.396606 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ad1df-bdf4-4072-9118-eaa8133d3fb8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:51.397347 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3ad1df-bdf4-4072-9118-eaa8133d3fb8 None admin] RBAC: Adding query filter params (role.id=fe9bbc67742f4f5893f39b18eb31d59a, scope.project.id=7ed8ec70d1f649c6b36156f0f44f2271, user.id=f67ada6fef81410183cd5abb19dfd699) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:57:51.397643 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3ad1df-bdf4-4072-9118-eaa8133d3fb8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:51.399059 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3ad1df-bdf4-4072-9118-eaa8133d3fb8 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:51.404672 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 100/206] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Sep 29 01:57:51 2022] GET /identity/v3/role_assignments?user.id=f67ada6fef81410183cd5abb19dfd699&scope.project.id=7ed8ec70d1f649c6b36156f0f44f2271&role.id=fe9bbc67742f4f5893f39b18eb31d59a => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:57:51.409508 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced1bc2b-cc4c-4fd6-ac36-f1257acb330c None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:51.451086 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fb71c8-1ae2-4e41-9709-d9dd46592ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:51.452131 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fb71c8-1ae2-4e41-9709-d9dd46592ec1 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:51.452608 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fb71c8-1ae2-4e41-9709-d9dd46592ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:51.453073 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fb71c8-1ae2-4e41-9709-d9dd46592ec1 None admin] PATH_INFO: `/v3/projects/7ed8ec70d1f649c6b36156f0f44f2271` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:51.454550 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fb71c8-1ae2-4e41-9709-d9dd46592ec1 None admin] RBAC: Authorizing `identity:get_project(project_id=7ed8ec70d1f649c6b36156f0f44f2271)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:51.456936 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fb71c8-1ae2-4e41-9709-d9dd46592ec1 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:51.459346 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 107/207] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Sep 29 01:57:51 2022] GET /identity/v3/projects/7ed8ec70d1f649c6b36156f0f44f2271 => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:51.465051 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3ad1df-bdf4-4072-9118-eaa8133d3fb8 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:51.509007 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:51.606375 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3ad1df-bdf4-4072-9118-eaa8133d3fb8 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:51.642620 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a829c429-e991-4fcf-a643-efd602f1582f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:51.643380 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a829c429-e991-4fcf-a643-efd602f1582f None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:51.643649 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a829c429-e991-4fcf-a643-efd602f1582f None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:51.643912 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a829c429-e991-4fcf-a643-efd602f1582f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:51.644632 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a829c429-e991-4fcf-a643-efd602f1582f None admin] RBAC: Adding query filter params (role.id=8de931d79c9d4c8daf717aaea348dda9, scope.project.id=7ed8ec70d1f649c6b36156f0f44f2271, user.id=f67ada6fef81410183cd5abb19dfd699) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:57:51.644932 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a829c429-e991-4fcf-a643-efd602f1582f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:51.646383 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a829c429-e991-4fcf-a643-efd602f1582f None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:51.651889 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 101/208] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Sep 29 01:57:51 2022] GET /identity/v3/role_assignments?user.id=f67ada6fef81410183cd5abb19dfd699&scope.project.id=7ed8ec70d1f649c6b36156f0f44f2271&role.id=8de931d79c9d4c8daf717aaea348dda9 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:52.508386 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951935e2-b684-4bb3-846c-9aaa88cce584 None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:52.509458 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951935e2-b684-4bb3-846c-9aaa88cce584 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:52.509965 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951935e2-b684-4bb3-846c-9aaa88cce584 None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:52.511544 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 108/209] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:57:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:57:52.517362 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7c96e2-fce9-4275-9504-36e18e4464ad None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:52.518955 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7c96e2-fce9-4275-9504-36e18e4464ad None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:52.519435 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7c96e2-fce9-4275-9504-36e18e4464ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:52.539343 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-0d7c96e2-fce9-4275-9504-36e18e4464ad None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:57:52.540887 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-0d7c96e2-fce9-4275-9504-36e18e4464ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:57:52.617183 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 102/210] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:57:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:57:52.672884 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df27dc0-cbc1-4460-bd65-367db118235b None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:52.673511 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df27dc0-cbc1-4460-bd65-367db118235b None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:52.674005 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df27dc0-cbc1-4460-bd65-367db118235b None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:52.676471 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 109/211] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:57:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:57:52.681682 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d1f20-9484-44fe-91d3-f00231b2dbab None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:52.682185 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d1f20-9484-44fe-91d3-f00231b2dbab None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:52.682668 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d1f20-9484-44fe-91d3-f00231b2dbab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:52.702123 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-a58d1f20-9484-44fe-91d3-f00231b2dbab None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:57:52.703686 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-a58d1f20-9484-44fe-91d3-f00231b2dbab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:57:52.718327 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:52.779410 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 103/212] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:57:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:57:52.902696 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df27dc0-cbc1-4460-bd65-367db118235b None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:53.022427 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df27dc0-cbc1-4460-bd65-367db118235b None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:53.057766 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b82e718-8cb3-465b-861b-70578853b469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:53.058623 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b82e718-8cb3-465b-861b-70578853b469 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:53.059081 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b82e718-8cb3-465b-861b-70578853b469 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:53.059486 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b82e718-8cb3-465b-861b-70578853b469 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:53.062380 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:53.063384 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58d1f20-9484-44fe-91d3-f00231b2dbab None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:53.073822 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b82e718-8cb3-465b-861b-70578853b469 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:57:53.080886 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-4b82e718-8cb3-465b-861b-70578853b469 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 29 01:57:53.080886 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:57:53.080886 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:57:53.080886 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:57:53.080886 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:57:53.080886 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:57:53.080886 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:57:53.080886 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:57:53.080886 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:57:53.080886 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:57:53.080886 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:57:53.080886 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:57:53.080886 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:57:53.080886 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:57:53.080886 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:57:53.080886 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:57:53.081820 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:57:53.081820 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:57:53.081820 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:57:53.081820 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:57:53.081820 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:57:53.081820 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:57:53.081820 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:57:53.081820 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:57:53.081820 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:57:53.081820 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:57:53.081820 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:57:53.081820 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:57:53.081820 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:57:53.081820 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:57:53.081820 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:57:53.081820 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:57:53.082584 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:57:53.082584 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:57:53.082584 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:57:53.082584 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:57:53.082584 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:57:53.082584 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:57:53.082584 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:57:53.082584 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:57:53.082584 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:57:53.082584 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:57:53.082584 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 29 01:57:53.082584 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:57:53.085557 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 110/213] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Sep 29 01:57:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:57:53.091483 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b82e718-8cb3-465b-861b-70578853b469 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:53.186651 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58d1f20-9484-44fe-91d3-f00231b2dbab None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:53.203194 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b82e718-8cb3-465b-861b-70578853b469 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:53.224630 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1bb646-2529-4c6f-ac3e-c85ea6529ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:53.225360 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1bb646-2529-4c6f-ac3e-c85ea6529ee0 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:53.225636 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1bb646-2529-4c6f-ac3e-c85ea6529ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:53.225916 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1bb646-2529-4c6f-ac3e-c85ea6529ee0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:53.227047 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1bb646-2529-4c6f-ac3e-c85ea6529ee0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:53.228503 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1bb646-2529-4c6f-ac3e-c85ea6529ee0 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:53.234606 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 104/214] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 01:57:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:53.236121 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1bb646-2529-4c6f-ac3e-c85ea6529ee0 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:53.251899 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53125af-867c-4524-b573-77f7f63afca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:53.252556 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53125af-867c-4524-b573-77f7f63afca2 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:53.252878 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53125af-867c-4524-b573-77f7f63afca2 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:53.253112 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53125af-867c-4524-b573-77f7f63afca2 None admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:53.254089 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53125af-867c-4524-b573-77f7f63afca2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:57:53.254389 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53125af-867c-4524-b573-77f7f63afca2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:53.255931 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53125af-867c-4524-b573-77f7f63afca2 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:53.260038 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:53.272096 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 111/215] 10.222.0.49 () {56 vars in 1101 bytes} [Thu Sep 29 01:57:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:53.273927 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53125af-867c-4524-b573-77f7f63afca2 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:53.339363 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:53.361058 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1bb646-2529-4c6f-ac3e-c85ea6529ee0 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:53.388261 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53125af-867c-4524-b573-77f7f63afca2 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:53.399415 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa57347b-6272-4b00-9f7e-fd36a8c123ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:53.400025 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57347b-6272-4b00-9f7e-fd36a8c123ac None admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:53.400290 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57347b-6272-4b00-9f7e-fd36a8c123ac None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:53.400858 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57347b-6272-4b00-9f7e-fd36a8c123ac None admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:53.401216 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa57347b-6272-4b00-9f7e-fd36a8c123ac None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:53.402738 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa57347b-6272-4b00-9f7e-fd36a8c123ac None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:53.429917 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbf2572-6395-4caa-8888-e7e9c34795c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:53.430942 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbf2572-6395-4caa-8888-e7e9c34795c4 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:53.431417 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbf2572-6395-4caa-8888-e7e9c34795c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:53.431983 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbf2572-6395-4caa-8888-e7e9c34795c4 None admin] PATH_INFO: `/v3/users/15e3778307b843d58786b636cd69198a` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:53.441344 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 105/216] 10.222.0.49 () {60 vars in 1132 bytes} [Thu Sep 29 01:57:53 2022] POST /identity/v3/users => generated 297 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 01:57:53.455163 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbf2572-6395-4caa-8888-e7e9c34795c4 None admin] RBAC: Authorizing `identity:get_user(user_id=15e3778307b843d58786b636cd69198a)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:53.457500 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbf2572-6395-4caa-8888-e7e9c34795c4 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:53.459591 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 112/217] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Sep 29 01:57:53 2022] GET /identity/v3/users/15e3778307b843d58786b636cd69198a => generated 297 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:57:53.466560 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa57347b-6272-4b00-9f7e-fd36a8c123ac None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:53.566658 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:53.600887 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa57347b-6272-4b00-9f7e-fd36a8c123ac None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:53.631096 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b49d2-2c46-4895-924d-3919a49fb2b5 None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:53.631607 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b49d2-2c46-4895-924d-3919a49fb2b5 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:53.631680 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b49d2-2c46-4895-924d-3919a49fb2b5 None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:53.633090 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 113/218] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:57:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 29 01:57:53.639082 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023860ba-6dba-44f5-a2e2-4e3c527ac73f None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:53.639650 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023860ba-6dba-44f5-a2e2-4e3c527ac73f None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:53.640118 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023860ba-6dba-44f5-a2e2-4e3c527ac73f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:53.642372 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36082c13-e13a-4887-bbeb-ce7adb6de8dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:53.643024 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36082c13-e13a-4887-bbeb-ce7adb6de8dd None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:53.643334 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36082c13-e13a-4887-bbeb-ce7adb6de8dd None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:53.643608 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36082c13-e13a-4887-bbeb-ce7adb6de8dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:53.661577 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-023860ba-6dba-44f5-a2e2-4e3c527ac73f None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:57:53.663120 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-023860ba-6dba-44f5-a2e2-4e3c527ac73f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:57:53.721509 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36082c13-e13a-4887-bbeb-ce7adb6de8dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:53.723533 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36082c13-e13a-4887-bbeb-ce7adb6de8dd None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:53.753892 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 114/219] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:57:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 29 01:57:53.809686 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:53.842017 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 106/220] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Sep 29 01:57:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 29 01:57:53.848461 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023860ba-6dba-44f5-a2e2-4e3c527ac73f None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:53.861615 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf51a377-2257-45f1-90e4-41fb26764fd0 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:53.863053 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf51a377-2257-45f1-90e4-41fb26764fd0 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:53.863874 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf51a377-2257-45f1-90e4-41fb26764fd0 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:53.865564 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 107/221] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:57:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:57:53.872825 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36d2b12-cd8a-4fe6-a6ea-f533431e7f55 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:53.873046 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36d2b12-cd8a-4fe6-a6ea-f533431e7f55 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:53.873383 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36d2b12-cd8a-4fe6-a6ea-f533431e7f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:53.895568 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-d36d2b12-cd8a-4fe6-a6ea-f533431e7f55 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:57:53.897056 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-d36d2b12-cd8a-4fe6-a6ea-f533431e7f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:57:53.924066 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:53.992604 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 108/222] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:57:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 29 01:57:54.008280 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023860ba-6dba-44f5-a2e2-4e3c527ac73f None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:54.064815 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23064990-573f-4580-9eab-3b7258e84c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:54.066087 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23064990-573f-4580-9eab-3b7258e84c13 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:54.066594 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23064990-573f-4580-9eab-3b7258e84c13 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:54.067061 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23064990-573f-4580-9eab-3b7258e84c13 None admin] PATH_INFO: `/v3/projects/7ed8ec70d1f649c6b36156f0f44f2271` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:54.074007 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23064990-573f-4580-9eab-3b7258e84c13 None admin] RBAC: Authorizing `identity:get_project(project_id=7ed8ec70d1f649c6b36156f0f44f2271)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:54.075938 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23064990-573f-4580-9eab-3b7258e84c13 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:54.077922 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 115/223] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Sep 29 01:57:53 2022] GET /identity/v3/projects/7ed8ec70d1f649c6b36156f0f44f2271 => generated 302 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:54.084766 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36d2b12-cd8a-4fe6-a6ea-f533431e7f55 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:54.102456 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23064990-573f-4580-9eab-3b7258e84c13 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:54.209581 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36d2b12-cd8a-4fe6-a6ea-f533431e7f55 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:54.225935 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:54.265577 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89b3b22-b92c-4259-86f1-58124bf0d750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:54.266194 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b3b22-b92c-4259-86f1-58124bf0d750 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:54.266464 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b3b22-b92c-4259-86f1-58124bf0d750 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:54.266728 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b3b22-b92c-4259-86f1-58124bf0d750 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:54.270113 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89b3b22-b92c-4259-86f1-58124bf0d750 None admin] RBAC: Adding query filter params (role.id=f157f905c9c94ccfbfb46e52d443e8f2, scope.project.id=7ed8ec70d1f649c6b36156f0f44f2271, user.id=15e3778307b843d58786b636cd69198a) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:57:54.270431 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89b3b22-b92c-4259-86f1-58124bf0d750 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:54.271876 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89b3b22-b92c-4259-86f1-58124bf0d750 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:54.284837 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 109/224] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Sep 29 01:57:54 2022] GET /identity/v3/role_assignments?user.id=15e3778307b843d58786b636cd69198a&scope.project.id=7ed8ec70d1f649c6b36156f0f44f2271&role.id=f157f905c9c94ccfbfb46e52d443e8f2 => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:54.295280 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89b3b22-b92c-4259-86f1-58124bf0d750 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:54.311033 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23064990-573f-4580-9eab-3b7258e84c13 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:54.332376 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:54.380674 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c379ac7-f7b8-499c-a2df-365c3cd096b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:54.381354 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c379ac7-f7b8-499c-a2df-365c3cd096b4 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:54.381634 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c379ac7-f7b8-499c-a2df-365c3cd096b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:54.381898 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c379ac7-f7b8-499c-a2df-365c3cd096b4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:54.397782 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c379ac7-f7b8-499c-a2df-365c3cd096b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:57:54.403721 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-1c379ac7-f7b8-499c-a2df-365c3cd096b4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 01:57:54.403721 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:57:54.403721 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:57:54.403721 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:57:54.403721 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:57:54.403721 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:57:54.403721 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:57:54.403721 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:57:54.403721 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:57:54.403721 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:57:54.403721 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:57:54.403721 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:57:54.403721 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:57:54.403721 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:57:54.403721 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:57:54.403721 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:57:54.404679 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:57:54.404679 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:57:54.404679 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:57:54.404679 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:57:54.404679 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:57:54.404679 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:57:54.404679 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:57:54.404679 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:57:54.404679 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:57:54.404679 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:57:54.404679 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:57:54.404679 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:57:54.404679 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:57:54.404679 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:57:54.404679 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:57:54.404679 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:57:54.405471 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:57:54.405471 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:57:54.405471 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:57:54.405471 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:57:54.405471 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:57:54.405471 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:57:54.405471 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:57:54.405471 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:57:54.405471 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:57:54.405471 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:57:54.405471 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 01:57:54.405471 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:57:54.405471 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 116/225] 10.222.0.49 () {56 vars in 1096 bytes} [Thu Sep 29 01:57:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 01:57:54.418543 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c379ac7-f7b8-499c-a2df-365c3cd096b4 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:54.466817 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89b3b22-b92c-4259-86f1-58124bf0d750 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:54.511979 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052d19a7-6f7c-45b9-9033-713a22719a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:54.512632 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052d19a7-6f7c-45b9-9033-713a22719a12 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:54.512908 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052d19a7-6f7c-45b9-9033-713a22719a12 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:54.513178 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052d19a7-6f7c-45b9-9033-713a22719a12 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:54.530709 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052d19a7-6f7c-45b9-9033-713a22719a12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:57:54.537100 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-052d19a7-6f7c-45b9-9033-713a22719a12 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 29 01:57:54.537100 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:57:54.537100 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:57:54.537100 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:57:54.537100 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:57:54.537100 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:57:54.537100 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:57:54.537100 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:57:54.537100 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:57:54.537100 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:57:54.537100 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:57:54.537100 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:57:54.537100 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:57:54.537100 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:57:54.537100 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:57:54.537100 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:57:54.539567 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:57:54.539567 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:57:54.539567 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:57:54.539567 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:57:54.539567 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:57:54.539567 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:57:54.539567 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:57:54.539567 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:57:54.539567 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:57:54.539567 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:57:54.539567 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:57:54.539567 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:57:54.539567 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:57:54.539567 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:57:54.539567 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:57:54.539567 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:57:54.541561 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:57:54.541561 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:57:54.541561 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:57:54.541561 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:57:54.541561 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:57:54.541561 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:57:54.541561 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:57:54.541561 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:57:54.541561 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:57:54.541561 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:57:54.541561 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 29 01:57:54.541561 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:57:54.541561 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 110/226] 10.222.0.49 () {56 vars in 1114 bytes} [Thu Sep 29 01:57:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 01:57:54.545361 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052d19a7-6f7c-45b9-9033-713a22719a12 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:54.607634 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:54.628787 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c379ac7-f7b8-499c-a2df-365c3cd096b4 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:54.683466 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c929ee82-40e8-4da9-ac61-2fc0d5e2a72e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:54.684365 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c929ee82-40e8-4da9-ac61-2fc0d5e2a72e None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:54.684645 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c929ee82-40e8-4da9-ac61-2fc0d5e2a72e None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:54.684919 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c929ee82-40e8-4da9-ac61-2fc0d5e2a72e None admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:54.685763 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c929ee82-40e8-4da9-ac61-2fc0d5e2a72e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:57:54.686066 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c929ee82-40e8-4da9-ac61-2fc0d5e2a72e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:54.687529 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c929ee82-40e8-4da9-ac61-2fc0d5e2a72e None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:54.698844 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 117/227] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Sep 29 01:57:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:54.704086 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c929ee82-40e8-4da9-ac61-2fc0d5e2a72e None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:54.748293 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052d19a7-6f7c-45b9-9033-713a22719a12 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:54.776224 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:54.817303 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c618ed2-1e9e-4e83-aa7b-e8053c18a1c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:54.817942 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c618ed2-1e9e-4e83-aa7b-e8053c18a1c4 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:54.818215 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c618ed2-1e9e-4e83-aa7b-e8053c18a1c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:54.818479 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c618ed2-1e9e-4e83-aa7b-e8053c18a1c4 None admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:54.819147 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c618ed2-1e9e-4e83-aa7b-e8053c18a1c4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:57:54.819438 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c618ed2-1e9e-4e83-aa7b-e8053c18a1c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:54.820819 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c618ed2-1e9e-4e83-aa7b-e8053c18a1c4 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:54.835216 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 111/228] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Sep 29 01:57:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:54.850336 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c618ed2-1e9e-4e83-aa7b-e8053c18a1c4 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:54.881388 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c929ee82-40e8-4da9-ac61-2fc0d5e2a72e None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:54.936213 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92a1323-92eb-43fc-8c8b-160065607a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:54.936855 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92a1323-92eb-43fc-8c8b-160065607a04 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:54.937129 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92a1323-92eb-43fc-8c8b-160065607a04 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:54.937429 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92a1323-92eb-43fc-8c8b-160065607a04 None admin] PATH_INFO: `/v3/users/f67ada6fef81410183cd5abb19dfd699` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:54.938607 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92a1323-92eb-43fc-8c8b-160065607a04 None admin] RBAC: Authorizing `identity:get_user(user_id=f67ada6fef81410183cd5abb19dfd699)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:54.940276 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92a1323-92eb-43fc-8c8b-160065607a04 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:54.941889 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 118/229] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Sep 29 01:57:54 2022] GET /identity/v3/users/f67ada6fef81410183cd5abb19dfd699 => generated 283 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:54.947778 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92a1323-92eb-43fc-8c8b-160065607a04 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:55.060599 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:55.068061 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92a1323-92eb-43fc-8c8b-160065607a04 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:55.070671 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:55.091482 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c618ed2-1e9e-4e83-aa7b-e8053c18a1c4 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:55.106354 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8991a3fe-07b8-4917-80d7-112ee975681f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:55.106991 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991a3fe-07b8-4917-80d7-112ee975681f None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:55.107271 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991a3fe-07b8-4917-80d7-112ee975681f None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:55.107540 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991a3fe-07b8-4917-80d7-112ee975681f None admin] PATH_INFO: `/v3/projects/7ed8ec70d1f649c6b36156f0f44f2271` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:55.108772 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8991a3fe-07b8-4917-80d7-112ee975681f None admin] RBAC: Authorizing `identity:get_project(project_id=7ed8ec70d1f649c6b36156f0f44f2271)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:55.110312 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8991a3fe-07b8-4917-80d7-112ee975681f None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:55.112687 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 119/230] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Sep 29 01:57:54 2022] GET /identity/v3/projects/7ed8ec70d1f649c6b36156f0f44f2271 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:55.122925 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8991a3fe-07b8-4917-80d7-112ee975681f None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:55.157659 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fcd59e-3875-4c88-b826-d25c13b44675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:55.159492 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fcd59e-3875-4c88-b826-d25c13b44675 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:55.159771 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fcd59e-3875-4c88-b826-d25c13b44675 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:55.160084 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fcd59e-3875-4c88-b826-d25c13b44675 None admin] PATH_INFO: `/v3/users/f67ada6fef81410183cd5abb19dfd699` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:55.161384 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fcd59e-3875-4c88-b826-d25c13b44675 None admin] RBAC: Authorizing `identity:get_user(user_id=f67ada6fef81410183cd5abb19dfd699)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:55.162848 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fcd59e-3875-4c88-b826-d25c13b44675 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:55.164462 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 112/231] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Sep 29 01:57:54 2022] GET /identity/v3/users/f67ada6fef81410183cd5abb19dfd699 => generated 283 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:55.176892 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fcd59e-3875-4c88-b826-d25c13b44675 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:55.312732 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8991a3fe-07b8-4917-80d7-112ee975681f None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:55.334683 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fcd59e-3875-4c88-b826-d25c13b44675 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:55.386495 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd4fc3c-a6bf-4dcd-829b-b52904faa082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:55.387176 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd4fc3c-a6bf-4dcd-829b-b52904faa082 None admin] REQUEST_METHOD: `PUT` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:55.387456 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd4fc3c-a6bf-4dcd-829b-b52904faa082 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:55.387731 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd4fc3c-a6bf-4dcd-829b-b52904faa082 None admin] PATH_INFO: `/v3/projects/7ed8ec70d1f649c6b36156f0f44f2271/users/f67ada6fef81410183cd5abb19dfd699/roles/fe9bbc67742f4f5893f39b18eb31d59a` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:55.390475 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd4fc3c-a6bf-4dcd-829b-b52904faa082 None admin] RBAC: Authorizing `identity:create_grant(project_id=7ed8ec70d1f649c6b36156f0f44f2271, user_id=f67ada6fef81410183cd5abb19dfd699, role_id=fe9bbc67742f4f5893f39b18eb31d59a)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:55.391924 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd4fc3c-a6bf-4dcd-829b-b52904faa082 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:55.402334 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373803df-13c1-44d3-8419-9c83f43ada96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:55.402970 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373803df-13c1-44d3-8419-9c83f43ada96 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:55.403249 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373803df-13c1-44d3-8419-9c83f43ada96 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:55.403518 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373803df-13c1-44d3-8419-9c83f43ada96 None admin] PATH_INFO: `/v3/projects/7ed8ec70d1f649c6b36156f0f44f2271` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:55.405690 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373803df-13c1-44d3-8419-9c83f43ada96 None admin] RBAC: Authorizing `identity:get_project(project_id=7ed8ec70d1f649c6b36156f0f44f2271)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:55.407228 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373803df-13c1-44d3-8419-9c83f43ada96 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:55.409460 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 113/232] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Sep 29 01:57:55 2022] GET /identity/v3/projects/7ed8ec70d1f649c6b36156f0f44f2271 => generated 302 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:57:55.418693 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373803df-13c1-44d3-8419-9c83f43ada96 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:55.421024 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 120/233] 10.222.0.49 () {58 vars in 1439 bytes} [Thu Sep 29 01:57:55 2022] PUT /identity/v3/projects/7ed8ec70d1f649c6b36156f0f44f2271/users/f67ada6fef81410183cd5abb19dfd699/roles/fe9bbc67742f4f5893f39b18eb31d59a => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 01:57:55.448835 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:55.574609 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373803df-13c1-44d3-8419-9c83f43ada96 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:55.610523 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9111c8e1-e4a8-47e6-9caa-20b83993ff81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:55.611288 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9111c8e1-e4a8-47e6-9caa-20b83993ff81 None admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:55.611451 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9111c8e1-e4a8-47e6-9caa-20b83993ff81 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:55.612330 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9111c8e1-e4a8-47e6-9caa-20b83993ff81 None admin] PATH_INFO: `/v3/projects/7ed8ec70d1f649c6b36156f0f44f2271/users/f67ada6fef81410183cd5abb19dfd699/roles/8de931d79c9d4c8daf717aaea348dda9` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:55.614915 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9111c8e1-e4a8-47e6-9caa-20b83993ff81 None admin] RBAC: Authorizing `identity:create_grant(project_id=7ed8ec70d1f649c6b36156f0f44f2271, user_id=f67ada6fef81410183cd5abb19dfd699, role_id=8de931d79c9d4c8daf717aaea348dda9)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:55.616381 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9111c8e1-e4a8-47e6-9caa-20b83993ff81 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:55.631207 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 114/234] 10.222.0.49 () {58 vars in 1439 bytes} [Thu Sep 29 01:57:55 2022] PUT /identity/v3/projects/7ed8ec70d1f649c6b36156f0f44f2271/users/f67ada6fef81410183cd5abb19dfd699/roles/8de931d79c9d4c8daf717aaea348dda9 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 01:57:56.219486 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c4732-572f-4e85-b590-4fd06bbd6323 None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:56.220496 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c4732-572f-4e85-b590-4fd06bbd6323 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:56.221560 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c4732-572f-4e85-b590-4fd06bbd6323 None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:56.223562 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 121/235] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:57:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:57:56.229416 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59667682-fd39-4261-b76b-0e5814e105a2 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:56.229972 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59667682-fd39-4261-b76b-0e5814e105a2 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:56.230469 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59667682-fd39-4261-b76b-0e5814e105a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:56.249010 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-59667682-fd39-4261-b76b-0e5814e105a2 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:57:56.250538 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-59667682-fd39-4261-b76b-0e5814e105a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:57:56.348431 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 115/236] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:57:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:57:56.360441 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a2d85-b676-4e2d-a8d8-3840a608b17a None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:56.360801 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a2d85-b676-4e2d-a8d8-3840a608b17a None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:56.361178 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a2d85-b676-4e2d-a8d8-3840a608b17a None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:56.363066 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 122/237] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:57:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:57:56.374936 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63bc624-3c83-42c7-9c9e-5a536ec9e44c None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:56.375466 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63bc624-3c83-42c7-9c9e-5a536ec9e44c None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:56.375937 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63bc624-3c83-42c7-9c9e-5a536ec9e44c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:56.399821 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-e63bc624-3c83-42c7-9c9e-5a536ec9e44c None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:57:56.401026 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-e63bc624-3c83-42c7-9c9e-5a536ec9e44c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:57:56.412227 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:56.486289 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 116/238] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:57:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 29 01:57:56.782507 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219a2d85-b676-4e2d-a8d8-3840a608b17a None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:56.819970 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:56.894926 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63bc624-3c83-42c7-9c9e-5a536ec9e44c None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:56.922285 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219a2d85-b676-4e2d-a8d8-3840a608b17a None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:56.980281 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67cc819-263d-49f7-adda-61693d4ca1e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:56.981180 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67cc819-263d-49f7-adda-61693d4ca1e5 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:56.981618 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67cc819-263d-49f7-adda-61693d4ca1e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:56.982038 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67cc819-263d-49f7-adda-61693d4ca1e5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:56.994336 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67cc819-263d-49f7-adda-61693d4ca1e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:57:56.999645 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-a67cc819-263d-49f7-adda-61693d4ca1e5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 29 01:57:56.999645 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:57:56.999645 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:57:56.999645 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:57:56.999645 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:57:56.999645 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:57:56.999645 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:57:56.999645 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:57:56.999645 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:57:56.999645 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:57:56.999645 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:57:56.999645 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:57:56.999645 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:57:56.999645 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:57:56.999645 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:57:56.999645 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:57:57.000707 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:57:57.000707 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:57:57.000707 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:57:57.000707 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:57:57.000707 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:57:57.000707 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:57:57.000707 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:57:57.000707 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:57:57.000707 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:57:57.000707 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:57:57.000707 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:57:57.000707 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:57:57.000707 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:57:57.000707 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:57:57.000707 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:57:57.000707 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:57:57.001733 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:57:57.001733 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:57:57.001733 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:57:57.001733 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:57:57.001733 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:57:57.001733 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:57:57.001733 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:57:57.001733 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:57:57.001733 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:57:57.001733 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:57:57.001733 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 29 01:57:57.001733 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:57:57.003835 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 123/239] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Sep 29 01:57:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:57:57.005154 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f0a192-e96d-495f-8075-312af83c42cb None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:57.005699 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f0a192-e96d-495f-8075-312af83c42cb None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:57.006107 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f0a192-e96d-495f-8075-312af83c42cb None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:57.007820 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 124/240] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:57:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:57:57.010903 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f0a192-e96d-495f-8075-312af83c42cb None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:57.041808 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63bc624-3c83-42c7-9c9e-5a536ec9e44c None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:57.078398 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfacc5c1-fa2e-4e1c-93f2-65a038d89fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:57.078977 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfacc5c1-fa2e-4e1c-93f2-65a038d89fba None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:57.079399 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfacc5c1-fa2e-4e1c-93f2-65a038d89fba None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:57.079671 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfacc5c1-fa2e-4e1c-93f2-65a038d89fba None admin] PATH_INFO: `/v3/domains/default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:57.081674 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfacc5c1-fa2e-4e1c-93f2-65a038d89fba None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:57.083301 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfacc5c1-fa2e-4e1c-93f2-65a038d89fba None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:57.085063 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 117/241] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 01:57:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:57.086281 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc1c8a-b2e9-4163-b2c5-8921c2397eea None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:57.086620 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc1c8a-b2e9-4163-b2c5-8921c2397eea None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:57.086954 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc1c8a-b2e9-4163-b2c5-8921c2397eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:57.106424 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-b7cc1c8a-b2e9-4163-b2c5-8921c2397eea None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:57:57.107629 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-b7cc1c8a-b2e9-4163-b2c5-8921c2397eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:57:57.116644 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:57.149327 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:57.165434 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f0a192-e96d-495f-8075-312af83c42cb None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:57.189882 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 118/242] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:57:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:57:57.191501 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cc1c8a-b2e9-4163-b2c5-8921c2397eea None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:57.223906 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3c6fbe-40b3-470e-bcff-4d00b0fd9d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:57.225345 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3c6fbe-40b3-470e-bcff-4d00b0fd9d9c None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:57.225848 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3c6fbe-40b3-470e-bcff-4d00b0fd9d9c None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:57.226368 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3c6fbe-40b3-470e-bcff-4d00b0fd9d9c None admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:57.227250 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3c6fbe-40b3-470e-bcff-4d00b0fd9d9c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:57:57.227927 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3c6fbe-40b3-470e-bcff-4d00b0fd9d9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:57.229660 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3c6fbe-40b3-470e-bcff-4d00b0fd9d9c None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:57.249531 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 125/243] 10.222.0.49 () {56 vars in 1101 bytes} [Thu Sep 29 01:57:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:57.250698 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3c6fbe-40b3-470e-bcff-4d00b0fd9d9c None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:57.301468 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cc1c8a-b2e9-4163-b2c5-8921c2397eea None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:57.358027 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b7bc82-2937-4a00-bf72-913098186af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:57.358653 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b7bc82-2937-4a00-bf72-913098186af8 None admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:57.358936 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b7bc82-2937-4a00-bf72-913098186af8 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:57.359213 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b7bc82-2937-4a00-bf72-913098186af8 None admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:57.359931 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b7bc82-2937-4a00-bf72-913098186af8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:57.361488 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b7bc82-2937-4a00-bf72-913098186af8 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:57.392721 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:57.394720 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3c6fbe-40b3-470e-bcff-4d00b0fd9d9c None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:57.404805 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 119/244] 10.222.0.49 () {60 vars in 1132 bytes} [Thu Sep 29 01:57:57 2022] POST /identity/v3/users => generated 293 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 01:57:57.438811 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1485c2-dcd5-4d29-b231-51706da9a501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:57.439472 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1485c2-dcd5-4d29-b231-51706da9a501 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:57.440300 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1485c2-dcd5-4d29-b231-51706da9a501 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:57.440570 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1485c2-dcd5-4d29-b231-51706da9a501 None admin] PATH_INFO: `/v3/users/1a1cd34b69ec4930b0d67d7fff35ff6c` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:57.457230 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1485c2-dcd5-4d29-b231-51706da9a501 None admin] RBAC: Authorizing `identity:get_user(user_id=1a1cd34b69ec4930b0d67d7fff35ff6c)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:57.458758 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1485c2-dcd5-4d29-b231-51706da9a501 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:57.460535 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 126/245] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Sep 29 01:57:57 2022] GET /identity/v3/users/1a1cd34b69ec4930b0d67d7fff35ff6c => generated 297 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:57.466193 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b7bc82-2937-4a00-bf72-913098186af8 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:57.624750 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b7bc82-2937-4a00-bf72-913098186af8 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:57.638023 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1485c2-dcd5-4d29-b231-51706da9a501 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:57.664905 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:57.671715 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29137f1-b60b-475d-9758-9639f636fa6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:57.673863 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29137f1-b60b-475d-9758-9639f636fa6b None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:57.674217 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29137f1-b60b-475d-9758-9639f636fa6b None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:57.674497 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29137f1-b60b-475d-9758-9639f636fa6b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:57.775770 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29137f1-b60b-475d-9758-9639f636fa6b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:57.777740 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29137f1-b60b-475d-9758-9639f636fa6b None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:57.781663 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:57.786228 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1485c2-dcd5-4d29-b231-51706da9a501 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:57.831420 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba82c096-2080-4e19-80d2-3f7a51ea98b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:57.832643 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82c096-2080-4e19-80d2-3f7a51ea98b8 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:57.833125 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82c096-2080-4e19-80d2-3f7a51ea98b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:57.833635 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82c096-2080-4e19-80d2-3f7a51ea98b8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:57.845445 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba82c096-2080-4e19-80d2-3f7a51ea98b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:57:57.853564 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-ba82c096-2080-4e19-80d2-3f7a51ea98b8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 29 01:57:57.853564 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:57:57.853564 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:57:57.853564 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:57:57.853564 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:57:57.853564 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:57:57.853564 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:57:57.853564 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:57:57.853564 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:57:57.853564 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:57:57.853564 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:57:57.853564 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:57:57.853564 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:57:57.853564 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:57:57.853564 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:57:57.853564 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:57:57.854475 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:57:57.854475 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:57:57.854475 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:57:57.854475 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:57:57.854475 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:57:57.854475 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:57:57.854475 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:57:57.854475 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:57:57.854475 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:57:57.854475 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:57:57.854475 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:57:57.854475 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:57:57.854475 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:57:57.854475 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:57:57.854475 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:57:57.854475 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:57:57.855260 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:57:57.855260 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:57:57.855260 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:57:57.855260 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:57:57.855260 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:57:57.855260 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:57:57.855260 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:57:57.855260 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:57:57.855260 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:57:57.855260 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:57:57.855260 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 29 01:57:57.855260 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:57:57.858037 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 127/246] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Sep 29 01:57:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:57:57.865672 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba82c096-2080-4e19-80d2-3f7a51ea98b8 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:57.895217 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 120/247] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Sep 29 01:57:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 29 01:57:57.910696 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29137f1-b60b-475d-9758-9639f636fa6b None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:57.962950 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:58.008388 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba82c096-2080-4e19-80d2-3f7a51ea98b8 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:58.044822 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:58.051767 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29137f1-b60b-475d-9758-9639f636fa6b None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:58.069846 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c430c1a-9ec9-4f17-a148-ca41aa2abc31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:58.070480 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c430c1a-9ec9-4f17-a148-ca41aa2abc31 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:58.070754 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c430c1a-9ec9-4f17-a148-ca41aa2abc31 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:58.071024 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c430c1a-9ec9-4f17-a148-ca41aa2abc31 None admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:58.071916 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c430c1a-9ec9-4f17-a148-ca41aa2abc31 None admin] RBAC: Adding query filter params (name=member) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:57:58.072226 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c430c1a-9ec9-4f17-a148-ca41aa2abc31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:58.074221 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c430c1a-9ec9-4f17-a148-ca41aa2abc31 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:58.087432 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 128/248] 10.222.0.49 () {56 vars in 1101 bytes} [Thu Sep 29 01:57:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:58.093550 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c430c1a-9ec9-4f17-a148-ca41aa2abc31 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:58.104997 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed818d75-6ce4-405a-bf02-31d4f72ba4d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:58.105884 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed818d75-6ce4-405a-bf02-31d4f72ba4d5 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:58.106318 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed818d75-6ce4-405a-bf02-31d4f72ba4d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:58.106980 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed818d75-6ce4-405a-bf02-31d4f72ba4d5 None admin] PATH_INFO: `/v3/projects/7ed8ec70d1f649c6b36156f0f44f2271` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:58.107951 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed818d75-6ce4-405a-bf02-31d4f72ba4d5 None admin] RBAC: Authorizing `identity:get_project(project_id=7ed8ec70d1f649c6b36156f0f44f2271)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:58.110239 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed818d75-6ce4-405a-bf02-31d4f72ba4d5 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:58.111657 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 121/249] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Sep 29 01:57:57 2022] GET /identity/v3/projects/7ed8ec70d1f649c6b36156f0f44f2271 => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:58.118371 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed818d75-6ce4-405a-bf02-31d4f72ba4d5 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:58.212346 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c430c1a-9ec9-4f17-a148-ca41aa2abc31 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:58.251133 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed818d75-6ce4-405a-bf02-31d4f72ba4d5 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:58.253693 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d072aeb-f938-4eb9-87dc-3938c58d582a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:58.254360 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d072aeb-f938-4eb9-87dc-3938c58d582a None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:58.254638 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d072aeb-f938-4eb9-87dc-3938c58d582a None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:58.254909 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d072aeb-f938-4eb9-87dc-3938c58d582a None admin] PATH_INFO: `/v3/users/15e3778307b843d58786b636cd69198a` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:58.256176 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d072aeb-f938-4eb9-87dc-3938c58d582a None admin] RBAC: Authorizing `identity:get_user(user_id=15e3778307b843d58786b636cd69198a)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:58.257720 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d072aeb-f938-4eb9-87dc-3938c58d582a None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:58.264188 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 129/250] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Sep 29 01:57:58 2022] GET /identity/v3/users/15e3778307b843d58786b636cd69198a => generated 297 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:57:58.265744 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d05db7-2c8b-4e33-8b84-659064894cf1 None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:58.266032 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d05db7-2c8b-4e33-8b84-659064894cf1 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:58.266312 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d05db7-2c8b-4e33-8b84-659064894cf1 None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:58.268094 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 130/251] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:57:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:57:58.269032 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d05db7-2c8b-4e33-8b84-659064894cf1 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:58.276351 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:58.308712 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4654a4c2-2249-4840-aee1-2f32a61c1b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:58.310291 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4654a4c2-2249-4840-aee1-2f32a61c1b4d None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:58.310745 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4654a4c2-2249-4840-aee1-2f32a61c1b4d None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:58.311438 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4654a4c2-2249-4840-aee1-2f32a61c1b4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:58.312607 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4654a4c2-2249-4840-aee1-2f32a61c1b4d None admin] RBAC: Adding query filter params (role.id=63a7737d5e4b42ccbfdd40451c4a1c77, scope.project.id=7ed8ec70d1f649c6b36156f0f44f2271, user.id=1a1cd34b69ec4930b0d67d7fff35ff6c) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:57:58.313499 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4654a4c2-2249-4840-aee1-2f32a61c1b4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:58.316211 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4654a4c2-2249-4840-aee1-2f32a61c1b4d None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:58.324107 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 122/252] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Sep 29 01:57:58 2022] GET /identity/v3/role_assignments?user.id=1a1cd34b69ec4930b0d67d7fff35ff6c&scope.project.id=7ed8ec70d1f649c6b36156f0f44f2271&role.id=63a7737d5e4b42ccbfdd40451c4a1c77 => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:58.326214 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2209c40-4c20-4b8d-be0c-8256c3e2d7ed None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:58.326695 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2209c40-4c20-4b8d-be0c-8256c3e2d7ed None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:58.327636 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2209c40-4c20-4b8d-be0c-8256c3e2d7ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:58.354940 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-d2209c40-4c20-4b8d-be0c-8256c3e2d7ed None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:57:58.357515 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-d2209c40-4c20-4b8d-be0c-8256c3e2d7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:57:58.393274 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:58.395414 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d05db7-2c8b-4e33-8b84-659064894cf1 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:58.437500 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f4e1d4-82d3-47ff-aa33-276758d650b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:58.438302 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f4e1d4-82d3-47ff-aa33-276758d650b3 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:58.438793 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f4e1d4-82d3-47ff-aa33-276758d650b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:58.438989 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f4e1d4-82d3-47ff-aa33-276758d650b3 None admin] PATH_INFO: `/v3/projects/7ed8ec70d1f649c6b36156f0f44f2271` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:58.440406 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f4e1d4-82d3-47ff-aa33-276758d650b3 None admin] RBAC: Authorizing `identity:get_project(project_id=7ed8ec70d1f649c6b36156f0f44f2271)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:58.442070 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f4e1d4-82d3-47ff-aa33-276758d650b3 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:58.444044 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 131/253] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Sep 29 01:57:58 2022] GET /identity/v3/projects/7ed8ec70d1f649c6b36156f0f44f2271 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:58.451410 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f4e1d4-82d3-47ff-aa33-276758d650b3 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:58.502935 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 123/254] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:57:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:57:58.504761 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7552fbc7-cf90-40a3-9758-af80927c7ac2 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:58.504761 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7552fbc7-cf90-40a3-9758-af80927c7ac2 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:58.505030 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7552fbc7-cf90-40a3-9758-af80927c7ac2 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:58.506682 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 124/255] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:57:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:57:58.514831 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f2bf9e-c2b7-42c8-b697-f2105ff38c82 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:58.515152 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f2bf9e-c2b7-42c8-b697-f2105ff38c82 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:58.515380 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f2bf9e-c2b7-42c8-b697-f2105ff38c82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:58.547093 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:58.574522 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-83f2bf9e-c2b7-42c8-b697-f2105ff38c82 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:57:58.575637 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-83f2bf9e-c2b7-42c8-b697-f2105ff38c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:57:58.577834 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f4e1d4-82d3-47ff-aa33-276758d650b3 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:58.616128 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c52b956-50f3-4e1f-844a-84403de12d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:58.617568 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c52b956-50f3-4e1f-844a-84403de12d28 None admin] REQUEST_METHOD: `PUT` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:58.618044 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c52b956-50f3-4e1f-844a-84403de12d28 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:58.618559 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c52b956-50f3-4e1f-844a-84403de12d28 None admin] PATH_INFO: `/v3/projects/7ed8ec70d1f649c6b36156f0f44f2271/users/15e3778307b843d58786b636cd69198a/roles/f157f905c9c94ccfbfb46e52d443e8f2` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:58.620840 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c52b956-50f3-4e1f-844a-84403de12d28 None admin] RBAC: Authorizing `identity:create_grant(project_id=7ed8ec70d1f649c6b36156f0f44f2271, user_id=15e3778307b843d58786b636cd69198a, role_id=f157f905c9c94ccfbfb46e52d443e8f2)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:58.622646 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c52b956-50f3-4e1f-844a-84403de12d28 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:58.638227 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 132/256] 10.222.0.49 () {58 vars in 1439 bytes} [Thu Sep 29 01:57:58 2022] PUT /identity/v3/projects/7ed8ec70d1f649c6b36156f0f44f2271/users/15e3778307b843d58786b636cd69198a/roles/f157f905c9c94ccfbfb46e52d443e8f2 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 01:57:58.750971 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 125/257] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:57:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:57:58.893000 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c52b956-50f3-4e1f-844a-84403de12d28 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:59.038246 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c52b956-50f3-4e1f-844a-84403de12d28 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:59.085711 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:59.088750 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c255859-c37a-49c7-8213-0923ce086fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:59.089522 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c255859-c37a-49c7-8213-0923ce086fc4 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:59.089737 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c255859-c37a-49c7-8213-0923ce086fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:59.089974 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c255859-c37a-49c7-8213-0923ce086fc4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:59.103510 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c255859-c37a-49c7-8213-0923ce086fc4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:57:59.109012 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-9c255859-c37a-49c7-8213-0923ce086fc4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 01:57:59.109012 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:57:59.109012 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:57:59.109012 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:57:59.109012 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:57:59.109012 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:57:59.109012 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:57:59.109012 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:57:59.109012 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:57:59.109012 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:57:59.109012 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:57:59.109012 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:57:59.109012 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:57:59.109012 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:57:59.109012 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:57:59.109012 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:57:59.110151 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:57:59.110151 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:57:59.110151 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:57:59.110151 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:57:59.110151 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:57:59.110151 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:57:59.110151 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:57:59.110151 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:57:59.110151 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:57:59.110151 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:57:59.110151 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:57:59.110151 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:57:59.110151 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:57:59.110151 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:57:59.110151 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:57:59.110151 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:57:59.111138 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:57:59.111138 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:57:59.111138 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:57:59.111138 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:57:59.111138 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:57:59.111138 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:57:59.111138 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:57:59.111138 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:57:59.111138 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:57:59.111138 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:57:59.111138 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 01:57:59.111138 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:57:59.111138 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 133/258] 10.222.0.49 () {56 vars in 1096 bytes} [Thu Sep 29 01:57:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:57:59.116347 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f2bf9e-c2b7-42c8-b697-f2105ff38c82 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:59.164604 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c255859-c37a-49c7-8213-0923ce086fc4 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:59.252019 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:59.280901 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c255859-c37a-49c7-8213-0923ce086fc4 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:59.291291 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f2bf9e-c2b7-42c8-b697-f2105ff38c82 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:59.319481 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79148fad-93ff-435b-adbe-573566b4ef40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:59.320650 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79148fad-93ff-435b-adbe-573566b4ef40 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:59.321124 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79148fad-93ff-435b-adbe-573566b4ef40 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:59.321612 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79148fad-93ff-435b-adbe-573566b4ef40 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:59.336073 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79148fad-93ff-435b-adbe-573566b4ef40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:57:59.342358 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-79148fad-93ff-435b-adbe-573566b4ef40 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 29 01:57:59.342358 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:57:59.342358 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:57:59.342358 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:57:59.342358 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:57:59.342358 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:57:59.342358 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:57:59.342358 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:57:59.342358 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:57:59.342358 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:57:59.342358 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:57:59.342358 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:57:59.342358 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:57:59.342358 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:57:59.342358 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:57:59.342358 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:57:59.343279 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:57:59.343279 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:57:59.343279 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:57:59.343279 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:57:59.343279 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:57:59.343279 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:57:59.343279 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:57:59.343279 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:57:59.343279 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:57:59.343279 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:57:59.343279 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:57:59.343279 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:57:59.343279 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:57:59.343279 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:57:59.343279 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:57:59.343279 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:57:59.344134 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:57:59.344134 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:57:59.344134 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:57:59.344134 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:57:59.344134 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:57:59.344134 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:57:59.344134 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:57:59.344134 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:57:59.344134 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:57:59.344134 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:57:59.344134 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 29 01:57:59.344134 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:57:59.347374 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 134/259] 10.222.0.49 () {56 vars in 1114 bytes} [Thu Sep 29 01:57:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 01:57:59.354413 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79148fad-93ff-435b-adbe-573566b4ef40 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:59.411441 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f27ab8-871f-4755-a6d0-a0ba2e96a523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:59.412224 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f27ab8-871f-4755-a6d0-a0ba2e96a523 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:59.412332 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f27ab8-871f-4755-a6d0-a0ba2e96a523 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:59.412592 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f27ab8-871f-4755-a6d0-a0ba2e96a523 None admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:59.413273 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f27ab8-871f-4755-a6d0-a0ba2e96a523 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:57:59.413595 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f27ab8-871f-4755-a6d0-a0ba2e96a523 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:59.415028 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f27ab8-871f-4755-a6d0-a0ba2e96a523 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:59.416588 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:59.443609 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 126/260] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Sep 29 01:57:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:59.448907 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f27ab8-871f-4755-a6d0-a0ba2e96a523 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:59.467720 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79148fad-93ff-435b-adbe-573566b4ef40 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:59.504742 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9164fc8a-b71c-4a80-bd13-a030e8f9bada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:59.505856 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9164fc8a-b71c-4a80-bd13-a030e8f9bada None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:59.506331 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9164fc8a-b71c-4a80-bd13-a030e8f9bada None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:59.506793 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9164fc8a-b71c-4a80-bd13-a030e8f9bada None admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:59.507645 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9164fc8a-b71c-4a80-bd13-a030e8f9bada None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:57:59.508154 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9164fc8a-b71c-4a80-bd13-a030e8f9bada None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:59.509748 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9164fc8a-b71c-4a80-bd13-a030e8f9bada None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:59.519523 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 135/261] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Sep 29 01:57:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:57:59.525570 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9164fc8a-b71c-4a80-bd13-a030e8f9bada None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:59.639812 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9164fc8a-b71c-4a80-bd13-a030e8f9bada None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:59.655153 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:59.678984 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9484045-5fde-441c-a344-a8996032a67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:59.680237 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9484045-5fde-441c-a344-a8996032a67d None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:59.680814 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9484045-5fde-441c-a344-a8996032a67d None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:59.681277 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9484045-5fde-441c-a344-a8996032a67d None admin] PATH_INFO: `/v3/users/f67ada6fef81410183cd5abb19dfd699` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:59.682665 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9484045-5fde-441c-a344-a8996032a67d None admin] RBAC: Authorizing `identity:get_user(user_id=f67ada6fef81410183cd5abb19dfd699)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:59.684314 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9484045-5fde-441c-a344-a8996032a67d None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:59.686131 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 136/262] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Sep 29 01:57:59 2022] GET /identity/v3/users/f67ada6fef81410183cd5abb19dfd699 => generated 283 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:59.693062 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9484045-5fde-441c-a344-a8996032a67d None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:59.735259 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f27ab8-871f-4755-a6d0-a0ba2e96a523 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:59.801612 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9484045-5fde-441c-a344-a8996032a67d None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:57:59.817754 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3d924f-e010-4df3-a303-01fa8c33c55f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:59.818401 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3d924f-e010-4df3-a303-01fa8c33c55f None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:59.818734 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3d924f-e010-4df3-a303-01fa8c33c55f None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:59.818945 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3d924f-e010-4df3-a303-01fa8c33c55f None admin] PATH_INFO: `/v3/users/f67ada6fef81410183cd5abb19dfd699` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:59.826020 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3d924f-e010-4df3-a303-01fa8c33c55f None admin] RBAC: Authorizing `identity:get_user(user_id=f67ada6fef81410183cd5abb19dfd699)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:59.827478 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3d924f-e010-4df3-a303-01fa8c33c55f None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:57:59.829471 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 127/263] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Sep 29 01:57:59 2022] GET /identity/v3/users/f67ada6fef81410183cd5abb19dfd699 => generated 283 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:57:59.835113 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3d924f-e010-4df3-a303-01fa8c33c55f None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:57:59.839124 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fe0ab8-318e-422a-bf68-9c94dcbca4da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:57:59.839986 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe0ab8-318e-422a-bf68-9c94dcbca4da None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:57:59.840472 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe0ab8-318e-422a-bf68-9c94dcbca4da None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:57:59.841009 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe0ab8-318e-422a-bf68-9c94dcbca4da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:57:59.877906 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:59.893705 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:57:59.918475 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fe0ab8-318e-422a-bf68-9c94dcbca4da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:57:59.920316 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fe0ab8-318e-422a-bf68-9c94dcbca4da None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:00.017239 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3d924f-e010-4df3-a303-01fa8c33c55f None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:00.036005 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 137/264] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Sep 29 01:57:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 29 01:58:00.041926 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fe0ab8-318e-422a-bf68-9c94dcbca4da None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:00.076195 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deca94ed-ba1e-4d14-9eb0-9f9cf7293db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:00.076804 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca94ed-ba1e-4d14-9eb0-9f9cf7293db0 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:00.077094 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca94ed-ba1e-4d14-9eb0-9f9cf7293db0 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:00.077404 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca94ed-ba1e-4d14-9eb0-9f9cf7293db0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:00.132057 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:00.154249 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fe0ab8-318e-422a-bf68-9c94dcbca4da None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:00.191073 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf6aa51-4ebc-4e33-b6e0-1791729477ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:00.192040 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf6aa51-4ebc-4e33-b6e0-1791729477ec None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:00.192519 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf6aa51-4ebc-4e33-b6e0-1791729477ec None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:00.193129 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf6aa51-4ebc-4e33-b6e0-1791729477ec None admin] PATH_INFO: `/v3/projects/7ed8ec70d1f649c6b36156f0f44f2271` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:00.194524 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf6aa51-4ebc-4e33-b6e0-1791729477ec None admin] RBAC: Authorizing `identity:get_project(project_id=7ed8ec70d1f649c6b36156f0f44f2271)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:00.196287 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf6aa51-4ebc-4e33-b6e0-1791729477ec None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:00.198432 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 138/265] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Sep 29 01:58:00 2022] GET /identity/v3/projects/7ed8ec70d1f649c6b36156f0f44f2271 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:58:00.204413 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf6aa51-4ebc-4e33-b6e0-1791729477ec None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:00.214492 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deca94ed-ba1e-4d14-9eb0-9f9cf7293db0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:00.216328 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deca94ed-ba1e-4d14-9eb0-9f9cf7293db0 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:00.251598 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:00.313984 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf6aa51-4ebc-4e33-b6e0-1791729477ec None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:00.351121 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce19939f-bcf2-4909-b880-49c2b47d2d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:00.352107 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce19939f-bcf2-4909-b880-49c2b47d2d26 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:00.352580 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce19939f-bcf2-4909-b880-49c2b47d2d26 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:00.353066 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce19939f-bcf2-4909-b880-49c2b47d2d26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:00.354046 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce19939f-bcf2-4909-b880-49c2b47d2d26 None admin] RBAC: Adding query filter params (role.id=8de931d79c9d4c8daf717aaea348dda9, scope.project.id=7ed8ec70d1f649c6b36156f0f44f2271, user.id=f67ada6fef81410183cd5abb19dfd699) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:00.354654 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce19939f-bcf2-4909-b880-49c2b47d2d26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:00.356281 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce19939f-bcf2-4909-b880-49c2b47d2d26 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:00.362888 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 139/266] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Sep 29 01:58:00 2022] GET /identity/v3/role_assignments?user.id=f67ada6fef81410183cd5abb19dfd699&scope.project.id=7ed8ec70d1f649c6b36156f0f44f2271&role.id=8de931d79c9d4c8daf717aaea348dda9 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:58:00.387902 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 128/267] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Sep 29 01:57:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 29 01:58:00.393929 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce19939f-bcf2-4909-b880-49c2b47d2d26 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:00.417529 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:00.523919 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce19939f-bcf2-4909-b880-49c2b47d2d26 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:00.575585 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96f38df-64fd-47b6-baf3-222f1a63b74a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:00.576147 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96f38df-64fd-47b6-baf3-222f1a63b74a None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:00.576423 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96f38df-64fd-47b6-baf3-222f1a63b74a None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:00.576691 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96f38df-64fd-47b6-baf3-222f1a63b74a None admin] PATH_INFO: `/v3/projects/7ed8ec70d1f649c6b36156f0f44f2271` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:00.582100 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96f38df-64fd-47b6-baf3-222f1a63b74a None admin] RBAC: Authorizing `identity:get_project(project_id=7ed8ec70d1f649c6b36156f0f44f2271)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:00.583587 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96f38df-64fd-47b6-baf3-222f1a63b74a None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:00.585300 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 140/268] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Sep 29 01:58:00 2022] GET /identity/v3/projects/7ed8ec70d1f649c6b36156f0f44f2271 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:00.591629 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deca94ed-ba1e-4d14-9eb0-9f9cf7293db0 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:00.733901 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deca94ed-ba1e-4d14-9eb0-9f9cf7293db0 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:00.757512 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:00.775602 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebabb5b-1b52-46c9-a532-c4db420ba000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:00.776221 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebabb5b-1b52-46c9-a532-c4db420ba000 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:00.776502 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebabb5b-1b52-46c9-a532-c4db420ba000 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:00.776776 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebabb5b-1b52-46c9-a532-c4db420ba000 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:00.777534 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebabb5b-1b52-46c9-a532-c4db420ba000 None admin] RBAC: Adding query filter params (role.id=fe9bbc67742f4f5893f39b18eb31d59a, scope.project.id=7ed8ec70d1f649c6b36156f0f44f2271, user.id=f67ada6fef81410183cd5abb19dfd699) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:00.777845 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebabb5b-1b52-46c9-a532-c4db420ba000 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:00.779291 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebabb5b-1b52-46c9-a532-c4db420ba000 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:00.785979 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 129/269] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Sep 29 01:58:00 2022] GET /identity/v3/role_assignments?user.id=f67ada6fef81410183cd5abb19dfd699&scope.project.id=7ed8ec70d1f649c6b36156f0f44f2271&role.id=fe9bbc67742f4f5893f39b18eb31d59a => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:01.084467 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a51b3-1d9a-4ae2-8fe6-308a5f0943ed None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:01.084845 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a51b3-1d9a-4ae2-8fe6-308a5f0943ed None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:01.085032 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a51b3-1d9a-4ae2-8fe6-308a5f0943ed None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:01.086591 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 141/270] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:58:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:58:01.092426 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a3338-d560-488b-8efe-ed130b080b7b None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:01.092707 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a3338-d560-488b-8efe-ed130b080b7b None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:01.092982 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a3338-d560-488b-8efe-ed130b080b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:01.112480 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-425a3338-d560-488b-8efe-ed130b080b7b None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:01.114067 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-425a3338-d560-488b-8efe-ed130b080b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:01.193564 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d0dfe6-de96-43c5-9cd7-b57fdb35eb1b None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:01.193855 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d0dfe6-de96-43c5-9cd7-b57fdb35eb1b None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:01.194048 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d0dfe6-de96-43c5-9cd7-b57fdb35eb1b None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:01.195706 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 142/271] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:58:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:58:01.200836 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708847b2-34bc-4465-b9ed-aac0ce5588f3 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:01.200971 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 130/272] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 29 01:58:01.201146 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708847b2-34bc-4465-b9ed-aac0ce5588f3 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:01.201432 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708847b2-34bc-4465-b9ed-aac0ce5588f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:01.221231 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-708847b2-34bc-4465-b9ed-aac0ce5588f3 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:01.222488 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-708847b2-34bc-4465-b9ed-aac0ce5588f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:01.297692 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 143/273] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 29 01:58:01.512007 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425a3338-d560-488b-8efe-ed130b080b7b None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:01.580247 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708847b2-34bc-4465-b9ed-aac0ce5588f3 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:01.592880 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:01.622301 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425a3338-d560-488b-8efe-ed130b080b7b None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:01.640192 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:01.663228 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4df8e0e-195f-4057-8eae-e866b3b81d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:01.663871 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df8e0e-195f-4057-8eae-e866b3b81d08 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:01.664148 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df8e0e-195f-4057-8eae-e866b3b81d08 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:01.664419 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df8e0e-195f-4057-8eae-e866b3b81d08 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:01.675913 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4df8e0e-195f-4057-8eae-e866b3b81d08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:58:01.681362 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-f4df8e0e-195f-4057-8eae-e866b3b81d08 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 29 01:58:01.681362 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:01.681362 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:01.681362 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:01.681362 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:01.681362 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:01.681362 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:01.681362 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:01.681362 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:01.681362 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:01.681362 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:01.681362 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:01.681362 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:58:01.681362 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:58:01.681362 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:58:01.681362 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:58:01.682224 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:58:01.682224 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:58:01.682224 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:58:01.682224 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:58:01.682224 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:01.682224 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:01.682224 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:01.682224 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:01.682224 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:01.682224 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:01.682224 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:01.682224 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:01.682224 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:01.682224 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:01.682224 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:01.682224 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:01.682988 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:01.682988 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:01.682988 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:01.682988 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:01.682988 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:58:01.682988 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:58:01.682988 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:58:01.682988 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:58:01.682988 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:58:01.682988 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:58:01.682988 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 29 01:58:01.682988 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:58:01.682988 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 131/274] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Sep 29 01:58:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:01.690359 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4df8e0e-195f-4057-8eae-e866b3b81d08 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:01.701192 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708847b2-34bc-4465-b9ed-aac0ce5588f3 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:01.744193 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c072749-1ac8-4607-bff0-f6c052cff2cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:01.744830 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c072749-1ac8-4607-bff0-f6c052cff2cc None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:01.745107 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c072749-1ac8-4607-bff0-f6c052cff2cc None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:01.745409 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c072749-1ac8-4607-bff0-f6c052cff2cc None admin] PATH_INFO: `/v3/domains/default` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:01.746542 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c072749-1ac8-4607-bff0-f6c052cff2cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:01.748046 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c072749-1ac8-4607-bff0-f6c052cff2cc None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:01.749926 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 144/275] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 01:58:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:58:01.754955 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c072749-1ac8-4607-bff0-f6c052cff2cc None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:01.824375 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4df8e0e-195f-4057-8eae-e866b3b81d08 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:01.836144 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:01.860535 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c072749-1ac8-4607-bff0-f6c052cff2cc None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:01.861643 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e1e798-a7d3-4b17-89d7-a69bd5e1444c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:01.862407 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e1e798-a7d3-4b17-89d7-a69bd5e1444c None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:01.862750 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e1e798-a7d3-4b17-89d7-a69bd5e1444c None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:01.863667 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e1e798-a7d3-4b17-89d7-a69bd5e1444c None admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:01.863667 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e1e798-a7d3-4b17-89d7-a69bd5e1444c None admin] RBAC: Adding query filter params (name=member) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:01.863964 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e1e798-a7d3-4b17-89d7-a69bd5e1444c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:01.865396 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e1e798-a7d3-4b17-89d7-a69bd5e1444c None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:01.874205 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 132/276] 10.222.0.49 () {56 vars in 1101 bytes} [Thu Sep 29 01:58:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:01.879333 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4203869e-9b61-4c87-8063-41c7880de8e7 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:01.879620 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4203869e-9b61-4c87-8063-41c7880de8e7 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:01.879893 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4203869e-9b61-4c87-8063-41c7880de8e7 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:01.881717 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 133/277] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:58:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:58:01.886183 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4203869e-9b61-4c87-8063-41c7880de8e7 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:01.902462 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d95e632-5380-407c-aa0e-3dab808ad5ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:01.902462 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d95e632-5380-407c-aa0e-3dab808ad5ae None admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:01.902462 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d95e632-5380-407c-aa0e-3dab808ad5ae None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:01.902462 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d95e632-5380-407c-aa0e-3dab808ad5ae None admin] PATH_INFO: `/v3/users` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:01.902840 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d95e632-5380-407c-aa0e-3dab808ad5ae None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:01.903366 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d95e632-5380-407c-aa0e-3dab808ad5ae None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:01.927599 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:01.931205 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 145/278] 10.222.0.49 () {60 vars in 1132 bytes} [Thu Sep 29 01:58:01 2022] POST /identity/v3/users => generated 293 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 29 01:58:01.932615 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ed3ca-3dc3-4b55-9048-3733fabc401c None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:01.932904 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ed3ca-3dc3-4b55-9048-3733fabc401c None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:01.933182 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ed3ca-3dc3-4b55-9048-3733fabc401c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:01.963831 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-5f9ed3ca-3dc3-4b55-9048-3733fabc401c None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:01.965999 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-5f9ed3ca-3dc3-4b55-9048-3733fabc401c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:02.028445 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4203869e-9b61-4c87-8063-41c7880de8e7 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:02.058783 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 146/279] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:58:02.061135 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c42284-5542-475f-82e9-99259b1706a2 None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:02.061668 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c42284-5542-475f-82e9-99259b1706a2 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:02.062311 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c42284-5542-475f-82e9-99259b1706a2 None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:02.065917 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 147/280] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:58:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:58:02.073363 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e267a181-fcc0-4bfb-9257-96eae60cd27f None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:02.073363 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e267a181-fcc0-4bfb-9257-96eae60cd27f None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:02.073363 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e267a181-fcc0-4bfb-9257-96eae60cd27f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:02.079222 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d72f9e7-e144-4a6b-8d9f-2557326ed03b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:02.080178 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72f9e7-e144-4a6b-8d9f-2557326ed03b None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:02.080666 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72f9e7-e144-4a6b-8d9f-2557326ed03b None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:02.081152 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72f9e7-e144-4a6b-8d9f-2557326ed03b None admin] PATH_INFO: `/v3/users/2a7cf76aeb0a4fa8b02db0f8bcc3450a` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:02.093897 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-e267a181-fcc0-4bfb-9257-96eae60cd27f None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:02.095121 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-e267a181-fcc0-4bfb-9257-96eae60cd27f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:02.097258 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d72f9e7-e144-4a6b-8d9f-2557326ed03b None admin] RBAC: Authorizing `identity:get_user(user_id=2a7cf76aeb0a4fa8b02db0f8bcc3450a)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:02.099127 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d72f9e7-e144-4a6b-8d9f-2557326ed03b None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:02.101596 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 134/281] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Sep 29 01:58:01 2022] GET /identity/v3/users/2a7cf76aeb0a4fa8b02db0f8bcc3450a => generated 293 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:02.107565 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d72f9e7-e144-4a6b-8d9f-2557326ed03b None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:02.170342 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:02.186497 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 148/282] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 29 01:58:02.225393 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:02.233101 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d72f9e7-e144-4a6b-8d9f-2557326ed03b None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:02.269937 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd85a74-370b-4d20-8fa2-1661cacbc1c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:02.270588 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd85a74-370b-4d20-8fa2-1661cacbc1c6 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:02.270867 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd85a74-370b-4d20-8fa2-1661cacbc1c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:02.271155 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd85a74-370b-4d20-8fa2-1661cacbc1c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:02.271907 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd85a74-370b-4d20-8fa2-1661cacbc1c6 None admin] RBAC: Adding query filter params (role.id=f157f905c9c94ccfbfb46e52d443e8f2, user.id=2a7cf76aeb0a4fa8b02db0f8bcc3450a, scope.system=all) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:02.272158 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd85a74-370b-4d20-8fa2-1661cacbc1c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:02.273618 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd85a74-370b-4d20-8fa2-1661cacbc1c6 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:02.279158 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 135/283] 10.222.0.49 () {56 vars in 1308 bytes} [Thu Sep 29 01:58:02 2022] GET /identity/v3/role_assignments?user.id=2a7cf76aeb0a4fa8b02db0f8bcc3450a&scope.system=all&role.id=f157f905c9c94ccfbfb46e52d443e8f2 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:58:02.369913 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e267a181-fcc0-4bfb-9257-96eae60cd27f None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:02.467642 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd85a74-370b-4d20-8fa2-1661cacbc1c6 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:02.486301 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e267a181-fcc0-4bfb-9257-96eae60cd27f None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:02.526367 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664b5bfa-5a43-44a4-92eb-31c5a5311c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:02.527538 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b5bfa-5a43-44a4-92eb-31c5a5311c6d None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:02.528019 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b5bfa-5a43-44a4-92eb-31c5a5311c6d None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:02.528490 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b5bfa-5a43-44a4-92eb-31c5a5311c6d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:02.548418 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664b5bfa-5a43-44a4-92eb-31c5a5311c6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:58:02.561430 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-664b5bfa-5a43-44a4-92eb-31c5a5311c6d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 29 01:58:02.561430 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:02.561430 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:02.561430 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:02.561430 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:02.561430 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:02.561430 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:02.561430 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:02.561430 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:02.561430 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:02.561430 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:02.561430 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:02.561430 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:58:02.561430 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:58:02.561430 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:58:02.561430 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:58:02.562335 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:58:02.562335 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:58:02.562335 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:58:02.562335 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:58:02.562335 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:02.562335 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:02.562335 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:02.562335 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:02.562335 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:02.562335 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:02.562335 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:02.562335 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:02.562335 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:02.562335 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:02.562335 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:02.562335 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:02.563117 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:02.563117 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:02.563117 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:02.563117 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:02.563117 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:58:02.563117 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:58:02.563117 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:58:02.563117 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:58:02.563117 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:58:02.563117 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:58:02.563117 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 29 01:58:02.563117 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:58:02.563117 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 149/284] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Sep 29 01:58:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:02.586020 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664b5bfa-5a43-44a4-92eb-31c5a5311c6d None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:02.614308 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd85a74-370b-4d20-8fa2-1661cacbc1c6 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:02.681862 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:02.683863 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4254ccde-0e4f-4f3f-ae2a-80dfc634ffa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:02.684532 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4254ccde-0e4f-4f3f-ae2a-80dfc634ffa0 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:02.684807 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4254ccde-0e4f-4f3f-ae2a-80dfc634ffa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:02.685071 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4254ccde-0e4f-4f3f-ae2a-80dfc634ffa0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:02.708197 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4254ccde-0e4f-4f3f-ae2a-80dfc634ffa0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:58:02.712693 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-4254ccde-0e4f-4f3f-ae2a-80dfc634ffa0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 29 01:58:02.712693 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:02.712693 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:02.712693 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:02.712693 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:02.712693 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:02.712693 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:02.712693 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:02.712693 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:02.712693 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:02.712693 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:02.712693 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:02.712693 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:58:02.712693 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:58:02.712693 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:58:02.712693 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:58:02.713638 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:58:02.713638 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:58:02.713638 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:58:02.713638 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:58:02.713638 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:02.713638 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:02.713638 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:02.713638 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:02.713638 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:02.713638 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:02.713638 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:02.713638 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:02.713638 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:02.713638 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:02.713638 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:02.713638 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:02.714403 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:02.714403 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:02.714403 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:02.714403 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:02.714403 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:58:02.714403 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:58:02.714403 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:58:02.714403 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:58:02.714403 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:58:02.714403 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:58:02.714403 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 29 01:58:02.714403 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:58:02.714403 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 136/285] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Sep 29 01:58:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:02.719720 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4254ccde-0e4f-4f3f-ae2a-80dfc634ffa0 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:02.735759 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664b5bfa-5a43-44a4-92eb-31c5a5311c6d None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:02.756310 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:02.786301 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f0e280-08d4-44f7-a757-010b502e82df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:02.787324 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f0e280-08d4-44f7-a757-010b502e82df None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:02.787808 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f0e280-08d4-44f7-a757-010b502e82df None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:02.788329 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f0e280-08d4-44f7-a757-010b502e82df None admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:02.789197 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f0e280-08d4-44f7-a757-010b502e82df None admin] RBAC: Adding query filter params (name=reader) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:02.789787 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f0e280-08d4-44f7-a757-010b502e82df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:02.791362 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f0e280-08d4-44f7-a757-010b502e82df None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:02.811783 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 150/286] 10.222.0.49 () {56 vars in 1101 bytes} [Thu Sep 29 01:58:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:58:02.818691 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f0e280-08d4-44f7-a757-010b502e82df None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:02.902803 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4254ccde-0e4f-4f3f-ae2a-80dfc634ffa0 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:02.974118 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24a57ca-8319-427c-bb1f-7d90aad662ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:02.974968 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a57ca-8319-427c-bb1f-7d90aad662ac None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:02.975404 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a57ca-8319-427c-bb1f-7d90aad662ac None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:02.975810 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a57ca-8319-427c-bb1f-7d90aad662ac None admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:02.976605 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24a57ca-8319-427c-bb1f-7d90aad662ac None admin] RBAC: Adding query filter params (name=member) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:02.977029 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24a57ca-8319-427c-bb1f-7d90aad662ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:02.978593 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24a57ca-8319-427c-bb1f-7d90aad662ac None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:02.982106 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f0e280-08d4-44f7-a757-010b502e82df None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:02.992407 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 137/287] 10.222.0.49 () {56 vars in 1101 bytes} [Thu Sep 29 01:58:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:58:02.997958 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24a57ca-8319-427c-bb1f-7d90aad662ac None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:03.000253 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:03.025342 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b5d29e-1c13-4b13-a3d2-2a2524ae319f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:03.025342 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b5d29e-1c13-4b13-a3d2-2a2524ae319f None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:03.025342 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b5d29e-1c13-4b13-a3d2-2a2524ae319f None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:03.025342 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b5d29e-1c13-4b13-a3d2-2a2524ae319f None admin] PATH_INFO: `/v3/users/1a1cd34b69ec4930b0d67d7fff35ff6c` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:03.025806 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b5d29e-1c13-4b13-a3d2-2a2524ae319f None admin] RBAC: Authorizing `identity:get_user(user_id=1a1cd34b69ec4930b0d67d7fff35ff6c)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:03.025806 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b5d29e-1c13-4b13-a3d2-2a2524ae319f None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:03.027494 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 151/288] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Sep 29 01:58:02 2022] GET /identity/v3/users/1a1cd34b69ec4930b0d67d7fff35ff6c => generated 297 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:58:03.033356 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b5d29e-1c13-4b13-a3d2-2a2524ae319f None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:03.168341 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:03.173132 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b5d29e-1c13-4b13-a3d2-2a2524ae319f None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:03.203599 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24a57ca-8319-427c-bb1f-7d90aad662ac None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:03.212915 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d66f39-0a4d-4058-9ecd-d2b219737344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:03.213643 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d66f39-0a4d-4058-9ecd-d2b219737344 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:03.213926 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d66f39-0a4d-4058-9ecd-d2b219737344 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:03.214198 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d66f39-0a4d-4058-9ecd-d2b219737344 None admin] PATH_INFO: `/v3/projects/7ed8ec70d1f649c6b36156f0f44f2271` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:03.215323 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d66f39-0a4d-4058-9ecd-d2b219737344 None admin] RBAC: Authorizing `identity:get_project(project_id=7ed8ec70d1f649c6b36156f0f44f2271)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:03.216768 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d66f39-0a4d-4058-9ecd-d2b219737344 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:03.223424 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 152/289] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Sep 29 01:58:03 2022] GET /identity/v3/projects/7ed8ec70d1f649c6b36156f0f44f2271 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:03.224796 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d66f39-0a4d-4058-9ecd-d2b219737344 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:03.281448 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:03.306022 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747c76b1-b41a-4ae6-83b1-b437f6d9802d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:03.307006 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747c76b1-b41a-4ae6-83b1-b437f6d9802d None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:03.307513 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747c76b1-b41a-4ae6-83b1-b437f6d9802d None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:03.307976 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747c76b1-b41a-4ae6-83b1-b437f6d9802d None admin] PATH_INFO: `/v3/users/15e3778307b843d58786b636cd69198a` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:03.309411 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747c76b1-b41a-4ae6-83b1-b437f6d9802d None admin] RBAC: Authorizing `identity:get_user(user_id=15e3778307b843d58786b636cd69198a)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:03.311064 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747c76b1-b41a-4ae6-83b1-b437f6d9802d None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:03.312953 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 138/290] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Sep 29 01:58:02 2022] GET /identity/v3/users/15e3778307b843d58786b636cd69198a => generated 297 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:58:03.319183 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747c76b1-b41a-4ae6-83b1-b437f6d9802d None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:03.345411 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d66f39-0a4d-4058-9ecd-d2b219737344 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:03.416145 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa36d59-3769-443a-b3a2-1297d922a623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:03.417935 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa36d59-3769-443a-b3a2-1297d922a623 None admin] REQUEST_METHOD: `PUT` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:03.418213 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa36d59-3769-443a-b3a2-1297d922a623 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:03.418488 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa36d59-3769-443a-b3a2-1297d922a623 None admin] PATH_INFO: `/v3/projects/7ed8ec70d1f649c6b36156f0f44f2271/users/1a1cd34b69ec4930b0d67d7fff35ff6c/roles/63a7737d5e4b42ccbfdd40451c4a1c77` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:03.421710 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa36d59-3769-443a-b3a2-1297d922a623 None admin] RBAC: Authorizing `identity:create_grant(project_id=7ed8ec70d1f649c6b36156f0f44f2271, user_id=1a1cd34b69ec4930b0d67d7fff35ff6c, role_id=63a7737d5e4b42ccbfdd40451c4a1c77)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:03.423202 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa36d59-3769-443a-b3a2-1297d922a623 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:03.450564 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 153/291] 10.222.0.49 () {58 vars in 1439 bytes} [Thu Sep 29 01:58:03 2022] PUT /identity/v3/projects/7ed8ec70d1f649c6b36156f0f44f2271/users/1a1cd34b69ec4930b0d67d7fff35ff6c/roles/63a7737d5e4b42ccbfdd40451c4a1c77 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 01:58:03.498678 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747c76b1-b41a-4ae6-83b1-b437f6d9802d None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:03.551622 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ab01b4-3c02-4d06-a72a-0c5a20967e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:03.552262 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ab01b4-3c02-4d06-a72a-0c5a20967e58 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:03.552546 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ab01b4-3c02-4d06-a72a-0c5a20967e58 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:03.552820 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ab01b4-3c02-4d06-a72a-0c5a20967e58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:03.577752 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:03.636286 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ab01b4-3c02-4d06-a72a-0c5a20967e58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:03.637918 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ab01b4-3c02-4d06-a72a-0c5a20967e58 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:03.759540 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 139/292] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Sep 29 01:58:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 29 01:58:03.764649 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa36d59-3769-443a-b3a2-1297d922a623 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:03.875743 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa36d59-3769-443a-b3a2-1297d922a623 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:03.895748 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:03.923824 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93b52a9-61ef-4ae8-bc25-b7a2dedfe3c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:03.924564 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b52a9-61ef-4ae8-bc25-b7a2dedfe3c6 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:03.924842 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b52a9-61ef-4ae8-bc25-b7a2dedfe3c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:03.925112 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b52a9-61ef-4ae8-bc25-b7a2dedfe3c6 None admin] PATH_INFO: `/v3/projects/7ed8ec70d1f649c6b36156f0f44f2271` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:03.926315 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93b52a9-61ef-4ae8-bc25-b7a2dedfe3c6 None admin] RBAC: Authorizing `identity:get_project(project_id=7ed8ec70d1f649c6b36156f0f44f2271)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:03.927754 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93b52a9-61ef-4ae8-bc25-b7a2dedfe3c6 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:03.929379 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 154/293] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Sep 29 01:58:03 2022] GET /identity/v3/projects/7ed8ec70d1f649c6b36156f0f44f2271 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:58:03.935292 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ab01b4-3c02-4d06-a72a-0c5a20967e58 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:03.985102 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:04.039203 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ab01b4-3c02-4d06-a72a-0c5a20967e58 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:04.088783 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbfca4b-1d2a-431e-b2c3-9e12b424c215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:04.089411 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbfca4b-1d2a-431e-b2c3-9e12b424c215 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:04.089695 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbfca4b-1d2a-431e-b2c3-9e12b424c215 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:04.089970 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbfca4b-1d2a-431e-b2c3-9e12b424c215 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:04.090694 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbfca4b-1d2a-431e-b2c3-9e12b424c215 None admin] RBAC: Adding query filter params (role.id=f157f905c9c94ccfbfb46e52d443e8f2, scope.project.id=7ed8ec70d1f649c6b36156f0f44f2271, user.id=15e3778307b843d58786b636cd69198a) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:04.090999 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbfca4b-1d2a-431e-b2c3-9e12b424c215 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:04.092433 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbfca4b-1d2a-431e-b2c3-9e12b424c215 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:04.099144 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 140/294] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Sep 29 01:58:03 2022] GET /identity/v3/role_assignments?user.id=15e3778307b843d58786b636cd69198a&scope.project.id=7ed8ec70d1f649c6b36156f0f44f2271&role.id=f157f905c9c94ccfbfb46e52d443e8f2 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:04.720613 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee5c626-77b2-4cb0-be10-c4838758846c None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:04.721082 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee5c626-77b2-4cb0-be10-c4838758846c None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:04.721386 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee5c626-77b2-4cb0-be10-c4838758846c None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:04.722793 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 155/295] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:58:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:58:04.728888 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff81a8d-8ae3-4d70-ba01-68183ea159e0 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:04.729357 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff81a8d-8ae3-4d70-ba01-68183ea159e0 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:04.729557 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff81a8d-8ae3-4d70-ba01-68183ea159e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:04.752176 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-8ff81a8d-8ae3-4d70-ba01-68183ea159e0 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:04.753857 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-8ff81a8d-8ae3-4d70-ba01-68183ea159e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:04.842174 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 141/296] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:58:04.887946 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84055055-4095-4fee-8bf6-864c154f31b4 None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:04.888898 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84055055-4095-4fee-8bf6-864c154f31b4 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:04.889407 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84055055-4095-4fee-8bf6-864c154f31b4 None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:04.890928 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 156/297] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:58:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:58:04.896471 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17408525-e05e-4afd-8f2e-6e258b51c670 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:04.896993 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17408525-e05e-4afd-8f2e-6e258b51c670 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:04.897511 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17408525-e05e-4afd-8f2e-6e258b51c670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:04.918667 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-17408525-e05e-4afd-8f2e-6e258b51c670 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:04.919914 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-17408525-e05e-4afd-8f2e-6e258b51c670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:04.964153 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:04.997599 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 142/298] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:58:05.044390 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cc61b0-482c-4cf5-81c9-0f7f53198ce0 None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:05.044698 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cc61b0-482c-4cf5-81c9-0f7f53198ce0 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:05.044939 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cc61b0-482c-4cf5-81c9-0f7f53198ce0 None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:05.046628 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 157/299] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:58:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:58:05.052024 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c2ec39-c86d-4e3a-bc89-1bade5b86ae6 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:05.052313 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c2ec39-c86d-4e3a-bc89-1bade5b86ae6 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:05.052590 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c2ec39-c86d-4e3a-bc89-1bade5b86ae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:05.071800 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-f2c2ec39-c86d-4e3a-bc89-1bade5b86ae6 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:05.072990 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-f2c2ec39-c86d-4e3a-bc89-1bade5b86ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:05.133099 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cc61b0-482c-4cf5-81c9-0f7f53198ce0 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:05.147602 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 143/300] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:58:05.243765 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cc61b0-482c-4cf5-81c9-0f7f53198ce0 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:05.280024 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f742b18-4b32-4c63-9723-2c0bc629b32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:05.280590 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f742b18-4b32-4c63-9723-2c0bc629b32f None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:05.280929 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f742b18-4b32-4c63-9723-2c0bc629b32f None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:05.281210 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f742b18-4b32-4c63-9723-2c0bc629b32f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:05.286698 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c2ec39-c86d-4e3a-bc89-1bade5b86ae6 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:05.293978 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f742b18-4b32-4c63-9723-2c0bc629b32f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:58:05.300953 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-7f742b18-4b32-4c63-9723-2c0bc629b32f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 29 01:58:05.300953 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:05.300953 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:05.300953 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:05.300953 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:05.300953 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:05.300953 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:05.300953 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:05.300953 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:05.300953 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:05.300953 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:05.300953 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:05.300953 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:58:05.300953 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:58:05.300953 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:58:05.300953 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:58:05.301870 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:58:05.301870 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:58:05.301870 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:58:05.301870 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:58:05.301870 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:05.301870 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:05.301870 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:05.301870 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:05.301870 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:05.301870 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:05.301870 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:05.301870 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:05.301870 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:05.301870 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:05.301870 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:05.301870 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:05.302620 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:05.302620 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:05.302620 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:05.302620 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:05.302620 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:58:05.302620 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:58:05.302620 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:58:05.302620 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:58:05.302620 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:58:05.302620 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:58:05.302620 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 29 01:58:05.302620 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:58:05.302620 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 158/301] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Sep 29 01:58:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 01:58:05.307818 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f742b18-4b32-4c63-9723-2c0bc629b32f None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:05.366379 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:05.405244 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c2ec39-c86d-4e3a-bc89-1bade5b86ae6 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:05.407507 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:05.444107 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f742b18-4b32-4c63-9723-2c0bc629b32f None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:05.446165 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fe1616-e004-499e-8271-083627b9e7e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:05.446809 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe1616-e004-499e-8271-083627b9e7e8 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:05.447085 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe1616-e004-499e-8271-083627b9e7e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:05.447525 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe1616-e004-499e-8271-083627b9e7e8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:05.458726 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fe1616-e004-499e-8271-083627b9e7e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:58:05.463821 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-71fe1616-e004-499e-8271-083627b9e7e8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 29 01:58:05.463821 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:05.463821 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:05.463821 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:05.463821 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:05.463821 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:05.463821 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:05.463821 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:05.463821 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:05.463821 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:05.463821 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:05.463821 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:05.463821 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:58:05.463821 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:58:05.463821 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:58:05.463821 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:58:05.464689 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:58:05.464689 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:58:05.464689 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:58:05.464689 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:58:05.464689 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:05.464689 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:05.464689 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:05.464689 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:05.464689 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:05.464689 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:05.464689 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:05.464689 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:05.464689 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:05.464689 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:05.464689 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:05.464689 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:05.465539 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:05.465539 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:05.465539 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:05.465539 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:05.465539 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:58:05.465539 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:58:05.465539 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:58:05.465539 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:58:05.465539 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:58:05.465539 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:58:05.465539 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 29 01:58:05.465539 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:58:05.465539 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 144/302] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Sep 29 01:58:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 01:58:05.466775 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fe1616-e004-499e-8271-083627b9e7e8 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:05.490346 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1c104e-9288-4f88-a8cd-5e4e3ef0f34e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:05.491560 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c104e-9288-4f88-a8cd-5e4e3ef0f34e None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:05.491841 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c104e-9288-4f88-a8cd-5e4e3ef0f34e None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:05.492105 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c104e-9288-4f88-a8cd-5e4e3ef0f34e None admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:05.492772 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1c104e-9288-4f88-a8cd-5e4e3ef0f34e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:05.493130 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1c104e-9288-4f88-a8cd-5e4e3ef0f34e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:05.494553 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1c104e-9288-4f88-a8cd-5e4e3ef0f34e None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:05.503790 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 159/303] 10.222.0.49 () {56 vars in 1101 bytes} [Thu Sep 29 01:58:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:58:05.504594 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1c104e-9288-4f88-a8cd-5e4e3ef0f34e None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:05.579684 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fe1616-e004-499e-8271-083627b9e7e8 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:05.615144 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59764d53-5a86-4678-8e48-c28dfb4d332d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:05.615459 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1c104e-9288-4f88-a8cd-5e4e3ef0f34e None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:05.615769 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59764d53-5a86-4678-8e48-c28dfb4d332d None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:05.616042 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59764d53-5a86-4678-8e48-c28dfb4d332d None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:05.616307 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59764d53-5a86-4678-8e48-c28dfb4d332d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:05.617437 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59764d53-5a86-4678-8e48-c28dfb4d332d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:05.617827 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:05.619373 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59764d53-5a86-4678-8e48-c28dfb4d332d None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:05.625680 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 145/304] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 01:58:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:05.625680 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59764d53-5a86-4678-8e48-c28dfb4d332d None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:05.653989 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:05.666034 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7032c1d-ec80-46d5-b48f-23896b061a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:05.666648 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7032c1d-ec80-46d5-b48f-23896b061a5b None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:05.666924 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7032c1d-ec80-46d5-b48f-23896b061a5b None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:05.667189 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7032c1d-ec80-46d5-b48f-23896b061a5b None admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:05.668106 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7032c1d-ec80-46d5-b48f-23896b061a5b None admin] RBAC: Adding query filter params (name=member) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:05.668406 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7032c1d-ec80-46d5-b48f-23896b061a5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:05.669828 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7032c1d-ec80-46d5-b48f-23896b061a5b None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:05.678414 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 160/305] 10.222.0.49 () {56 vars in 1101 bytes} [Thu Sep 29 01:58:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:05.683598 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7032c1d-ec80-46d5-b48f-23896b061a5b None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:05.729953 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59764d53-5a86-4678-8e48-c28dfb4d332d None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:05.774119 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aff75aa-6c03-4fcc-943a-e93ecda873a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:05.775185 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aff75aa-6c03-4fcc-943a-e93ecda873a5 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:05.775686 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aff75aa-6c03-4fcc-943a-e93ecda873a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:05.776150 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aff75aa-6c03-4fcc-943a-e93ecda873a5 None admin] PATH_INFO: `/v3/users/574c71c9846d4dba833bfd770c4b6573` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:05.792766 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aff75aa-6c03-4fcc-943a-e93ecda873a5 None admin] RBAC: Authorizing `identity:get_user(user_id=574c71c9846d4dba833bfd770c4b6573)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:05.794271 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aff75aa-6c03-4fcc-943a-e93ecda873a5 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:05.800871 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 146/306] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Sep 29 01:58:05 2022] GET /identity/v3/users/574c71c9846d4dba833bfd770c4b6573 => generated 293 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:05.800871 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aff75aa-6c03-4fcc-943a-e93ecda873a5 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:05.805647 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7032c1d-ec80-46d5-b48f-23896b061a5b None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:05.843694 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e2a932-77eb-431f-8c2b-2fe7536e1ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:05.844234 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e2a932-77eb-431f-8c2b-2fe7536e1ff3 None admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:05.844516 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e2a932-77eb-431f-8c2b-2fe7536e1ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:05.844792 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e2a932-77eb-431f-8c2b-2fe7536e1ff3 None admin] PATH_INFO: `/v3/groups` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:05.845447 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e2a932-77eb-431f-8c2b-2fe7536e1ff3 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:05.847168 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e2a932-77eb-431f-8c2b-2fe7536e1ff3 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:05.863782 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 161/307] 10.222.0.49 () {60 vars in 1134 bytes} [Thu Sep 29 01:58:05 2022] POST /identity/v3/groups => generated 229 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 01:58:05.864757 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e2a932-77eb-431f-8c2b-2fe7536e1ff3 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:05.912292 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:05.916253 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:05.930597 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aff75aa-6c03-4fcc-943a-e93ecda873a5 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:05.976043 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8751711-237b-409e-837b-f2497536733d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:05.977831 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8751711-237b-409e-837b-f2497536733d None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:05.978392 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8751711-237b-409e-837b-f2497536733d None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:05.978948 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8751711-237b-409e-837b-f2497536733d None admin] PATH_INFO: `/v3/users/2a7cf76aeb0a4fa8b02db0f8bcc3450a` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:05.981572 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8751711-237b-409e-837b-f2497536733d None admin] RBAC: Authorizing `identity:get_user(user_id=2a7cf76aeb0a4fa8b02db0f8bcc3450a)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:05.983811 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8751711-237b-409e-837b-f2497536733d None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:05.986311 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 147/308] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Sep 29 01:58:05 2022] GET /identity/v3/users/2a7cf76aeb0a4fa8b02db0f8bcc3450a => generated 293 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:05.992847 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8751711-237b-409e-837b-f2497536733d None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:06.016856 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e2a932-77eb-431f-8c2b-2fe7536e1ff3 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:06.060682 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a25c31a-e7f7-48a6-bfe2-ffaf8902188f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:06.061442 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a25c31a-e7f7-48a6-bfe2-ffaf8902188f None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:06.061723 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a25c31a-e7f7-48a6-bfe2-ffaf8902188f None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:06.062114 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a25c31a-e7f7-48a6-bfe2-ffaf8902188f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:06.062836 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a25c31a-e7f7-48a6-bfe2-ffaf8902188f None admin] RBAC: Adding query filter params (role.id=63a7737d5e4b42ccbfdd40451c4a1c77, user.id=574c71c9846d4dba833bfd770c4b6573, scope.system=all) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:06.063816 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a25c31a-e7f7-48a6-bfe2-ffaf8902188f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:06.065566 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a25c31a-e7f7-48a6-bfe2-ffaf8902188f None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:06.072610 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 162/309] 10.222.0.49 () {56 vars in 1308 bytes} [Thu Sep 29 01:58:05 2022] GET /identity/v3/role_assignments?user.id=574c71c9846d4dba833bfd770c4b6573&scope.system=all&role.id=63a7737d5e4b42ccbfdd40451c4a1c77 => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:06.073950 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7447d251-804a-481b-8e02-451cb4ef4db7 None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:06.075277 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7447d251-804a-481b-8e02-451cb4ef4db7 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:06.075277 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7447d251-804a-481b-8e02-451cb4ef4db7 None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:06.075716 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 163/310] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:58:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:58:06.088085 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a7631d-7c74-41f0-878c-7c46455386ed None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:06.088399 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a7631d-7c74-41f0-878c-7c46455386ed None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:06.088644 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a7631d-7c74-41f0-878c-7c46455386ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:06.112753 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-a2a7631d-7c74-41f0-878c-7c46455386ed None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:06.113955 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-a2a7631d-7c74-41f0-878c-7c46455386ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:06.122915 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8751711-237b-409e-837b-f2497536733d None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:06.164885 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8064e6ff-4169-46ea-a87d-d92406786c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:06.166315 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8064e6ff-4169-46ea-a87d-d92406786c13 None admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:06.166315 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8064e6ff-4169-46ea-a87d-d92406786c13 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:06.166315 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8064e6ff-4169-46ea-a87d-d92406786c13 None admin] PATH_INFO: `/v3/system/users/2a7cf76aeb0a4fa8b02db0f8bcc3450a/roles/f157f905c9c94ccfbfb46e52d443e8f2` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:06.167947 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8064e6ff-4169-46ea-a87d-d92406786c13 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=2a7cf76aeb0a4fa8b02db0f8bcc3450a, role_id=f157f905c9c94ccfbfb46e52d443e8f2)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:06.169403 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8064e6ff-4169-46ea-a87d-d92406786c13 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:06.182240 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 148/311] 10.222.0.49 () {58 vars in 1334 bytes} [Thu Sep 29 01:58:05 2022] PUT /identity/v3/system/users/2a7cf76aeb0a4fa8b02db0f8bcc3450a/roles/f157f905c9c94ccfbfb46e52d443e8f2 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 01:58:06.215852 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 164/312] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:58:06.490465 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8064e6ff-4169-46ea-a87d-d92406786c13 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:06.515091 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:06.608280 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8064e6ff-4169-46ea-a87d-d92406786c13 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:06.645100 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa90fac-c203-4092-a075-17d876205a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:06.645999 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa90fac-c203-4092-a075-17d876205a74 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:06.646477 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa90fac-c203-4092-a075-17d876205a74 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:06.646917 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa90fac-c203-4092-a075-17d876205a74 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:06.657873 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa90fac-c203-4092-a075-17d876205a74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:58:06.664660 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-2aa90fac-c203-4092-a075-17d876205a74 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 29 01:58:06.664660 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:06.664660 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:06.664660 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:06.664660 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:06.664660 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:06.664660 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:06.664660 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:06.664660 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:06.664660 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:06.664660 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:06.664660 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:06.664660 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:58:06.664660 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:58:06.664660 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:58:06.664660 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:58:06.665779 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:58:06.665779 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:58:06.665779 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:58:06.665779 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:58:06.665779 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:06.665779 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:06.665779 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:06.665779 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:06.665779 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:06.665779 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:06.665779 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:06.665779 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:06.665779 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:06.665779 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:06.665779 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:06.665779 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:06.666796 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:06.666796 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:06.666796 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:06.666796 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:06.666796 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:58:06.666796 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:58:06.666796 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:58:06.666796 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:58:06.666796 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:58:06.666796 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:58:06.666796 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 29 01:58:06.666796 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:58:06.669228 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 149/313] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Sep 29 01:58:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:06.675981 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a7631d-7c74-41f0-878c-7c46455386ed None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:06.701696 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:06.782464 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a7631d-7c74-41f0-878c-7c46455386ed None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:06.819653 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d57b9c-4607-4c20-957b-97c7bc431454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:06.820276 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d57b9c-4607-4c20-957b-97c7bc431454 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:06.820555 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d57b9c-4607-4c20-957b-97c7bc431454 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:06.820826 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d57b9c-4607-4c20-957b-97c7bc431454 None admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:06.821527 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d57b9c-4607-4c20-957b-97c7bc431454 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:06.821831 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d57b9c-4607-4c20-957b-97c7bc431454 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:06.823209 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d57b9c-4607-4c20-957b-97c7bc431454 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:06.836066 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 165/314] 10.222.0.49 () {56 vars in 1101 bytes} [Thu Sep 29 01:58:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:06.841834 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa90fac-c203-4092-a075-17d876205a74 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:06.942237 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:06.963605 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa90fac-c203-4092-a075-17d876205a74 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:07.001569 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c6db3e-37fd-45de-bc75-467e7616e689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:07.002787 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c6db3e-37fd-45de-bc75-467e7616e689 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:07.003266 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c6db3e-37fd-45de-bc75-467e7616e689 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:07.003732 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c6db3e-37fd-45de-bc75-467e7616e689 None admin] PATH_INFO: `/v3/users/1a1cd34b69ec4930b0d67d7fff35ff6c` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:07.005078 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c6db3e-37fd-45de-bc75-467e7616e689 None admin] RBAC: Authorizing `identity:get_user(user_id=1a1cd34b69ec4930b0d67d7fff35ff6c)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:07.007111 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c6db3e-37fd-45de-bc75-467e7616e689 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:07.008926 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 150/315] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Sep 29 01:58:06 2022] GET /identity/v3/users/1a1cd34b69ec4930b0d67d7fff35ff6c => generated 297 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:07.014976 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d57b9c-4607-4c20-957b-97c7bc431454 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:07.098616 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:07.119846 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d57b9c-4607-4c20-957b-97c7bc431454 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:07.156955 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070aeff9-d7b7-4eb8-9407-6ab75365fda1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:07.157860 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070aeff9-d7b7-4eb8-9407-6ab75365fda1 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:07.158808 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070aeff9-d7b7-4eb8-9407-6ab75365fda1 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:07.159220 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070aeff9-d7b7-4eb8-9407-6ab75365fda1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:07.228354 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070aeff9-d7b7-4eb8-9407-6ab75365fda1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:07.230074 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070aeff9-d7b7-4eb8-9407-6ab75365fda1 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:07.310690 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:07.330938 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 166/316] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Sep 29 01:58:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 29 01:58:07.336419 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c6db3e-37fd-45de-bc75-467e7616e689 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:07.442221 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c6db3e-37fd-45de-bc75-467e7616e689 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:07.476854 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73160b0b-941d-4170-b066-86931c880479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:07.477512 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73160b0b-941d-4170-b066-86931c880479 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:07.477792 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73160b0b-941d-4170-b066-86931c880479 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:07.478064 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73160b0b-941d-4170-b066-86931c880479 None admin] PATH_INFO: `/v3/projects/7ed8ec70d1f649c6b36156f0f44f2271` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:07.479193 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73160b0b-941d-4170-b066-86931c880479 None admin] RBAC: Authorizing `identity:get_project(project_id=7ed8ec70d1f649c6b36156f0f44f2271)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:07.480619 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73160b0b-941d-4170-b066-86931c880479 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:07.482440 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 151/317] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Sep 29 01:58:07 2022] GET /identity/v3/projects/7ed8ec70d1f649c6b36156f0f44f2271 => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:07.488218 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070aeff9-d7b7-4eb8-9407-6ab75365fda1 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:07.596497 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070aeff9-d7b7-4eb8-9407-6ab75365fda1 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:07.632144 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f37958-a7d6-412b-a9f1-1663d8b9b6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:07.632749 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f37958-a7d6-412b-a9f1-1663d8b9b6bb None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:07.633026 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f37958-a7d6-412b-a9f1-1663d8b9b6bb None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:07.633293 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f37958-a7d6-412b-a9f1-1663d8b9b6bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:07.634046 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f37958-a7d6-412b-a9f1-1663d8b9b6bb None admin] RBAC: Adding query filter params (role.id=63a7737d5e4b42ccbfdd40451c4a1c77, scope.project.id=7ed8ec70d1f649c6b36156f0f44f2271, user.id=1a1cd34b69ec4930b0d67d7fff35ff6c) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:07.634348 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f37958-a7d6-412b-a9f1-1663d8b9b6bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:07.635785 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f37958-a7d6-412b-a9f1-1663d8b9b6bb None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:07.642037 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 167/318] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Sep 29 01:58:07 2022] GET /identity/v3/role_assignments?user.id=1a1cd34b69ec4930b0d67d7fff35ff6c&scope.project.id=7ed8ec70d1f649c6b36156f0f44f2271&role.id=63a7737d5e4b42ccbfdd40451c4a1c77 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:08.210837 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6fd16b-3e93-4bff-8767-b4bc30d7fbf4 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:08.211360 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6fd16b-3e93-4bff-8767-b4bc30d7fbf4 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:08.211360 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6fd16b-3e93-4bff-8767-b4bc30d7fbf4 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:08.212875 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 152/319] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:58:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:58:08.218748 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7694b4-aef9-46aa-a0df-b9c3eca44d2c None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:08.219251 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7694b4-aef9-46aa-a0df-b9c3eca44d2c None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:08.219324 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7694b4-aef9-46aa-a0df-b9c3eca44d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:08.239090 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-bd7694b4-aef9-46aa-a0df-b9c3eca44d2c None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:08.240306 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-bd7694b4-aef9-46aa-a0df-b9c3eca44d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:08.283284 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:08.312142 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 168/320] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:58:08.326730 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e015a6-84e1-4db0-a38b-d034a551ad6d None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:08.327007 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e015a6-84e1-4db0-a38b-d034a551ad6d None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:08.327283 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e015a6-84e1-4db0-a38b-d034a551ad6d None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:08.328731 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 153/321] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:58:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:58:08.334881 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe80dce6-6eac-4d91-87db-d655981cba6d None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:08.335166 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe80dce6-6eac-4d91-87db-d655981cba6d None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:08.335442 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe80dce6-6eac-4d91-87db-d655981cba6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:08.355836 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-fe80dce6-6eac-4d91-87db-d655981cba6d None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:08.357072 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-fe80dce6-6eac-4d91-87db-d655981cba6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:08.426034 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 169/322] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:58:08.460527 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031dc964-b90c-4341-86b1-def6a472009a None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:08.460798 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031dc964-b90c-4341-86b1-def6a472009a None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:08.461119 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031dc964-b90c-4341-86b1-def6a472009a None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:08.462551 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 154/323] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:58:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:58:08.467439 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc6aa95-e778-49cc-b3c6-44ede00589a5 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:08.467996 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc6aa95-e778-49cc-b3c6-44ede00589a5 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:08.468273 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc6aa95-e778-49cc-b3c6-44ede00589a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:08.486854 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-fdc6aa95-e778-49cc-b3c6-44ede00589a5 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:08.488024 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-fdc6aa95-e778-49cc-b3c6-44ede00589a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:08.554871 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 170/324] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:58:08.580886 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031dc964-b90c-4341-86b1-def6a472009a None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:08.599557 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:08.683730 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031dc964-b90c-4341-86b1-def6a472009a None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:08.690766 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc6aa95-e778-49cc-b3c6-44ede00589a5 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:08.720513 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6042a5-e301-4a83-a852-73ca3c2f4ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:08.721246 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6042a5-e301-4a83-a852-73ca3c2f4ec5 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:08.721554 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6042a5-e301-4a83-a852-73ca3c2f4ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:08.722132 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6042a5-e301-4a83-a852-73ca3c2f4ec5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:08.723478 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6042a5-e301-4a83-a852-73ca3c2f4ec5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:08.724940 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6042a5-e301-4a83-a852-73ca3c2f4ec5 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:08.727991 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:08.729473 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 155/325] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 01:58:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:08.733092 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6042a5-e301-4a83-a852-73ca3c2f4ec5 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:08.799406 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc6aa95-e778-49cc-b3c6-44ede00589a5 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:08.821589 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:08.833630 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4069fbb-716c-476d-bc51-6e46144a257a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:08.834261 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4069fbb-716c-476d-bc51-6e46144a257a None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:08.834538 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4069fbb-716c-476d-bc51-6e46144a257a None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:08.834799 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4069fbb-716c-476d-bc51-6e46144a257a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:08.837927 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6042a5-e301-4a83-a852-73ca3c2f4ec5 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:08.844673 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4069fbb-716c-476d-bc51-6e46144a257a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:58:08.850101 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-f4069fbb-716c-476d-bc51-6e46144a257a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 29 01:58:08.850101 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:08.850101 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:08.850101 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:08.850101 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:08.850101 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:08.850101 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:08.850101 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:08.850101 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:08.850101 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:08.850101 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:08.850101 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:08.850101 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:58:08.850101 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:58:08.850101 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:58:08.850101 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:58:08.851061 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:58:08.851061 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:58:08.851061 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:58:08.851061 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:58:08.851061 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:08.851061 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:08.851061 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:08.851061 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:08.851061 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:08.851061 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:08.851061 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:08.851061 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:08.851061 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:08.851061 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:08.851061 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:08.851061 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:08.851845 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:08.851845 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:08.851845 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:08.851845 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:08.851845 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:58:08.851845 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:58:08.851845 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:58:08.851845 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:58:08.851845 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:58:08.851845 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:58:08.851845 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 29 01:58:08.851845 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:58:08.851845 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 171/326] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Sep 29 01:58:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:08.852487 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4069fbb-716c-476d-bc51-6e46144a257a None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:08.874630 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80ef59d-9737-43e9-a3f5-a3cab33b0c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:08.875240 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ef59d-9737-43e9-a3f5-a3cab33b0c68 None admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:08.875517 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ef59d-9737-43e9-a3f5-a3cab33b0c68 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:08.875784 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ef59d-9737-43e9-a3f5-a3cab33b0c68 None admin] PATH_INFO: `/v3/groups` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:08.876402 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80ef59d-9737-43e9-a3f5-a3cab33b0c68 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:08.878335 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80ef59d-9737-43e9-a3f5-a3cab33b0c68 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:08.893873 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 156/327] 10.222.0.49 () {60 vars in 1134 bytes} [Thu Sep 29 01:58:08 2022] POST /identity/v3/groups => generated 226 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 29 01:58:08.894713 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80ef59d-9737-43e9-a3f5-a3cab33b0c68 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:08.965112 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:08.975250 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4069fbb-716c-476d-bc51-6e46144a257a None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:09.012761 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158c6f0f-8abd-4c5c-9542-e51ee3a713f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:09.013785 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c6f0f-8abd-4c5c-9542-e51ee3a713f5 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:09.014122 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c6f0f-8abd-4c5c-9542-e51ee3a713f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:09.014390 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c6f0f-8abd-4c5c-9542-e51ee3a713f5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:09.015546 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80ef59d-9737-43e9-a3f5-a3cab33b0c68 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:09.027165 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158c6f0f-8abd-4c5c-9542-e51ee3a713f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:58:09.032266 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-158c6f0f-8abd-4c5c-9542-e51ee3a713f5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 29 01:58:09.032266 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:09.032266 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:09.032266 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:09.032266 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:09.032266 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:09.032266 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:09.032266 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:09.032266 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:09.032266 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:09.032266 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:09.032266 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:09.032266 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:58:09.032266 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:58:09.032266 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:58:09.032266 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:58:09.033220 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:58:09.033220 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:58:09.033220 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:58:09.033220 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:58:09.033220 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:09.033220 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:09.033220 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:09.033220 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:09.033220 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:09.033220 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:09.033220 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:09.033220 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:09.033220 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:09.033220 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:09.033220 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:09.033220 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:09.034503 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:09.034503 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:09.034503 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:09.034503 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:09.034503 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:58:09.034503 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:58:09.034503 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:58:09.034503 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:58:09.034503 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:58:09.034503 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:58:09.034503 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 29 01:58:09.034503 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:58:09.034503 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 172/328] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Sep 29 01:58:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:09.042205 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158c6f0f-8abd-4c5c-9542-e51ee3a713f5 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:09.059208 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b566909-5fbc-40a0-839b-63aaa4460dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:09.059823 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b566909-5fbc-40a0-839b-63aaa4460dc7 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:09.060130 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b566909-5fbc-40a0-839b-63aaa4460dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:09.060363 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b566909-5fbc-40a0-839b-63aaa4460dc7 None admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:09.061158 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b566909-5fbc-40a0-839b-63aaa4460dc7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:09.061359 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b566909-5fbc-40a0-839b-63aaa4460dc7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:09.064902 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b566909-5fbc-40a0-839b-63aaa4460dc7 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:09.073422 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 157/329] 10.222.0.49 () {56 vars in 1101 bytes} [Thu Sep 29 01:58:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:09.078987 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b566909-5fbc-40a0-839b-63aaa4460dc7 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:09.092499 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:09.166800 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158c6f0f-8abd-4c5c-9542-e51ee3a713f5 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:09.202856 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b566909-5fbc-40a0-839b-63aaa4460dc7 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:09.210540 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f0a124-fa9d-41f4-b50d-d2a411bacc29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:09.211516 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f0a124-fa9d-41f4-b50d-d2a411bacc29 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:09.211993 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f0a124-fa9d-41f4-b50d-d2a411bacc29 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:09.212490 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f0a124-fa9d-41f4-b50d-d2a411bacc29 None admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:09.213379 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f0a124-fa9d-41f4-b50d-d2a411bacc29 None admin] RBAC: Adding query filter params (name=member) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:09.213793 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f0a124-fa9d-41f4-b50d-d2a411bacc29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:09.215270 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f0a124-fa9d-41f4-b50d-d2a411bacc29 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:09.225385 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 173/330] 10.222.0.49 () {56 vars in 1101 bytes} [Thu Sep 29 01:58:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:09.231380 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f0a124-fa9d-41f4-b50d-d2a411bacc29 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:09.248338 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b760c08-7de9-49c5-81e4-b4ddfbd8a3f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:09.249146 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b760c08-7de9-49c5-81e4-b4ddfbd8a3f7 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:09.249448 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b760c08-7de9-49c5-81e4-b4ddfbd8a3f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:09.250106 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b760c08-7de9-49c5-81e4-b4ddfbd8a3f7 None admin] PATH_INFO: `/v3/users/574c71c9846d4dba833bfd770c4b6573` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:09.251282 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b760c08-7de9-49c5-81e4-b4ddfbd8a3f7 None admin] RBAC: Authorizing `identity:get_user(user_id=574c71c9846d4dba833bfd770c4b6573)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:09.252171 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:09.253172 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b760c08-7de9-49c5-81e4-b4ddfbd8a3f7 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:09.255177 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 158/331] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Sep 29 01:58:09 2022] GET /identity/v3/users/574c71c9846d4dba833bfd770c4b6573 => generated 293 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:58:09.261277 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b760c08-7de9-49c5-81e4-b4ddfbd8a3f7 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:09.362404 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f0a124-fa9d-41f4-b50d-d2a411bacc29 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:09.369601 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:09.406497 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b760c08-7de9-49c5-81e4-b4ddfbd8a3f7 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:09.407055 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bbb750-fe4f-447f-87eb-dfc5e76c94ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:09.407700 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bbb750-fe4f-447f-87eb-dfc5e76c94ac None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:09.407975 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bbb750-fe4f-447f-87eb-dfc5e76c94ac None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:09.408797 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bbb750-fe4f-447f-87eb-dfc5e76c94ac None admin] PATH_INFO: `/v3/users/2a7cf76aeb0a4fa8b02db0f8bcc3450a` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:09.411444 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bbb750-fe4f-447f-87eb-dfc5e76c94ac None admin] RBAC: Authorizing `identity:get_user(user_id=2a7cf76aeb0a4fa8b02db0f8bcc3450a)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:09.412896 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bbb750-fe4f-447f-87eb-dfc5e76c94ac None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:09.419235 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 174/332] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Sep 29 01:58:09 2022] GET /identity/v3/users/2a7cf76aeb0a4fa8b02db0f8bcc3450a => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:09.426510 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bbb750-fe4f-447f-87eb-dfc5e76c94ac None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:09.454318 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67d2f7a-775c-4b84-8160-cd86755173df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:09.455303 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67d2f7a-775c-4b84-8160-cd86755173df None admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:09.455934 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67d2f7a-775c-4b84-8160-cd86755173df None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:09.456353 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67d2f7a-775c-4b84-8160-cd86755173df None admin] PATH_INFO: `/v3/system/users/574c71c9846d4dba833bfd770c4b6573/roles/63a7737d5e4b42ccbfdd40451c4a1c77` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:09.458109 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67d2f7a-775c-4b84-8160-cd86755173df None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=574c71c9846d4dba833bfd770c4b6573, role_id=63a7737d5e4b42ccbfdd40451c4a1c77)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:09.460408 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67d2f7a-775c-4b84-8160-cd86755173df None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:09.473573 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 159/333] 10.222.0.49 () {58 vars in 1334 bytes} [Thu Sep 29 01:58:09 2022] PUT /identity/v3/system/users/574c71c9846d4dba833bfd770c4b6573/roles/63a7737d5e4b42ccbfdd40451c4a1c77 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 01:58:09.522549 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:09.542915 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bbb750-fe4f-447f-87eb-dfc5e76c94ac None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:09.591563 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c25010-0349-4247-b236-c8a7de85e55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:09.592241 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c25010-0349-4247-b236-c8a7de85e55b None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:09.592526 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c25010-0349-4247-b236-c8a7de85e55b None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:09.592796 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c25010-0349-4247-b236-c8a7de85e55b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:09.593575 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c25010-0349-4247-b236-c8a7de85e55b None admin] RBAC: Adding query filter params (role.id=f157f905c9c94ccfbfb46e52d443e8f2, user.id=2a7cf76aeb0a4fa8b02db0f8bcc3450a, scope.system=all) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:09.593880 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c25010-0349-4247-b236-c8a7de85e55b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:09.595340 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c25010-0349-4247-b236-c8a7de85e55b None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:09.609897 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 175/334] 10.222.0.49 () {56 vars in 1308 bytes} [Thu Sep 29 01:58:09 2022] GET /identity/v3/role_assignments?user.id=2a7cf76aeb0a4fa8b02db0f8bcc3450a&scope.system=all&role.id=f157f905c9c94ccfbfb46e52d443e8f2 => generated 510 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:11.349022 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b851e1f7-afe8-4fd1-9898-4d9be59b367a None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:11.350070 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b851e1f7-afe8-4fd1-9898-4d9be59b367a None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:11.350590 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b851e1f7-afe8-4fd1-9898-4d9be59b367a None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:11.352409 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 160/335] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:58:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:58:11.358870 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec5e8f4-a387-4c1a-b737-bcc8832654ef None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:11.359724 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec5e8f4-a387-4c1a-b737-bcc8832654ef None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:11.360199 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec5e8f4-a387-4c1a-b737-bcc8832654ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:11.380942 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-8ec5e8f4-a387-4c1a-b737-bcc8832654ef None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:11.382486 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-8ec5e8f4-a387-4c1a-b737-bcc8832654ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:11.456886 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 176/336] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:58:11.632040 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cddea14-122a-4de9-8ccf-e2aa1f6ebdb3 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:11.632643 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cddea14-122a-4de9-8ccf-e2aa1f6ebdb3 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:11.633151 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cddea14-122a-4de9-8ccf-e2aa1f6ebdb3 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:11.634997 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 161/337] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:58:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:58:11.640155 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0049e9f3-bb8e-4ecd-a7b9-6f53f6501ed0 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:11.640680 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0049e9f3-bb8e-4ecd-a7b9-6f53f6501ed0 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:11.641153 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0049e9f3-bb8e-4ecd-a7b9-6f53f6501ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:11.666276 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-0049e9f3-bb8e-4ecd-a7b9-6f53f6501ed0 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:11.668091 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-0049e9f3-bb8e-4ecd-a7b9-6f53f6501ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:11.765901 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 177/338] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:58:12.029932 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cddea14-122a-4de9-8ccf-e2aa1f6ebdb3 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:12.150941 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cddea14-122a-4de9-8ccf-e2aa1f6ebdb3 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:12.172025 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6943616-f1ff-48ee-9fec-ef49d3d58d58 None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:12.172317 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6943616-f1ff-48ee-9fec-ef49d3d58d58 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:12.172505 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6943616-f1ff-48ee-9fec-ef49d3d58d58 None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:12.178554 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 178/339] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:58:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:58:12.180046 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a9f187-e8f1-4722-a60a-ea76b567c458 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:12.180334 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a9f187-e8f1-4722-a60a-ea76b567c458 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:12.180611 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a9f187-e8f1-4722-a60a-ea76b567c458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:12.193682 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:12.197752 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde1c723-29a2-4938-a2f7-09789ab79407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:12.198421 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde1c723-29a2-4938-a2f7-09789ab79407 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:12.198702 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde1c723-29a2-4938-a2f7-09789ab79407 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:12.198975 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde1c723-29a2-4938-a2f7-09789ab79407 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:12.213944 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:12.218456 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde1c723-29a2-4938-a2f7-09789ab79407 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:58:12.222536 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-02a9f187-e8f1-4722-a60a-ea76b567c458 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:12.223668 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-fde1c723-29a2-4938-a2f7-09789ab79407 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 29 01:58:12.223668 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:12.223668 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:12.223668 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:12.223668 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:12.223668 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:12.223668 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:12.223668 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:12.223668 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:12.223668 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:12.223668 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:12.223668 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:12.223668 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:58:12.223668 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:58:12.223668 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:58:12.223668 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:58:12.224535 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:58:12.224535 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:58:12.224535 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:58:12.224535 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:58:12.224535 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:12.224535 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:12.224535 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:12.224535 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:12.224535 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:12.224535 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:12.224535 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:12.224535 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:12.224535 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:12.224535 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:12.224535 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:12.224535 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:12.225324 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:12.225324 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:12.225324 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:12.225324 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:12.225324 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:58:12.225324 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:58:12.225324 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:58:12.225324 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:58:12.225324 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:58:12.225324 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:58:12.225324 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 29 01:58:12.225324 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:58:12.225924 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-02a9f187-e8f1-4722-a60a-ea76b567c458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:12.225992 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 162/340] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Sep 29 01:58:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:12.231366 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde1c723-29a2-4938-a2f7-09789ab79407 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:12.333742 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 179/341] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:58:12.334706 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a9f187-e8f1-4722-a60a-ea76b567c458 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:12.420121 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde1c723-29a2-4938-a2f7-09789ab79407 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:12.469701 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499bb2bd-3973-4f19-a647-2ee77b3cbbef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:12.473552 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499bb2bd-3973-4f19-a647-2ee77b3cbbef None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:12.473832 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499bb2bd-3973-4f19-a647-2ee77b3cbbef None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:12.474104 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499bb2bd-3973-4f19-a647-2ee77b3cbbef None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:12.494526 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499bb2bd-3973-4f19-a647-2ee77b3cbbef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:58:12.499927 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-499bb2bd-3973-4f19-a647-2ee77b3cbbef None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 29 01:58:12.499927 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:12.499927 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:12.499927 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:12.499927 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:12.499927 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:12.499927 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:12.499927 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:12.499927 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:12.499927 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:12.499927 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:12.499927 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:12.499927 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:58:12.499927 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:58:12.499927 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:58:12.499927 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:58:12.500777 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:58:12.500777 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:58:12.500777 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:58:12.500777 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:58:12.500777 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:12.500777 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:12.500777 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:12.500777 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:12.500777 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:12.500777 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:12.500777 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:12.500777 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:12.500777 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:12.500777 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:12.500777 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:12.500777 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:12.501562 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:12.501562 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:12.501562 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:12.501562 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:12.501562 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:58:12.501562 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:58:12.501562 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:58:12.501562 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:58:12.501562 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:58:12.501562 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:58:12.501562 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 29 01:58:12.501562 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:58:12.501562 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 163/342] 10.222.0.49 () {56 vars in 1114 bytes} [Thu Sep 29 01:58:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 01:58:12.510583 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499bb2bd-3973-4f19-a647-2ee77b3cbbef None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:12.528248 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a9f187-e8f1-4722-a60a-ea76b567c458 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:12.585752 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:12.592924 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eea510c-9309-4971-a56c-d2433e661d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:12.593763 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eea510c-9309-4971-a56c-d2433e661d16 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:12.594038 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eea510c-9309-4971-a56c-d2433e661d16 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:12.594519 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eea510c-9309-4971-a56c-d2433e661d16 None admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:12.595185 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eea510c-9309-4971-a56c-d2433e661d16 None admin] RBAC: Adding query filter params (name=member) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:12.596063 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eea510c-9309-4971-a56c-d2433e661d16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:12.597782 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eea510c-9309-4971-a56c-d2433e661d16 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:12.610964 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:12.613019 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 180/343] 10.222.0.49 () {56 vars in 1101 bytes} [Thu Sep 29 01:58:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:12.619465 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eea510c-9309-4971-a56c-d2433e661d16 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:12.677670 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499bb2bd-3973-4f19-a647-2ee77b3cbbef None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:12.742729 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489a5bb4-9ee4-4c37-9c94-cc715060f33e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:12.743275 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a5bb4-9ee4-4c37-9c94-cc715060f33e None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:12.743554 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a5bb4-9ee4-4c37-9c94-cc715060f33e None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:12.743825 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a5bb4-9ee4-4c37-9c94-cc715060f33e None admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:12.744501 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489a5bb4-9ee4-4c37-9c94-cc715060f33e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:12.744797 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489a5bb4-9ee4-4c37-9c94-cc715060f33e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:12.746208 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489a5bb4-9ee4-4c37-9c94-cc715060f33e None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:12.748951 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eea510c-9309-4971-a56c-d2433e661d16 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:12.755507 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 164/344] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Sep 29 01:58:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:12.756416 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489a5bb4-9ee4-4c37-9c94-cc715060f33e None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:12.788962 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcc3f54-2d73-4049-82ac-1f3c870b8763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:12.789642 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc3f54-2d73-4049-82ac-1f3c870b8763 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:12.789921 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc3f54-2d73-4049-82ac-1f3c870b8763 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:12.790321 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc3f54-2d73-4049-82ac-1f3c870b8763 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:12.910759 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489a5bb4-9ee4-4c37-9c94-cc715060f33e None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:12.913032 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:12.923476 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcc3f54-2d73-4049-82ac-1f3c870b8763 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:12.925824 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcc3f54-2d73-4049-82ac-1f3c870b8763 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:12.937269 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:12.952912 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b34f7b-3b6a-46f0-ba9e-596c35a7b0d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:12.953913 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b34f7b-3b6a-46f0-ba9e-596c35a7b0d0 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:12.954421 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b34f7b-3b6a-46f0-ba9e-596c35a7b0d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:12.954888 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b34f7b-3b6a-46f0-ba9e-596c35a7b0d0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:12.966870 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b34f7b-3b6a-46f0-ba9e-596c35a7b0d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:58:12.972859 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-f5b34f7b-3b6a-46f0-ba9e-596c35a7b0d0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 29 01:58:12.972859 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:12.972859 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:12.972859 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:12.972859 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:12.972859 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:12.972859 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:12.972859 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:12.972859 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:12.972859 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:12.972859 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:12.972859 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:12.972859 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:58:12.972859 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:58:12.972859 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:58:12.972859 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:58:12.973871 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:58:12.973871 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:58:12.973871 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:58:12.973871 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:58:12.973871 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:12.973871 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:12.973871 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:12.973871 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:12.973871 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:12.973871 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:12.973871 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:12.973871 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:12.973871 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:12.973871 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:12.973871 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:12.973871 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:12.974664 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:12.974664 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:12.974664 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:12.974664 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:12.974664 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:58:12.974664 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:58:12.974664 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:58:12.974664 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:58:12.974664 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:58:12.974664 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:58:12.974664 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 29 01:58:12.974664 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:58:12.977241 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 165/345] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Sep 29 01:58:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:12.978352 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b34f7b-3b6a-46f0-ba9e-596c35a7b0d0 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:13.084897 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b34f7b-3b6a-46f0-ba9e-596c35a7b0d0 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:13.115607 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 181/346] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Sep 29 01:58:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 29 01:58:13.116652 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcc3f54-2d73-4049-82ac-1f3c870b8763 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:13.122558 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef818a9-ddef-41ae-b2fe-45f9e4af40f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:13.123481 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef818a9-ddef-41ae-b2fe-45f9e4af40f4 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:13.123965 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef818a9-ddef-41ae-b2fe-45f9e4af40f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:13.124471 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef818a9-ddef-41ae-b2fe-45f9e4af40f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:13.179411 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:13.200041 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef818a9-ddef-41ae-b2fe-45f9e4af40f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:13.201846 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef818a9-ddef-41ae-b2fe-45f9e4af40f4 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:13.224191 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:13.232508 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcc3f54-2d73-4049-82ac-1f3c870b8763 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:13.272220 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d53fe5a-e119-49d7-9283-a53d2c011650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:13.272867 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d53fe5a-e119-49d7-9283-a53d2c011650 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:13.273145 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d53fe5a-e119-49d7-9283-a53d2c011650 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:13.273501 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d53fe5a-e119-49d7-9283-a53d2c011650 None admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:13.274100 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d53fe5a-e119-49d7-9283-a53d2c011650 None admin] RBAC: Adding query filter params (name=member) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:13.274400 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d53fe5a-e119-49d7-9283-a53d2c011650 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:13.275869 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d53fe5a-e119-49d7-9283-a53d2c011650 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:13.286454 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 182/347] 10.222.0.49 () {56 vars in 1101 bytes} [Thu Sep 29 01:58:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:13.287853 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec40dd91-472a-4134-8e25-3ca5e3af9e31 None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:13.288142 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec40dd91-472a-4134-8e25-3ca5e3af9e31 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:13.288416 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec40dd91-472a-4134-8e25-3ca5e3af9e31 None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:13.289835 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 183/348] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:58:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:58:13.290468 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec40dd91-472a-4134-8e25-3ca5e3af9e31 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:13.313352 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 166/349] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Sep 29 01:58:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 29 01:58:13.315265 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef818a9-ddef-41ae-b2fe-45f9e4af40f4 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:13.403207 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:13.417963 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec40dd91-472a-4134-8e25-3ca5e3af9e31 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:13.425450 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef818a9-ddef-41ae-b2fe-45f9e4af40f4 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:13.458113 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e10b1f-6982-460d-accc-d7d51846880a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:13.458778 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e10b1f-6982-460d-accc-d7d51846880a None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:13.459073 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e10b1f-6982-460d-accc-d7d51846880a None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:13.459384 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e10b1f-6982-460d-accc-d7d51846880a None admin] PATH_INFO: `/v3/projects/ca184432008d4efaa18beac740258875` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:13.460635 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e10b1f-6982-460d-accc-d7d51846880a None admin] RBAC: Authorizing `identity:get_project(project_id=ca184432008d4efaa18beac740258875)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:13.463437 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e10b1f-6982-460d-accc-d7d51846880a None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:13.464212 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ac451c-3722-4d27-b91f-dcc15b73128b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:13.464353 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 184/350] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Sep 29 01:58:13 2022] GET /identity/v3/projects/ca184432008d4efaa18beac740258875 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:13.464580 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac451c-3722-4d27-b91f-dcc15b73128b None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:13.464855 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac451c-3722-4d27-b91f-dcc15b73128b None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:13.465119 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac451c-3722-4d27-b91f-dcc15b73128b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:13.465217 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df00b46-9b31-4f96-a2bf-d5c4f7f0bfa6 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:13.465432 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df00b46-9b31-4f96-a2bf-d5c4f7f0bfa6 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:13.465689 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df00b46-9b31-4f96-a2bf-d5c4f7f0bfa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:13.484614 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-5df00b46-9b31-4f96-a2bf-d5c4f7f0bfa6 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:13.486152 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-5df00b46-9b31-4f96-a2bf-d5c4f7f0bfa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:13.508387 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:13.549406 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ac451c-3722-4d27-b91f-dcc15b73128b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:13.551234 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ac451c-3722-4d27-b91f-dcc15b73128b None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:13.596168 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 185/351] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:58:13.597067 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df00b46-9b31-4f96-a2bf-d5c4f7f0bfa6 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:13.653553 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:13.683742 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 167/352] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Sep 29 01:58:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 29 01:58:13.685413 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cfbd6b-ab46-41b2-998c-1d77771b066a None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:13.685917 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cfbd6b-ab46-41b2-998c-1d77771b066a None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:13.686425 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cfbd6b-ab46-41b2-998c-1d77771b066a None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:13.689034 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 168/353] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:58:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:58:13.691083 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cfbd6b-ab46-41b2-998c-1d77771b066a None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:13.728641 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df00b46-9b31-4f96-a2bf-d5c4f7f0bfa6 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:13.768561 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51aaa6f-36de-4a18-94a4-4d58c78397d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:13.769201 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51aaa6f-36de-4a18-94a4-4d58c78397d2 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:13.769572 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51aaa6f-36de-4a18-94a4-4d58c78397d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:13.769842 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51aaa6f-36de-4a18-94a4-4d58c78397d2 None admin] PATH_INFO: `/v3/projects/ca184432008d4efaa18beac740258875` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:13.771060 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51aaa6f-36de-4a18-94a4-4d58c78397d2 None admin] RBAC: Authorizing `identity:get_project(project_id=ca184432008d4efaa18beac740258875)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:13.772521 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51aaa6f-36de-4a18-94a4-4d58c78397d2 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:13.774194 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 186/354] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Sep 29 01:58:13 2022] GET /identity/v3/projects/ca184432008d4efaa18beac740258875 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:13.776063 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fbe841-5280-4fa3-a4a6-1611ac6b5fb5 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:13.776344 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fbe841-5280-4fa3-a4a6-1611ac6b5fb5 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:13.776675 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fbe841-5280-4fa3-a4a6-1611ac6b5fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:13.797024 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-32fbe841-5280-4fa3-a4a6-1611ac6b5fb5 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:13.798266 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-32fbe841-5280-4fa3-a4a6-1611ac6b5fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:13.817551 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:13.830737 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cfbd6b-ab46-41b2-998c-1d77771b066a None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:13.874286 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9500ab76-7eb9-43bf-8414-c56e8906908a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:13.874921 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9500ab76-7eb9-43bf-8414-c56e8906908a None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:13.875194 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9500ab76-7eb9-43bf-8414-c56e8906908a None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:13.875440 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 187/355] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:58:13.875543 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9500ab76-7eb9-43bf-8414-c56e8906908a None admin] PATH_INFO: `/v3/groups/6702610c615b4999a7423f721152834f` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:13.876361 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fbe841-5280-4fa3-a4a6-1611ac6b5fb5 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:13.883646 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9500ab76-7eb9-43bf-8414-c56e8906908a None admin] RBAC: Authorizing `identity:get_group(group_id=6702610c615b4999a7423f721152834f)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:13.885166 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9500ab76-7eb9-43bf-8414-c56e8906908a None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:13.887172 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 169/356] 10.222.0.49 () {56 vars in 1180 bytes} [Thu Sep 29 01:58:13 2022] GET /identity/v3/groups/6702610c615b4999a7423f721152834f => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:13.890336 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9500ab76-7eb9-43bf-8414-c56e8906908a None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:13.953640 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:14.003834 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fbe841-5280-4fa3-a4a6-1611ac6b5fb5 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:14.019407 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9500ab76-7eb9-43bf-8414-c56e8906908a None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:14.047025 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccff2b07-8156-4662-9524-24a8c8ed007c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:14.047937 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff2b07-8156-4662-9524-24a8c8ed007c None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:14.048216 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff2b07-8156-4662-9524-24a8c8ed007c None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:14.048492 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff2b07-8156-4662-9524-24a8c8ed007c None admin] PATH_INFO: `/v3/projects/7ed8ec70d1f649c6b36156f0f44f2271` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:14.050153 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccff2b07-8156-4662-9524-24a8c8ed007c None admin] RBAC: Authorizing `identity:get_project(project_id=7ed8ec70d1f649c6b36156f0f44f2271)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:14.052034 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccff2b07-8156-4662-9524-24a8c8ed007c None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:14.054683 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 188/357] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Sep 29 01:58:13 2022] GET /identity/v3/projects/7ed8ec70d1f649c6b36156f0f44f2271 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:14.055369 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccff2b07-8156-4662-9524-24a8c8ed007c None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:14.058082 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139c4fa2-fc72-4f66-a40e-271a1931451b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:14.058933 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139c4fa2-fc72-4f66-a40e-271a1931451b None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:14.059457 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139c4fa2-fc72-4f66-a40e-271a1931451b None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:14.059904 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139c4fa2-fc72-4f66-a40e-271a1931451b None admin] PATH_INFO: `/v3/groups/6702610c615b4999a7423f721152834f` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:14.061167 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139c4fa2-fc72-4f66-a40e-271a1931451b None admin] RBAC: Authorizing `identity:get_group(group_id=6702610c615b4999a7423f721152834f)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:14.062721 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139c4fa2-fc72-4f66-a40e-271a1931451b None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:14.065548 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 170/358] 10.222.0.49 () {56 vars in 1180 bytes} [Thu Sep 29 01:58:13 2022] GET /identity/v3/groups/6702610c615b4999a7423f721152834f => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:14.066596 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139c4fa2-fc72-4f66-a40e-271a1931451b None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:14.081337 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:14.186268 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccff2b07-8156-4662-9524-24a8c8ed007c None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:14.188235 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139c4fa2-fc72-4f66-a40e-271a1931451b None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:14.214431 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:14.227473 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95c69fd-da48-4689-9eb4-3a28eb396cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:14.228348 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95c69fd-da48-4689-9eb4-3a28eb396cf9 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:14.228648 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95c69fd-da48-4689-9eb4-3a28eb396cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:14.228922 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95c69fd-da48-4689-9eb4-3a28eb396cf9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:14.229689 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95c69fd-da48-4689-9eb4-3a28eb396cf9 None admin] RBAC: Adding query filter params (group.id=6702610c615b4999a7423f721152834f, role.id=f157f905c9c94ccfbfb46e52d443e8f2, scope.project.id=ca184432008d4efaa18beac740258875) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:14.229997 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95c69fd-da48-4689-9eb4-3a28eb396cf9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:14.231926 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95c69fd-da48-4689-9eb4-3a28eb396cf9 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:14.240149 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 189/359] 10.222.0.49 () {56 vars in 1376 bytes} [Thu Sep 29 01:58:14 2022] GET /identity/v3/role_assignments?group.id=6702610c615b4999a7423f721152834f&scope.project.id=ca184432008d4efaa18beac740258875&role.id=f157f905c9c94ccfbfb46e52d443e8f2 => generated 260 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:14.241139 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95c69fd-da48-4689-9eb4-3a28eb396cf9 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:14.243910 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cb9f5a-fa0c-41aa-b59e-f0625226aa0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:14.245255 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb9f5a-fa0c-41aa-b59e-f0625226aa0c None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:14.246887 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb9f5a-fa0c-41aa-b59e-f0625226aa0c None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:14.247423 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb9f5a-fa0c-41aa-b59e-f0625226aa0c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:14.263822 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cb9f5a-fa0c-41aa-b59e-f0625226aa0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:58:14.273058 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-63cb9f5a-fa0c-41aa-b59e-f0625226aa0c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 29 01:58:14.273058 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:14.273058 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:14.273058 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:14.273058 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:14.273058 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:14.273058 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:14.273058 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:14.273058 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:14.273058 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:14.273058 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:14.273058 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:14.273058 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:58:14.273058 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:58:14.273058 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:58:14.273058 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:58:14.274040 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:58:14.274040 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:58:14.274040 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:58:14.274040 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:58:14.274040 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:14.274040 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:14.274040 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:14.274040 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:14.274040 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:14.274040 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:14.274040 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:14.274040 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:14.274040 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:14.274040 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:14.274040 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:14.274040 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:14.274904 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:14.274904 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:14.274904 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:14.274904 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:14.274904 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:58:14.274904 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:58:14.274904 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:58:14.274904 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:58:14.274904 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:58:14.274904 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:58:14.274904 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 29 01:58:14.274904 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:58:14.278186 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 171/360] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Sep 29 01:58:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:14.279499 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cb9f5a-fa0c-41aa-b59e-f0625226aa0c None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:14.358209 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:14.382516 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95c69fd-da48-4689-9eb4-3a28eb396cf9 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:14.428361 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cb9f5a-fa0c-41aa-b59e-f0625226aa0c None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:14.429988 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86a82a2-59eb-482f-8d72-b74290a60c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:14.430642 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a82a2-59eb-482f-8d72-b74290a60c05 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:14.430918 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a82a2-59eb-482f-8d72-b74290a60c05 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:14.431187 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a82a2-59eb-482f-8d72-b74290a60c05 None admin] PATH_INFO: `/v3/groups/6702610c615b4999a7423f721152834f` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:14.433501 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86a82a2-59eb-482f-8d72-b74290a60c05 None admin] RBAC: Authorizing `identity:get_group(group_id=6702610c615b4999a7423f721152834f)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:14.435948 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86a82a2-59eb-482f-8d72-b74290a60c05 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:14.437042 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 190/361] 10.222.0.49 () {56 vars in 1180 bytes} [Thu Sep 29 01:58:14 2022] GET /identity/v3/groups/6702610c615b4999a7423f721152834f => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:14.437802 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86a82a2-59eb-482f-8d72-b74290a60c05 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:14.476883 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7261bc82-1ad5-4012-b148-755a6760200c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:14.477837 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7261bc82-1ad5-4012-b148-755a6760200c None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:14.478293 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7261bc82-1ad5-4012-b148-755a6760200c None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:14.478739 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7261bc82-1ad5-4012-b148-755a6760200c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:14.479668 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7261bc82-1ad5-4012-b148-755a6760200c None admin] RBAC: Adding query filter params (group.id=6702610c615b4999a7423f721152834f, role.id=8de931d79c9d4c8daf717aaea348dda9, scope.project.id=ca184432008d4efaa18beac740258875) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:14.480159 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7261bc82-1ad5-4012-b148-755a6760200c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:14.481816 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7261bc82-1ad5-4012-b148-755a6760200c None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:14.488805 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 172/362] 10.222.0.49 () {56 vars in 1376 bytes} [Thu Sep 29 01:58:14 2022] GET /identity/v3/role_assignments?group.id=6702610c615b4999a7423f721152834f&scope.project.id=ca184432008d4efaa18beac740258875&role.id=8de931d79c9d4c8daf717aaea348dda9 => generated 260 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:14.489993 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7261bc82-1ad5-4012-b148-755a6760200c None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:14.537793 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:14.565409 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86a82a2-59eb-482f-8d72-b74290a60c05 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:14.613593 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00952ecf-b510-4983-8b4e-fd2c31fd032a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:14.615241 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00952ecf-b510-4983-8b4e-fd2c31fd032a None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:14.616132 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00952ecf-b510-4983-8b4e-fd2c31fd032a None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:14.616889 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00952ecf-b510-4983-8b4e-fd2c31fd032a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:14.625370 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7261bc82-1ad5-4012-b148-755a6760200c None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:14.634486 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00952ecf-b510-4983-8b4e-fd2c31fd032a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:58:14.642198 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-00952ecf-b510-4983-8b4e-fd2c31fd032a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 29 01:58:14.642198 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:14.642198 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:14.642198 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:14.642198 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:14.642198 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:14.642198 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:14.642198 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:14.642198 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:14.642198 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:14.642198 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:14.642198 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:14.642198 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:58:14.642198 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:58:14.642198 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:58:14.642198 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:58:14.643350 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:58:14.643350 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:58:14.643350 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:58:14.643350 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:58:14.643350 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:14.643350 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:14.643350 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:14.643350 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:14.643350 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:14.643350 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:14.643350 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:14.643350 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:14.643350 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:14.643350 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:14.643350 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:14.643350 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:14.644131 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:14.644131 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:14.644131 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:14.644131 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:14.644131 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:58:14.644131 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:58:14.644131 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:58:14.644131 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:58:14.644131 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:58:14.644131 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:58:14.644131 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 29 01:58:14.644131 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:58:14.647284 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 191/363] 10.222.0.49 () {56 vars in 1114 bytes} [Thu Sep 29 01:58:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:14.648873 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f85c83-637b-4add-889c-41f87f46c2ca None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:14.649357 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f85c83-637b-4add-889c-41f87f46c2ca None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:14.649769 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f85c83-637b-4add-889c-41f87f46c2ca None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:14.651292 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 192/364] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:58:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:58:14.652490 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f85c83-637b-4add-889c-41f87f46c2ca None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:14.675156 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:14.676951 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020c765e-e9d1-41a5-b31c-14e5b10eb5eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:14.677703 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c765e-e9d1-41a5-b31c-14e5b10eb5eb None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:14.677880 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c765e-e9d1-41a5-b31c-14e5b10eb5eb None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:14.678150 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c765e-e9d1-41a5-b31c-14e5b10eb5eb None admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:14.678861 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020c765e-e9d1-41a5-b31c-14e5b10eb5eb None admin] RBAC: Adding query filter params (name=reader) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:14.679160 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020c765e-e9d1-41a5-b31c-14e5b10eb5eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:14.680812 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020c765e-e9d1-41a5-b31c-14e5b10eb5eb None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:14.693218 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 173/365] 10.222.0.49 () {56 vars in 1101 bytes} [Thu Sep 29 01:58:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:14.697864 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020c765e-e9d1-41a5-b31c-14e5b10eb5eb None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:14.797857 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f85c83-637b-4add-889c-41f87f46c2ca None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:14.828962 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:14.834226 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020c765e-e9d1-41a5-b31c-14e5b10eb5eb None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:14.839244 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309b9cf5-c0e9-460b-8631-f13422ec08be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:14.839861 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b9cf5-c0e9-460b-8631-f13422ec08be None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:14.840137 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b9cf5-c0e9-460b-8631-f13422ec08be None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:14.840410 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b9cf5-c0e9-460b-8631-f13422ec08be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:14.841204 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309b9cf5-c0e9-460b-8631-f13422ec08be None admin] RBAC: Adding query filter params (group.id=6702610c615b4999a7423f721152834f, role.id=f157f905c9c94ccfbfb46e52d443e8f2, scope.project.id=7ed8ec70d1f649c6b36156f0f44f2271) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:14.841535 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309b9cf5-c0e9-460b-8631-f13422ec08be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:14.843037 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309b9cf5-c0e9-460b-8631-f13422ec08be None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:14.849825 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 193/366] 10.222.0.49 () {56 vars in 1376 bytes} [Thu Sep 29 01:58:14 2022] GET /identity/v3/role_assignments?group.id=6702610c615b4999a7423f721152834f&scope.project.id=7ed8ec70d1f649c6b36156f0f44f2271&role.id=f157f905c9c94ccfbfb46e52d443e8f2 => generated 260 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:14.851091 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e6bca-a7df-4db3-9e27-8eaef4a6e9ca None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:14.851301 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e6bca-a7df-4db3-9e27-8eaef4a6e9ca None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:14.857823 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e6bca-a7df-4db3-9e27-8eaef4a6e9ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:14.877408 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b6786f-ade7-4876-857d-7ffac2c1959a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:14.878421 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b6786f-ade7-4876-857d-7ffac2c1959a None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:14.878902 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b6786f-ade7-4876-857d-7ffac2c1959a None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:14.879444 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b6786f-ade7-4876-857d-7ffac2c1959a None admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:14.880340 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b6786f-ade7-4876-857d-7ffac2c1959a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:14.880871 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b6786f-ade7-4876-857d-7ffac2c1959a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:14.882507 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b6786f-ade7-4876-857d-7ffac2c1959a None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:14.886193 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-7f5e6bca-a7df-4db3-9e27-8eaef4a6e9ca None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:14.887455 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-7f5e6bca-a7df-4db3-9e27-8eaef4a6e9ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:14.892808 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 174/367] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Sep 29 01:58:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:14.894372 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b6786f-ade7-4876-857d-7ffac2c1959a None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:15.052059 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 194/368] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:58:15.052667 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5e6bca-a7df-4db3-9e27-8eaef4a6e9ca None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:15.053788 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b6786f-ade7-4876-857d-7ffac2c1959a None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:15.069742 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:15.095756 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67fc32c-bfbe-4473-8459-933c84311cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:15.096476 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67fc32c-bfbe-4473-8459-933c84311cba None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:15.096754 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67fc32c-bfbe-4473-8459-933c84311cba None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:15.097022 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67fc32c-bfbe-4473-8459-933c84311cba None admin] PATH_INFO: `/v3/users/574c71c9846d4dba833bfd770c4b6573` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:15.098248 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67fc32c-bfbe-4473-8459-933c84311cba None admin] RBAC: Authorizing `identity:get_user(user_id=574c71c9846d4dba833bfd770c4b6573)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:15.099917 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67fc32c-bfbe-4473-8459-933c84311cba None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:15.104260 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 175/369] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Sep 29 01:58:14 2022] GET /identity/v3/users/574c71c9846d4dba833bfd770c4b6573 => generated 293 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:15.109932 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67fc32c-bfbe-4473-8459-933c84311cba None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:15.153262 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:15.259494 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67fc32c-bfbe-4473-8459-933c84311cba None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:15.278715 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5e6bca-a7df-4db3-9e27-8eaef4a6e9ca None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:15.308301 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259cfbb2-d2f8-45b5-9fcb-097253afa5d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:15.308913 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259cfbb2-d2f8-45b5-9fcb-097253afa5d7 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:15.309187 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259cfbb2-d2f8-45b5-9fcb-097253afa5d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:15.309479 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259cfbb2-d2f8-45b5-9fcb-097253afa5d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:15.310206 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259cfbb2-d2f8-45b5-9fcb-097253afa5d7 None admin] RBAC: Adding query filter params (role.id=63a7737d5e4b42ccbfdd40451c4a1c77, user.id=574c71c9846d4dba833bfd770c4b6573, scope.system=all) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:15.310511 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259cfbb2-d2f8-45b5-9fcb-097253afa5d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:15.311926 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259cfbb2-d2f8-45b5-9fcb-097253afa5d7 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:15.324555 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 176/370] 10.222.0.49 () {56 vars in 1308 bytes} [Thu Sep 29 01:58:15 2022] GET /identity/v3/role_assignments?user.id=574c71c9846d4dba833bfd770c4b6573&scope.system=all&role.id=63a7737d5e4b42ccbfdd40451c4a1c77 => generated 510 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:58:15.363273 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ff5a3e-8b6e-4ebc-8e27-bd421cf2f7ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:15.363908 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ff5a3e-8b6e-4ebc-8e27-bd421cf2f7ca None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:15.364185 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ff5a3e-8b6e-4ebc-8e27-bd421cf2f7ca None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:15.364454 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ff5a3e-8b6e-4ebc-8e27-bd421cf2f7ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:15.476840 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ff5a3e-8b6e-4ebc-8e27-bd421cf2f7ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:15.478338 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ff5a3e-8b6e-4ebc-8e27-bd421cf2f7ca None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:15.491123 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:15.610805 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 195/371] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Sep 29 01:58:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 29 01:58:15.616586 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259cfbb2-d2f8-45b5-9fcb-097253afa5d7 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:15.623316 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ff5a3e-8b6e-4ebc-8e27-bd421cf2f7ca None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:15.761179 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:15.790586 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259cfbb2-d2f8-45b5-9fcb-097253afa5d7 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:15.796520 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ff5a3e-8b6e-4ebc-8e27-bd421cf2f7ca None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:15.810578 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:15.871125 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc90c3d3-fa22-47f4-9f36-c17f7cfc381a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:15.871674 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc90c3d3-fa22-47f4-9f36-c17f7cfc381a None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:15.871952 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc90c3d3-fa22-47f4-9f36-c17f7cfc381a None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:15.872224 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc90c3d3-fa22-47f4-9f36-c17f7cfc381a None admin] PATH_INFO: `/v3/projects/7ed8ec70d1f649c6b36156f0f44f2271` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:15.873369 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0260d656-5b6a-4adf-a678-0aac4b00c7dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:15.873957 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0260d656-5b6a-4adf-a678-0aac4b00c7dd None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:15.874061 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc90c3d3-fa22-47f4-9f36-c17f7cfc381a None admin] RBAC: Authorizing `identity:get_project(project_id=7ed8ec70d1f649c6b36156f0f44f2271)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:15.874216 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0260d656-5b6a-4adf-a678-0aac4b00c7dd None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:15.874482 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0260d656-5b6a-4adf-a678-0aac4b00c7dd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:15.875618 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc90c3d3-fa22-47f4-9f36-c17f7cfc381a None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:15.877974 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 177/372] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Sep 29 01:58:15 2022] GET /identity/v3/projects/7ed8ec70d1f649c6b36156f0f44f2271 => generated 302 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:15.887120 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc90c3d3-fa22-47f4-9f36-c17f7cfc381a None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:15.897571 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0260d656-5b6a-4adf-a678-0aac4b00c7dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:58:15.902958 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-0260d656-5b6a-4adf-a678-0aac4b00c7dd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 01:58:15.902958 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:15.902958 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:15.902958 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:15.902958 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:15.902958 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:15.902958 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:15.902958 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:15.902958 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:15.902958 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:15.902958 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:15.902958 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:15.902958 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:58:15.902958 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:58:15.902958 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:58:15.902958 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:58:15.903881 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:58:15.903881 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:58:15.903881 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:58:15.903881 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:58:15.903881 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:15.903881 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:15.903881 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:15.903881 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:15.903881 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:15.903881 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:15.903881 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:15.903881 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:15.903881 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:15.903881 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:15.903881 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:15.903881 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:15.904711 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:15.904711 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:15.904711 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:15.904711 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:15.904711 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:58:15.904711 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:58:15.904711 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:58:15.904711 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:58:15.904711 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:58:15.904711 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:58:15.904711 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 01:58:15.904711 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:58:15.904711 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 196/373] 10.222.0.49 () {56 vars in 1096 bytes} [Thu Sep 29 01:58:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 01:58:15.913350 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0260d656-5b6a-4adf-a678-0aac4b00c7dd None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:16.082506 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc90c3d3-fa22-47f4-9f36-c17f7cfc381a None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:16.099458 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0260d656-5b6a-4adf-a678-0aac4b00c7dd None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:16.144931 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d18316f-da87-46d6-b3ed-24c47afe7749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:16.146944 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d18316f-da87-46d6-b3ed-24c47afe7749 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:16.147230 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d18316f-da87-46d6-b3ed-24c47afe7749 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:16.147507 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d18316f-da87-46d6-b3ed-24c47afe7749 None admin] PATH_INFO: `/v3/groups/6702610c615b4999a7423f721152834f` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:16.149810 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d18316f-da87-46d6-b3ed-24c47afe7749 None admin] RBAC: Authorizing `identity:get_group(group_id=6702610c615b4999a7423f721152834f)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:16.151253 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d18316f-da87-46d6-b3ed-24c47afe7749 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:16.152846 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 178/374] 10.222.0.49 () {56 vars in 1180 bytes} [Thu Sep 29 01:58:15 2022] GET /identity/v3/groups/6702610c615b4999a7423f721152834f => generated 226 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:16.160100 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d18316f-da87-46d6-b3ed-24c47afe7749 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:16.167027 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6eee0e-7da0-4663-8b27-742e9fc7b3e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:16.167911 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6eee0e-7da0-4663-8b27-742e9fc7b3e1 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:16.168190 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6eee0e-7da0-4663-8b27-742e9fc7b3e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:16.168464 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6eee0e-7da0-4663-8b27-742e9fc7b3e1 None admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:16.169140 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6eee0e-7da0-4663-8b27-742e9fc7b3e1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:16.173817 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6eee0e-7da0-4663-8b27-742e9fc7b3e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:16.175682 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6eee0e-7da0-4663-8b27-742e9fc7b3e1 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:16.192673 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 197/375] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Sep 29 01:58:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:16.198228 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6eee0e-7da0-4663-8b27-742e9fc7b3e1 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:16.205687 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:16.233646 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:16.336072 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6eee0e-7da0-4663-8b27-742e9fc7b3e1 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:16.366918 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d18316f-da87-46d6-b3ed-24c47afe7749 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:16.401679 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f2bcd8-9e20-4140-bec6-40023ea3a302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:16.402224 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f2bcd8-9e20-4140-bec6-40023ea3a302 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:16.402497 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f2bcd8-9e20-4140-bec6-40023ea3a302 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:16.402816 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f2bcd8-9e20-4140-bec6-40023ea3a302 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:16.423377 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb3ec93-3419-44d2-9297-9b6ef3f3e5e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:16.424819 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb3ec93-3419-44d2-9297-9b6ef3f3e5e8 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:16.425409 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb3ec93-3419-44d2-9297-9b6ef3f3e5e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:16.425922 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb3ec93-3419-44d2-9297-9b6ef3f3e5e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:16.426982 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb3ec93-3419-44d2-9297-9b6ef3f3e5e8 None admin] RBAC: Adding query filter params (group.id=6702610c615b4999a7423f721152834f, role.id=8de931d79c9d4c8daf717aaea348dda9, scope.project.id=7ed8ec70d1f649c6b36156f0f44f2271) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:16.427491 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb3ec93-3419-44d2-9297-9b6ef3f3e5e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:16.429542 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb3ec93-3419-44d2-9297-9b6ef3f3e5e8 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:16.436286 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 179/376] 10.222.0.49 () {56 vars in 1376 bytes} [Thu Sep 29 01:58:16 2022] GET /identity/v3/role_assignments?group.id=6702610c615b4999a7423f721152834f&scope.project.id=7ed8ec70d1f649c6b36156f0f44f2271&role.id=8de931d79c9d4c8daf717aaea348dda9 => generated 260 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:16.505710 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f2bcd8-9e20-4140-bec6-40023ea3a302 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:16.507544 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f2bcd8-9e20-4140-bec6-40023ea3a302 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:16.538157 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:16.628090 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 198/377] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Sep 29 01:58:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 29 01:58:16.633486 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb3ec93-3419-44d2-9297-9b6ef3f3e5e8 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:16.749573 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:16.766343 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb3ec93-3419-44d2-9297-9b6ef3f3e5e8 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:16.815708 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79de4fec-fc7f-4850-b29c-6d552657d90d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:16.816353 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de4fec-fc7f-4850-b29c-6d552657d90d None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:16.816632 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de4fec-fc7f-4850-b29c-6d552657d90d None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:16.816895 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de4fec-fc7f-4850-b29c-6d552657d90d None admin] PATH_INFO: `/v3/projects/3a47c9ae604c439cb80f84e69bc4f995` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:16.818069 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79de4fec-fc7f-4850-b29c-6d552657d90d None admin] RBAC: Authorizing `identity:get_project(project_id=3a47c9ae604c439cb80f84e69bc4f995)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:16.820128 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79de4fec-fc7f-4850-b29c-6d552657d90d None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:16.822308 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 180/378] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Sep 29 01:58:16 2022] GET /identity/v3/projects/3a47c9ae604c439cb80f84e69bc4f995 => generated 344 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:58:16.828606 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f2bcd8-9e20-4140-bec6-40023ea3a302 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:16.903014 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ebab1-8bf4-476e-a7e2-4fab9465a5c2 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:16.903347 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ebab1-8bf4-476e-a7e2-4fab9465a5c2 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:16.903658 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ebab1-8bf4-476e-a7e2-4fab9465a5c2 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:16.909354 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 181/379] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:58:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:58:16.916057 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38585f18-4c72-4ed4-a4db-faf6c374bd93 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:16.916057 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38585f18-4c72-4ed4-a4db-faf6c374bd93 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:16.916057 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38585f18-4c72-4ed4-a4db-faf6c374bd93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:16.948012 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-38585f18-4c72-4ed4-a4db-faf6c374bd93 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:16.949352 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-38585f18-4c72-4ed4-a4db-faf6c374bd93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:16.952759 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f2bcd8-9e20-4140-bec6-40023ea3a302 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:16.984053 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:16.995351 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553f8add-c87c-41d3-998b-5c8aa2252437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:16.996038 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553f8add-c87c-41d3-998b-5c8aa2252437 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:16.996316 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553f8add-c87c-41d3-998b-5c8aa2252437 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:16.996588 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553f8add-c87c-41d3-998b-5c8aa2252437 None admin] PATH_INFO: `/v3/groups/ec63d251566641e78099c5e20241448f` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:17.003947 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553f8add-c87c-41d3-998b-5c8aa2252437 None admin] RBAC: Authorizing `identity:get_group(group_id=ec63d251566641e78099c5e20241448f)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:17.005404 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553f8add-c87c-41d3-998b-5c8aa2252437 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:17.007436 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 199/380] 10.222.0.49 () {56 vars in 1180 bytes} [Thu Sep 29 01:58:16 2022] GET /identity/v3/groups/ec63d251566641e78099c5e20241448f => generated 229 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:17.012945 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553f8add-c87c-41d3-998b-5c8aa2252437 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:17.079967 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 182/381] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 29 01:58:17.124291 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553f8add-c87c-41d3-998b-5c8aa2252437 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:17.160630 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f845df9b-7b65-4da2-ab22-61a2ad8dc08c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:17.161248 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f845df9b-7b65-4da2-ab22-61a2ad8dc08c None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:17.161556 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f845df9b-7b65-4da2-ab22-61a2ad8dc08c None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:17.161830 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f845df9b-7b65-4da2-ab22-61a2ad8dc08c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:17.162549 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f845df9b-7b65-4da2-ab22-61a2ad8dc08c None admin] RBAC: Adding query filter params (group.id=ec63d251566641e78099c5e20241448f, role.id=fe9bbc67742f4f5893f39b18eb31d59a, scope.project.id=3a47c9ae604c439cb80f84e69bc4f995) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:17.162854 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f845df9b-7b65-4da2-ab22-61a2ad8dc08c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:17.164331 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f845df9b-7b65-4da2-ab22-61a2ad8dc08c None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:17.170478 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 200/382] 10.222.0.49 () {56 vars in 1376 bytes} [Thu Sep 29 01:58:17 2022] GET /identity/v3/role_assignments?group.id=ec63d251566641e78099c5e20241448f&scope.project.id=3a47c9ae604c439cb80f84e69bc4f995&role.id=fe9bbc67742f4f5893f39b18eb31d59a => generated 260 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:17.511371 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80466f5-9f41-42a3-83e1-3c09f11d74e2 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:17.511871 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80466f5-9f41-42a3-83e1-3c09f11d74e2 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:17.512391 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80466f5-9f41-42a3-83e1-3c09f11d74e2 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:17.514251 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 183/383] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:58:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:58:17.519827 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a19fe-dc64-48d2-9337-5ca29d424971 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:17.520384 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a19fe-dc64-48d2-9337-5ca29d424971 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:17.520864 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a19fe-dc64-48d2-9337-5ca29d424971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:17.543133 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80466f5-9f41-42a3-83e1-3c09f11d74e2 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:17.544378 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-493a19fe-dc64-48d2-9337-5ca29d424971 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:17.545610 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-493a19fe-dc64-48d2-9337-5ca29d424971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:17.637114 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:17.638174 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 201/384] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 29 01:58:17.692227 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:17.711517 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80466f5-9f41-42a3-83e1-3c09f11d74e2 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:17.759431 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f081914-1607-47e1-9b57-88ec5eb5e6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:17.760472 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f081914-1607-47e1-9b57-88ec5eb5e6d1 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:17.760966 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f081914-1607-47e1-9b57-88ec5eb5e6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:17.761518 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f081914-1607-47e1-9b57-88ec5eb5e6d1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:17.777041 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f081914-1607-47e1-9b57-88ec5eb5e6d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:58:17.782414 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-7f081914-1607-47e1-9b57-88ec5eb5e6d1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 29 01:58:17.782414 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:17.782414 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:17.782414 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:17.782414 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:17.782414 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:17.782414 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:17.782414 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:17.782414 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:17.782414 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:17.782414 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:17.782414 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:17.782414 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:58:17.782414 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:58:17.782414 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:58:17.782414 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:58:17.783823 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:58:17.783823 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:58:17.783823 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:58:17.783823 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:58:17.783823 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:17.783823 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:17.783823 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:17.783823 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:17.783823 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:17.783823 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:17.783823 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:17.783823 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:17.783823 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:17.783823 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:17.783823 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:17.783823 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:17.784614 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:17.784614 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:17.784614 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:17.784614 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:17.784614 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:58:17.784614 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:58:17.784614 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:58:17.784614 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:58:17.784614 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:58:17.784614 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:58:17.784614 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 29 01:58:17.784614 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:58:17.787192 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 184/385] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Sep 29 01:58:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 01:58:17.792870 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493a19fe-dc64-48d2-9337-5ca29d424971 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:17.917830 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493a19fe-dc64-48d2-9337-5ca29d424971 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:17.967308 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6105c9-159f-42b4-951c-c03c8c0ac4ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:17.967932 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6105c9-159f-42b4-951c-c03c8c0ac4ab None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:17.968209 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6105c9-159f-42b4-951c-c03c8c0ac4ab None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:17.968480 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6105c9-159f-42b4-951c-c03c8c0ac4ab None admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:17.969212 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6105c9-159f-42b4-951c-c03c8c0ac4ab None admin] RBAC: Adding query filter params (name=member) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:17.969539 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6105c9-159f-42b4-951c-c03c8c0ac4ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:17.971314 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6105c9-159f-42b4-951c-c03c8c0ac4ab None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:17.976763 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f081914-1607-47e1-9b57-88ec5eb5e6d1 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:17.982568 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 202/386] 10.222.0.49 () {56 vars in 1101 bytes} [Thu Sep 29 01:58:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:17.988726 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6105c9-159f-42b4-951c-c03c8c0ac4ab None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:18.069678 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:18.132237 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6105c9-159f-42b4-951c-c03c8c0ac4ab None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:18.156603 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f081914-1607-47e1-9b57-88ec5eb5e6d1 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:18.184664 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef4c115-9de4-4998-94f1-028ed070f6a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:18.185299 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef4c115-9de4-4998-94f1-028ed070f6a7 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:18.185590 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef4c115-9de4-4998-94f1-028ed070f6a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:18.185857 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef4c115-9de4-4998-94f1-028ed070f6a7 None admin] PATH_INFO: `/v3/groups/6702610c615b4999a7423f721152834f` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:18.190499 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef4c115-9de4-4998-94f1-028ed070f6a7 None admin] RBAC: Authorizing `identity:get_group(group_id=6702610c615b4999a7423f721152834f)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:18.192071 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef4c115-9de4-4998-94f1-028ed070f6a7 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:18.195508 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 203/387] 10.222.0.49 () {56 vars in 1180 bytes} [Thu Sep 29 01:58:17 2022] GET /identity/v3/groups/6702610c615b4999a7423f721152834f => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:58:18.196621 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e70808-7e99-401b-baba-469cb22b018b None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:18.196907 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e70808-7e99-401b-baba-469cb22b018b None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:18.197180 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e70808-7e99-401b-baba-469cb22b018b None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:18.202571 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 204/388] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:58:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:58:18.203860 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e70808-7e99-401b-baba-469cb22b018b None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:18.226180 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344b80bd-e5c7-4256-bbec-f5964d999b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:18.227099 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344b80bd-e5c7-4256-bbec-f5964d999b9e None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:18.227378 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344b80bd-e5c7-4256-bbec-f5964d999b9e None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:18.227646 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344b80bd-e5c7-4256-bbec-f5964d999b9e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:18.248385 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344b80bd-e5c7-4256-bbec-f5964d999b9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:58:18.256105 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-344b80bd-e5c7-4256-bbec-f5964d999b9e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 29 01:58:18.256105 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:18.256105 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:18.256105 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:18.256105 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:18.256105 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:18.256105 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:18.256105 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:18.256105 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:18.256105 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:18.256105 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:18.256105 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:18.256105 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:58:18.256105 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:58:18.256105 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:58:18.256105 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:58:18.256987 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:58:18.256987 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:58:18.256987 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:58:18.256987 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:58:18.256987 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:18.256987 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:18.256987 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:18.256987 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:18.256987 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:18.256987 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:18.256987 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:18.256987 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:18.256987 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:18.256987 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:18.256987 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:18.256987 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:18.257825 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:18.257825 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:18.257825 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:18.257825 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:18.257825 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:58:18.257825 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:58:18.257825 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:58:18.257825 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:58:18.257825 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:58:18.257825 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:58:18.257825 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 29 01:58:18.257825 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:58:18.259303 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 185/389] 10.222.0.49 () {56 vars in 1114 bytes} [Thu Sep 29 01:58:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:18.260237 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc31c329-b727-4561-a29b-85e65d08ba72 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:18.262392 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc31c329-b727-4561-a29b-85e65d08ba72 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:18.262392 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc31c329-b727-4561-a29b-85e65d08ba72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:18.278957 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:18.291176 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-fc31c329-b727-4561-a29b-85e65d08ba72 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:18.292170 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-fc31c329-b727-4561-a29b-85e65d08ba72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:18.354205 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e70808-7e99-401b-baba-469cb22b018b None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:18.368452 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 186/390] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:58:18.369334 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc31c329-b727-4561-a29b-85e65d08ba72 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:18.376543 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:18.402203 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf646ba-dc2a-42bc-a0e7-b95273e74294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:18.402903 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf646ba-dc2a-42bc-a0e7-b95273e74294 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:18.403375 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf646ba-dc2a-42bc-a0e7-b95273e74294 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:18.403488 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf646ba-dc2a-42bc-a0e7-b95273e74294 None admin] PATH_INFO: `/v3/projects/ca184432008d4efaa18beac740258875` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:18.404615 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf646ba-dc2a-42bc-a0e7-b95273e74294 None admin] RBAC: Authorizing `identity:get_project(project_id=ca184432008d4efaa18beac740258875)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:18.406207 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf646ba-dc2a-42bc-a0e7-b95273e74294 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:18.408789 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 205/391] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Sep 29 01:58:18 2022] GET /identity/v3/projects/ca184432008d4efaa18beac740258875 => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:58:18.416180 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf646ba-dc2a-42bc-a0e7-b95273e74294 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:18.500104 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc31c329-b727-4561-a29b-85e65d08ba72 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:18.549425 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf646ba-dc2a-42bc-a0e7-b95273e74294 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:18.562598 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0093580-f17b-47c0-8b6f-067e1a437968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:18.563218 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0093580-f17b-47c0-8b6f-067e1a437968 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:18.563495 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0093580-f17b-47c0-8b6f-067e1a437968 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:18.563765 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0093580-f17b-47c0-8b6f-067e1a437968 None admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:18.565000 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0093580-f17b-47c0-8b6f-067e1a437968 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:18.565634 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0093580-f17b-47c0-8b6f-067e1a437968 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:18.567371 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0093580-f17b-47c0-8b6f-067e1a437968 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:18.569650 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:18.586197 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 187/392] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Sep 29 01:58:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:18.593497 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0093580-f17b-47c0-8b6f-067e1a437968 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:18.628956 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf15d25-a2fa-4f9f-bf9f-26b596a79ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:18.629636 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf15d25-a2fa-4f9f-bf9f-26b596a79ae9 None admin] REQUEST_METHOD: `PUT` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:18.629917 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf15d25-a2fa-4f9f-bf9f-26b596a79ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:18.630190 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf15d25-a2fa-4f9f-bf9f-26b596a79ae9 None admin] PATH_INFO: `/v3/projects/ca184432008d4efaa18beac740258875/groups/6702610c615b4999a7423f721152834f/roles/f157f905c9c94ccfbfb46e52d443e8f2` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:18.633541 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf15d25-a2fa-4f9f-bf9f-26b596a79ae9 None admin] RBAC: Authorizing `identity:create_grant(project_id=ca184432008d4efaa18beac740258875, group_id=6702610c615b4999a7423f721152834f, role_id=f157f905c9c94ccfbfb46e52d443e8f2)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:18.635068 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf15d25-a2fa-4f9f-bf9f-26b596a79ae9 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:18.661472 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 206/393] 10.222.0.49 () {58 vars in 1442 bytes} [Thu Sep 29 01:58:18 2022] PUT /identity/v3/projects/ca184432008d4efaa18beac740258875/groups/6702610c615b4999a7423f721152834f/roles/f157f905c9c94ccfbfb46e52d443e8f2 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 01:58:18.748492 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf15d25-a2fa-4f9f-bf9f-26b596a79ae9 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:18.749255 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0093580-f17b-47c0-8b6f-067e1a437968 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:18.826888 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf1ffad-340a-454f-a45a-04c03e4f9a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:18.827937 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf1ffad-340a-454f-a45a-04c03e4f9a9e None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:18.828420 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf1ffad-340a-454f-a45a-04c03e4f9a9e None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:18.828887 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf1ffad-340a-454f-a45a-04c03e4f9a9e None admin] PATH_INFO: `/v3/groups/6702610c615b4999a7423f721152834f` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:18.831052 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf1ffad-340a-454f-a45a-04c03e4f9a9e None admin] RBAC: Authorizing `identity:get_group(group_id=6702610c615b4999a7423f721152834f)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:18.832745 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf1ffad-340a-454f-a45a-04c03e4f9a9e None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:18.834716 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 188/394] 10.222.0.49 () {56 vars in 1180 bytes} [Thu Sep 29 01:58:18 2022] GET /identity/v3/groups/6702610c615b4999a7423f721152834f => generated 226 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:18.840860 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf1ffad-340a-454f-a45a-04c03e4f9a9e None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:18.846576 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:18.959934 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf15d25-a2fa-4f9f-bf9f-26b596a79ae9 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:18.970591 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:19.014647 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ac0efc-31f2-4a21-8aea-677d8c64a0fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:19.015541 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ac0efc-31f2-4a21-8aea-677d8c64a0fe None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:19.015896 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ac0efc-31f2-4a21-8aea-677d8c64a0fe None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:19.016245 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ac0efc-31f2-4a21-8aea-677d8c64a0fe None admin] PATH_INFO: `/v3/roles/member` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:19.030327 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ac0efc-31f2-4a21-8aea-677d8c64a0fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:58:19.036800 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf1ffad-340a-454f-a45a-04c03e4f9a9e None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:19.036959 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-79ac0efc-31f2-4a21-8aea-677d8c64a0fe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 29 01:58:19.036959 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:19.036959 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:19.036959 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:19.036959 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:19.036959 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:19.036959 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:19.036959 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:19.036959 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:19.036959 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:19.036959 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:19.036959 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:19.036959 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:58:19.036959 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:58:19.036959 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:58:19.036959 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:58:19.037811 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:58:19.037811 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:58:19.037811 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:58:19.037811 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:58:19.037811 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:19.037811 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:19.037811 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:19.037811 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:19.037811 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:19.037811 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:19.037811 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:19.037811 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:19.037811 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:19.037811 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:19.037811 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:19.037811 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:19.038673 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:19.038673 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:19.038673 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:19.038673 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:19.038673 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:58:19.038673 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:58:19.038673 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:58:19.038673 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:58:19.038673 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:58:19.038673 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:58:19.038673 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 29 01:58:19.038673 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:58:19.038673 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 207/395] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Sep 29 01:58:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 01:58:19.045756 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ac0efc-31f2-4a21-8aea-677d8c64a0fe None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:19.098607 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f777efeb-cb0b-474e-a9b1-77fc5288409e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:19.099261 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f777efeb-cb0b-474e-a9b1-77fc5288409e None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:19.099535 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f777efeb-cb0b-474e-a9b1-77fc5288409e None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:19.099802 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f777efeb-cb0b-474e-a9b1-77fc5288409e None admin] PATH_INFO: `/v3/projects/ca184432008d4efaa18beac740258875` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:19.101003 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f777efeb-cb0b-474e-a9b1-77fc5288409e None admin] RBAC: Authorizing `identity:get_project(project_id=ca184432008d4efaa18beac740258875)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:19.102509 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f777efeb-cb0b-474e-a9b1-77fc5288409e None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:19.104476 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 189/396] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Sep 29 01:58:18 2022] GET /identity/v3/projects/ca184432008d4efaa18beac740258875 => generated 298 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:19.110177 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f777efeb-cb0b-474e-a9b1-77fc5288409e None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:19.168949 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ac0efc-31f2-4a21-8aea-677d8c64a0fe None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:19.171837 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:19.211557 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd4df28-205a-4e9e-a5b6-59668c62b08a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:19.212181 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd4df28-205a-4e9e-a5b6-59668c62b08a None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:19.212466 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd4df28-205a-4e9e-a5b6-59668c62b08a None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:19.212744 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd4df28-205a-4e9e-a5b6-59668c62b08a None admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:19.213455 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd4df28-205a-4e9e-a5b6-59668c62b08a None admin] RBAC: Adding query filter params (name=member) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:19.213812 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd4df28-205a-4e9e-a5b6-59668c62b08a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:19.215732 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd4df28-205a-4e9e-a5b6-59668c62b08a None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:19.226264 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 208/397] 10.222.0.49 () {56 vars in 1101 bytes} [Thu Sep 29 01:58:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:19.231844 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd4df28-205a-4e9e-a5b6-59668c62b08a None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:19.308538 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f777efeb-cb0b-474e-a9b1-77fc5288409e None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:19.343628 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:19.356586 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e4a555-474e-4cd2-9d8a-f36795b83263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:19.357260 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e4a555-474e-4cd2-9d8a-f36795b83263 None admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:19.357554 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e4a555-474e-4cd2-9d8a-f36795b83263 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:19.357827 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e4a555-474e-4cd2-9d8a-f36795b83263 None admin] PATH_INFO: `/v3/projects/ca184432008d4efaa18beac740258875/groups/6702610c615b4999a7423f721152834f/roles/8de931d79c9d4c8daf717aaea348dda9` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:19.360001 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e4a555-474e-4cd2-9d8a-f36795b83263 None admin] RBAC: Authorizing `identity:create_grant(project_id=ca184432008d4efaa18beac740258875, group_id=6702610c615b4999a7423f721152834f, role_id=8de931d79c9d4c8daf717aaea348dda9)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:19.361731 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e4a555-474e-4cd2-9d8a-f36795b83263 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:19.382365 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 190/398] 10.222.0.49 () {58 vars in 1442 bytes} [Thu Sep 29 01:58:19 2022] PUT /identity/v3/projects/ca184432008d4efaa18beac740258875/groups/6702610c615b4999a7423f721152834f/roles/8de931d79c9d4c8daf717aaea348dda9 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 01:58:19.432818 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd4df28-205a-4e9e-a5b6-59668c62b08a None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:19.484790 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88d0ae3-ec0a-48ff-96d1-0582e46c30fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:19.485470 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88d0ae3-ec0a-48ff-96d1-0582e46c30fe None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:19.485751 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88d0ae3-ec0a-48ff-96d1-0582e46c30fe None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:19.486139 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88d0ae3-ec0a-48ff-96d1-0582e46c30fe None admin] PATH_INFO: `/v3/groups/6702610c615b4999a7423f721152834f` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:19.490182 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88d0ae3-ec0a-48ff-96d1-0582e46c30fe None admin] RBAC: Authorizing `identity:get_group(group_id=6702610c615b4999a7423f721152834f)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:19.491752 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88d0ae3-ec0a-48ff-96d1-0582e46c30fe None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:19.493910 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 209/399] 10.222.0.49 () {56 vars in 1180 bytes} [Thu Sep 29 01:58:19 2022] GET /identity/v3/groups/6702610c615b4999a7423f721152834f => generated 226 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:19.499573 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e4a555-474e-4cd2-9d8a-f36795b83263 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:19.641681 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e4a555-474e-4cd2-9d8a-f36795b83263 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:19.682660 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78450ec4-f6d5-4b5b-823f-d0716eadad07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:19.683376 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78450ec4-f6d5-4b5b-823f-d0716eadad07 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:19.683593 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78450ec4-f6d5-4b5b-823f-d0716eadad07 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:19.683862 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78450ec4-f6d5-4b5b-823f-d0716eadad07 None admin] PATH_INFO: `/v3/projects/7ed8ec70d1f649c6b36156f0f44f2271` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:19.685082 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78450ec4-f6d5-4b5b-823f-d0716eadad07 None admin] RBAC: Authorizing `identity:get_project(project_id=7ed8ec70d1f649c6b36156f0f44f2271)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:19.686602 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78450ec4-f6d5-4b5b-823f-d0716eadad07 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:19.688732 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 191/400] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Sep 29 01:58:19 2022] GET /identity/v3/projects/7ed8ec70d1f649c6b36156f0f44f2271 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:19.694558 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88d0ae3-ec0a-48ff-96d1-0582e46c30fe None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:19.746268 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:19.839570 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88d0ae3-ec0a-48ff-96d1-0582e46c30fe None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:19.862272 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04af3dd-9814-4a47-a186-a25b938913c0 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:19.862776 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04af3dd-9814-4a47-a186-a25b938913c0 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:19.862882 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04af3dd-9814-4a47-a186-a25b938913c0 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:19.864309 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 192/401] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:58:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:58:19.873361 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c03c5-4afb-47a1-be5f-6b183d48dc32 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:19.873361 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c03c5-4afb-47a1-be5f-6b183d48dc32 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:19.873361 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c03c5-4afb-47a1-be5f-6b183d48dc32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:19.894423 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-307c03c5-4afb-47a1-be5f-6b183d48dc32 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:19.895954 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f88837d-a919-4a1d-9060-67ac047dac0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:19.896301 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-307c03c5-4afb-47a1-be5f-6b183d48dc32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:19.896633 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88837d-a919-4a1d-9060-67ac047dac0a None admin] REQUEST_METHOD: `PUT` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:19.896932 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88837d-a919-4a1d-9060-67ac047dac0a None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:19.897205 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88837d-a919-4a1d-9060-67ac047dac0a None admin] PATH_INFO: `/v3/projects/7ed8ec70d1f649c6b36156f0f44f2271/groups/6702610c615b4999a7423f721152834f/roles/f157f905c9c94ccfbfb46e52d443e8f2` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:19.903525 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f88837d-a919-4a1d-9060-67ac047dac0a None admin] RBAC: Authorizing `identity:create_grant(project_id=7ed8ec70d1f649c6b36156f0f44f2271, group_id=6702610c615b4999a7423f721152834f, role_id=f157f905c9c94ccfbfb46e52d443e8f2)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:19.905106 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f88837d-a919-4a1d-9060-67ac047dac0a None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:19.929586 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 210/402] 10.222.0.49 () {58 vars in 1442 bytes} [Thu Sep 29 01:58:19 2022] PUT /identity/v3/projects/7ed8ec70d1f649c6b36156f0f44f2271/groups/6702610c615b4999a7423f721152834f/roles/f157f905c9c94ccfbfb46e52d443e8f2 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 01:58:19.944726 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fdb860-544a-44c9-a9af-dc383758a469 None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:19.944911 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fdb860-544a-44c9-a9af-dc383758a469 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:19.945194 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fdb860-544a-44c9-a9af-dc383758a469 None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:19.947036 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 211/403] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:58:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:58:19.952261 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff98fc93-c5ad-4bf0-bbc9-c2e84fe6e02d None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:19.952643 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff98fc93-c5ad-4bf0-bbc9-c2e84fe6e02d None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:19.952901 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff98fc93-c5ad-4bf0-bbc9-c2e84fe6e02d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:19.983918 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-ff98fc93-c5ad-4bf0-bbc9-c2e84fe6e02d None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:19.986647 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-ff98fc93-c5ad-4bf0-bbc9-c2e84fe6e02d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:20.036760 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:20.064564 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 193/404] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 29 01:58:20.087742 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 212/405] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 29 01:58:20.369462 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307c03c5-4afb-47a1-be5f-6b183d48dc32 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:20.394908 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff98fc93-c5ad-4bf0-bbc9-c2e84fe6e02d None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:20.451438 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:20.528824 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307c03c5-4afb-47a1-be5f-6b183d48dc32 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:20.578404 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173d3d1b-53c5-4da8-8d67-e10831bfc0e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:20.579422 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d3d1b-53c5-4da8-8d67-e10831bfc0e0 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:20.581449 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d3d1b-53c5-4da8-8d67-e10831bfc0e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:20.581920 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d3d1b-53c5-4da8-8d67-e10831bfc0e0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:20.604556 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173d3d1b-53c5-4da8-8d67-e10831bfc0e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:58:20.609816 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-173d3d1b-53c5-4da8-8d67-e10831bfc0e0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 29 01:58:20.609816 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:20.609816 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:20.609816 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:20.609816 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:20.609816 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:20.609816 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:20.609816 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:20.609816 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:20.609816 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:20.609816 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:20.609816 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:20.609816 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:58:20.609816 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:58:20.609816 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:58:20.609816 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:58:20.610657 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:58:20.610657 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:58:20.610657 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:58:20.610657 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:58:20.610657 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:20.610657 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:20.610657 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:20.610657 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:20.610657 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:20.610657 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:20.610657 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:20.610657 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:20.610657 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:20.610657 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:20.610657 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:20.610657 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:20.611494 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:20.611494 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:20.611494 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:20.611494 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:20.611494 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:58:20.611494 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:58:20.611494 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:58:20.611494 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:58:20.611494 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:58:20.611494 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:58:20.611494 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 29 01:58:20.611494 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:58:20.614404 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 194/406] 10.222.0.49 () {56 vars in 1114 bytes} [Thu Sep 29 01:58:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:20.618508 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff98fc93-c5ad-4bf0-bbc9-c2e84fe6e02d None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:20.619910 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173d3d1b-53c5-4da8-8d67-e10831bfc0e0 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:20.655239 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e0e532-6ac4-4873-9e41-2639278951fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:20.656228 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e0e532-6ac4-4873-9e41-2639278951fb None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:20.656698 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e0e532-6ac4-4873-9e41-2639278951fb None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:20.657160 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e0e532-6ac4-4873-9e41-2639278951fb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:20.668626 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e0e532-6ac4-4873-9e41-2639278951fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:58:20.673924 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-04e0e532-6ac4-4873-9e41-2639278951fb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 01:58:20.673924 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:20.673924 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:20.673924 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:20.673924 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:20.673924 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:20.673924 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:20.673924 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:20.673924 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:20.673924 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:20.673924 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:20.673924 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:20.673924 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:58:20.673924 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:58:20.673924 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:58:20.673924 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:58:20.674782 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:58:20.674782 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:58:20.674782 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:58:20.674782 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:58:20.674782 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:20.674782 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:20.674782 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:20.674782 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:20.674782 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:20.674782 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:20.674782 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:20.674782 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:20.674782 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:20.674782 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:20.674782 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:20.674782 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:20.675566 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:20.675566 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:20.675566 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:20.675566 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:20.675566 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:58:20.675566 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:58:20.675566 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:58:20.675566 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:58:20.675566 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:58:20.675566 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:58:20.675566 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 01:58:20.675566 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:58:20.678115 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 213/407] 10.222.0.49 () {56 vars in 1096 bytes} [Thu Sep 29 01:58:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 01:58:20.685349 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e0e532-6ac4-4873-9e41-2639278951fb None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:20.713565 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:20.791570 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173d3d1b-53c5-4da8-8d67-e10831bfc0e0 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:20.844637 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eb27e8-4dad-42ea-aa99-b9ef0a62808a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:20.845790 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb27e8-4dad-42ea-aa99-b9ef0a62808a None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:20.846103 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb27e8-4dad-42ea-aa99-b9ef0a62808a None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:20.846602 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb27e8-4dad-42ea-aa99-b9ef0a62808a None admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:20.847468 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eb27e8-4dad-42ea-aa99-b9ef0a62808a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:20.847781 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eb27e8-4dad-42ea-aa99-b9ef0a62808a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:20.849459 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eb27e8-4dad-42ea-aa99-b9ef0a62808a None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:20.863194 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:20.869744 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 195/408] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Sep 29 01:58:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:20.879577 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eb27e8-4dad-42ea-aa99-b9ef0a62808a None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:20.911423 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e0e532-6ac4-4873-9e41-2639278951fb None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:20.989117 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eb27e8-4dad-42ea-aa99-b9ef0a62808a None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:20.990046 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9524d3-bccd-448b-9344-0e2d4f52bba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:20.990685 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9524d3-bccd-448b-9344-0e2d4f52bba3 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:20.990965 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9524d3-bccd-448b-9344-0e2d4f52bba3 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:20.991234 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9524d3-bccd-448b-9344-0e2d4f52bba3 None admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:20.991914 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9524d3-bccd-448b-9344-0e2d4f52bba3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:20.992215 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9524d3-bccd-448b-9344-0e2d4f52bba3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:20.993631 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9524d3-bccd-448b-9344-0e2d4f52bba3 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:21.005861 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:21.009296 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 214/409] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Sep 29 01:58:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:21.014761 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9524d3-bccd-448b-9344-0e2d4f52bba3 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:21.028632 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f48986-4470-45b9-8041-907c1654d8d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:21.029271 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f48986-4470-45b9-8041-907c1654d8d3 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:21.029576 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f48986-4470-45b9-8041-907c1654d8d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:21.029848 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f48986-4470-45b9-8041-907c1654d8d3 None admin] PATH_INFO: `/v3/groups/6702610c615b4999a7423f721152834f` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:21.031324 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f48986-4470-45b9-8041-907c1654d8d3 None admin] RBAC: Authorizing `identity:get_group(group_id=6702610c615b4999a7423f721152834f)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:21.032790 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f48986-4470-45b9-8041-907c1654d8d3 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:21.037011 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 196/410] 10.222.0.49 () {56 vars in 1180 bytes} [Thu Sep 29 01:58:20 2022] GET /identity/v3/groups/6702610c615b4999a7423f721152834f => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:21.044714 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f48986-4470-45b9-8041-907c1654d8d3 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:21.226494 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9524d3-bccd-448b-9344-0e2d4f52bba3 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:21.233042 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f48986-4470-45b9-8041-907c1654d8d3 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:21.265554 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fd8e51-79f4-4dc6-9245-61c1b9f9b1a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:21.266337 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fd8e51-79f4-4dc6-9245-61c1b9f9b1a4 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:21.266752 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fd8e51-79f4-4dc6-9245-61c1b9f9b1a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:21.267035 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fd8e51-79f4-4dc6-9245-61c1b9f9b1a4 None admin] PATH_INFO: `/v3/groups/ec63d251566641e78099c5e20241448f` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:21.269251 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fd8e51-79f4-4dc6-9245-61c1b9f9b1a4 None admin] RBAC: Authorizing `identity:get_group(group_id=ec63d251566641e78099c5e20241448f)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:21.270742 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fd8e51-79f4-4dc6-9245-61c1b9f9b1a4 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:21.272528 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 215/411] 10.222.0.49 () {56 vars in 1180 bytes} [Thu Sep 29 01:58:21 2022] GET /identity/v3/groups/ec63d251566641e78099c5e20241448f => generated 229 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:58:21.277659 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fd8e51-79f4-4dc6-9245-61c1b9f9b1a4 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:21.303900 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7187bc5e-689e-4b34-a0f8-f268eea99891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:21.304538 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187bc5e-689e-4b34-a0f8-f268eea99891 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:21.304818 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187bc5e-689e-4b34-a0f8-f268eea99891 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:21.305094 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187bc5e-689e-4b34-a0f8-f268eea99891 None admin] PATH_INFO: `/v3/projects/7ed8ec70d1f649c6b36156f0f44f2271` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:21.306385 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7187bc5e-689e-4b34-a0f8-f268eea99891 None admin] RBAC: Authorizing `identity:get_project(project_id=7ed8ec70d1f649c6b36156f0f44f2271)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:21.307828 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7187bc5e-689e-4b34-a0f8-f268eea99891 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:21.310950 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:21.316457 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 197/412] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Sep 29 01:58:21 2022] GET /identity/v3/projects/7ed8ec70d1f649c6b36156f0f44f2271 => generated 302 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:58:21.323268 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7187bc5e-689e-4b34-a0f8-f268eea99891 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:21.384647 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:21.473705 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fd8e51-79f4-4dc6-9245-61c1b9f9b1a4 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:21.507624 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7187bc5e-689e-4b34-a0f8-f268eea99891 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:21.526611 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc9d898-8170-41d4-b7ae-229ea624bb7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:21.527264 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc9d898-8170-41d4-b7ae-229ea624bb7f None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:21.527546 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc9d898-8170-41d4-b7ae-229ea624bb7f None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:21.527821 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc9d898-8170-41d4-b7ae-229ea624bb7f None admin] PATH_INFO: `/v3/projects/3a47c9ae604c439cb80f84e69bc4f995` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:21.534062 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc9d898-8170-41d4-b7ae-229ea624bb7f None admin] RBAC: Authorizing `identity:get_project(project_id=3a47c9ae604c439cb80f84e69bc4f995)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:21.535527 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc9d898-8170-41d4-b7ae-229ea624bb7f None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:21.537413 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 216/413] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Sep 29 01:58:21 2022] GET /identity/v3/projects/3a47c9ae604c439cb80f84e69bc4f995 => generated 344 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:58:21.547629 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc9d898-8170-41d4-b7ae-229ea624bb7f None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:21.551177 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ebc30c-9d3d-4ff5-a119-fac4ce62fd28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:21.551913 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ebc30c-9d3d-4ff5-a119-fac4ce62fd28 None admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:21.552193 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ebc30c-9d3d-4ff5-a119-fac4ce62fd28 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:21.552465 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ebc30c-9d3d-4ff5-a119-fac4ce62fd28 None admin] PATH_INFO: `/v3/projects/7ed8ec70d1f649c6b36156f0f44f2271/groups/6702610c615b4999a7423f721152834f/roles/8de931d79c9d4c8daf717aaea348dda9` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:21.555761 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ebc30c-9d3d-4ff5-a119-fac4ce62fd28 None admin] RBAC: Authorizing `identity:create_grant(project_id=7ed8ec70d1f649c6b36156f0f44f2271, group_id=6702610c615b4999a7423f721152834f, role_id=8de931d79c9d4c8daf717aaea348dda9)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:21.557413 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ebc30c-9d3d-4ff5-a119-fac4ce62fd28 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:21.572948 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 198/414] 10.222.0.49 () {58 vars in 1442 bytes} [Thu Sep 29 01:58:21 2022] PUT /identity/v3/projects/7ed8ec70d1f649c6b36156f0f44f2271/groups/6702610c615b4999a7423f721152834f/roles/8de931d79c9d4c8daf717aaea348dda9 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 01:58:21.602549 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae37c542-fb54-4e95-a3a8-fda8a771d32a None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:21.602863 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae37c542-fb54-4e95-a3a8-fda8a771d32a None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:21.603105 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae37c542-fb54-4e95-a3a8-fda8a771d32a None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:21.604704 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 199/415] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:58:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:58:21.613637 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98c1e45-4d4a-4731-9e5e-a8c2a3eff17b None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:21.613936 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98c1e45-4d4a-4731-9e5e-a8c2a3eff17b None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:21.614248 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98c1e45-4d4a-4731-9e5e-a8c2a3eff17b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:21.654512 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-c98c1e45-4d4a-4731-9e5e-a8c2a3eff17b None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:21.654733 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:21.656060 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-c98c1e45-4d4a-4731-9e5e-a8c2a3eff17b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:21.676270 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc9d898-8170-41d4-b7ae-229ea624bb7f None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:21.716713 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fad7667-f69c-4866-8279-b9649e920061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:21.717970 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad7667-f69c-4866-8279-b9649e920061 None admin] REQUEST_METHOD: `PUT` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:21.719752 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad7667-f69c-4866-8279-b9649e920061 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:21.720279 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad7667-f69c-4866-8279-b9649e920061 None admin] PATH_INFO: `/v3/projects/3a47c9ae604c439cb80f84e69bc4f995/groups/ec63d251566641e78099c5e20241448f/roles/fe9bbc67742f4f5893f39b18eb31d59a` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:21.724090 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fad7667-f69c-4866-8279-b9649e920061 None admin] RBAC: Authorizing `identity:create_grant(project_id=3a47c9ae604c439cb80f84e69bc4f995, group_id=ec63d251566641e78099c5e20241448f, role_id=fe9bbc67742f4f5893f39b18eb31d59a)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:21.726660 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fad7667-f69c-4866-8279-b9649e920061 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:21.751462 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 217/416] 10.222.0.49 () {58 vars in 1442 bytes} [Thu Sep 29 01:58:21 2022] PUT /identity/v3/projects/3a47c9ae604c439cb80f84e69bc4f995/groups/ec63d251566641e78099c5e20241448f/roles/fe9bbc67742f4f5893f39b18eb31d59a => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 01:58:21.780277 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 200/417] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 29 01:58:22.116440 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fad7667-f69c-4866-8279-b9649e920061 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:22.243142 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d1fed2-3a8e-40fc-b7c3-b80cff859648 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:22.243679 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d1fed2-3a8e-40fc-b7c3-b80cff859648 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:22.243679 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d1fed2-3a8e-40fc-b7c3-b80cff859648 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:22.245017 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 201/418] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:58:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 29 01:58:22.247176 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fad7667-f69c-4866-8279-b9649e920061 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:22.253334 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b4d42d-a3f5-4214-9a61-6ef7a8e4b56c None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:22.253334 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b4d42d-a3f5-4214-9a61-6ef7a8e4b56c None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:22.253334 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b4d42d-a3f5-4214-9a61-6ef7a8e4b56c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:22.285350 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-c6b4d42d-a3f5-4214-9a61-6ef7a8e4b56c None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:22.285350 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-c6b4d42d-a3f5-4214-9a61-6ef7a8e4b56c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:22.307906 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d40e5a9-807e-4a5a-8ebe-67b6c9cf09b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:22.308585 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d40e5a9-807e-4a5a-8ebe-67b6c9cf09b5 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:22.308873 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d40e5a9-807e-4a5a-8ebe-67b6c9cf09b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:22.309152 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d40e5a9-807e-4a5a-8ebe-67b6c9cf09b5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:22.318460 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:22.340709 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d40e5a9-807e-4a5a-8ebe-67b6c9cf09b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:58:22.347016 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-2d40e5a9-807e-4a5a-8ebe-67b6c9cf09b5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 29 01:58:22.347016 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:22.347016 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:22.347016 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:22.347016 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:22.347016 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:22.347016 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:22.347016 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:22.347016 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:22.347016 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:22.347016 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:22.347016 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:22.347016 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:58:22.347016 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:58:22.347016 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:58:22.347016 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:58:22.347886 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:58:22.347886 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:58:22.347886 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:58:22.347886 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:58:22.347886 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:22.347886 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:22.347886 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:22.347886 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:22.347886 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:22.347886 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:22.347886 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:22.347886 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:22.347886 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:22.347886 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:22.347886 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:22.347886 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:22.349008 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:22.349008 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:22.349008 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:22.349008 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:22.349008 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:58:22.349008 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:58:22.349008 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:58:22.349008 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:58:22.349008 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:58:22.349008 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:58:22.349008 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 29 01:58:22.349008 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:58:22.349008 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 218/419] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Sep 29 01:58:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:22.358144 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d40e5a9-807e-4a5a-8ebe-67b6c9cf09b5 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:22.377379 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:22.419798 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 202/420] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 29 01:58:22.480413 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d40e5a9-807e-4a5a-8ebe-67b6c9cf09b5 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:22.511500 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb8bd2-8ce4-4c93-a5b0-868fdcd3f4b0 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:22.511819 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb8bd2-8ce4-4c93-a5b0-868fdcd3f4b0 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:22.512047 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb8bd2-8ce4-4c93-a5b0-868fdcd3f4b0 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:22.514070 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 203/421] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:58:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:58:22.520010 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ecf2b8-3876-422d-90c9-2fb4a89cb64b None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:22.520292 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ecf2b8-3876-422d-90c9-2fb4a89cb64b None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:22.520554 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ecf2b8-3876-422d-90c9-2fb4a89cb64b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:22.523953 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6b295f-5b71-44a3-965c-3578824c42c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:22.524574 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b295f-5b71-44a3-965c-3578824c42c7 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:22.524853 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b295f-5b71-44a3-965c-3578824c42c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:22.525227 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b295f-5b71-44a3-965c-3578824c42c7 None admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:22.525812 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6b295f-5b71-44a3-965c-3578824c42c7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:22.526114 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6b295f-5b71-44a3-965c-3578824c42c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:22.527484 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6b295f-5b71-44a3-965c-3578824c42c7 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:22.541704 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-82ecf2b8-3876-422d-90c9-2fb4a89cb64b None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:22.543170 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-82ecf2b8-3876-422d-90c9-2fb4a89cb64b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:22.543901 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 219/422] 10.222.0.49 () {56 vars in 1101 bytes} [Thu Sep 29 01:58:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:22.552929 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6b295f-5b71-44a3-965c-3578824c42c7 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:22.643706 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 204/423] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 29 01:58:22.683122 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:22.730854 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6b295f-5b71-44a3-965c-3578824c42c7 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:22.778704 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84a25b8-3531-4e27-ba37-8fc20295bb28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:22.779323 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a25b8-3531-4e27-ba37-8fc20295bb28 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:22.779596 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a25b8-3531-4e27-ba37-8fc20295bb28 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:22.779862 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a25b8-3531-4e27-ba37-8fc20295bb28 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:22.846387 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ecf2b8-3876-422d-90c9-2fb4a89cb64b None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:22.883870 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84a25b8-3531-4e27-ba37-8fc20295bb28 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:22.885344 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84a25b8-3531-4e27-ba37-8fc20295bb28 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:23.006305 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:23.017420 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:23.023189 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ecf2b8-3876-422d-90c9-2fb4a89cb64b None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:23.058665 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 220/424] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Sep 29 01:58:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 29 01:58:23.059579 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84a25b8-3531-4e27-ba37-8fc20295bb28 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:23.066387 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32060b99-bbb3-4036-a860-84a5189fa3c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:23.067124 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32060b99-bbb3-4036-a860-84a5189fa3c7 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:23.067462 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32060b99-bbb3-4036-a860-84a5189fa3c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:23.067742 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32060b99-bbb3-4036-a860-84a5189fa3c7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:23.078501 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32060b99-bbb3-4036-a860-84a5189fa3c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:58:23.083999 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-32060b99-bbb3-4036-a860-84a5189fa3c7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 29 01:58:23.083999 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:23.083999 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:23.083999 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:23.083999 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:23.083999 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:23.083999 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:23.083999 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:23.083999 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:23.083999 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:23.083999 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:23.083999 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:23.083999 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:58:23.083999 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:58:23.083999 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:58:23.083999 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:58:23.084856 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:58:23.084856 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:58:23.084856 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:58:23.084856 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:58:23.084856 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:23.084856 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:23.084856 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:23.084856 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:23.084856 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:23.084856 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:23.084856 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:23.084856 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:23.084856 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:23.084856 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:23.084856 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:23.084856 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:23.085657 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:23.085657 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:23.085657 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:23.085657 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:23.085657 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:58:23.085657 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:58:23.085657 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:58:23.085657 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:58:23.085657 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:58:23.085657 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:58:23.085657 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 29 01:58:23.085657 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:58:23.085657 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 205/425] 10.222.0.49 () {56 vars in 1114 bytes} [Thu Sep 29 01:58:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 01:58:23.086304 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32060b99-bbb3-4036-a860-84a5189fa3c7 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:23.183756 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84a25b8-3531-4e27-ba37-8fc20295bb28 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:23.211131 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32060b99-bbb3-4036-a860-84a5189fa3c7 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:23.229110 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157287d6-d0e1-4fb5-9157-e9ce8eb4fc87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:23.230017 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157287d6-d0e1-4fb5-9157-e9ce8eb4fc87 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:23.230291 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157287d6-d0e1-4fb5-9157-e9ce8eb4fc87 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:23.230941 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157287d6-d0e1-4fb5-9157-e9ce8eb4fc87 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:23.245888 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157287d6-d0e1-4fb5-9157-e9ce8eb4fc87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:58:23.248782 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957dd23a-fda2-4278-b140-1c7a971ec0a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:23.249483 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957dd23a-fda2-4278-b140-1c7a971ec0a4 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:23.249769 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957dd23a-fda2-4278-b140-1c7a971ec0a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:23.250042 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957dd23a-fda2-4278-b140-1c7a971ec0a4 None admin] PATH_INFO: `/v3/projects/ca184432008d4efaa18beac740258875` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:23.250944 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-157287d6-d0e1-4fb5-9157-e9ce8eb4fc87 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 29 01:58:23.250944 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:23.250944 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:23.250944 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:23.250944 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:23.250944 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:23.250944 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:23.250944 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:23.250944 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:23.250944 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:23.250944 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:23.250944 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:23.250944 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:58:23.250944 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:58:23.250944 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:58:23.250944 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:58:23.253477 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:58:23.253477 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:58:23.253477 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:58:23.253477 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:58:23.253477 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:23.253477 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:23.253477 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:23.253477 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:23.253477 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:23.253477 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:23.253477 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:23.253477 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:23.253477 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:23.253477 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:23.253477 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:23.253477 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:23.254532 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:23.254532 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:23.254532 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:23.254532 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:23.254532 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:58:23.254532 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:58:23.254532 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:58:23.254532 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:58:23.254532 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:58:23.254532 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:58:23.254532 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 29 01:58:23.254532 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:58:23.255329 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957dd23a-fda2-4278-b140-1c7a971ec0a4 None admin] RBAC: Authorizing `identity:get_project(project_id=ca184432008d4efaa18beac740258875)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:23.255423 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 221/426] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Sep 29 01:58:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:23.255423 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157287d6-d0e1-4fb5-9157-e9ce8eb4fc87 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:23.261350 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957dd23a-fda2-4278-b140-1c7a971ec0a4 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:23.261350 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 206/427] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Sep 29 01:58:23 2022] GET /identity/v3/projects/ca184432008d4efaa18beac740258875 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:23.261350 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957dd23a-fda2-4278-b140-1c7a971ec0a4 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:23.287968 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:23.294936 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:23.379629 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957dd23a-fda2-4278-b140-1c7a971ec0a4 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:23.380921 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157287d6-d0e1-4fb5-9157-e9ce8eb4fc87 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:23.417600 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d9dca5-f6d9-48e9-8500-4d38fa01fb33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:23.418302 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d9dca5-f6d9-48e9-8500-4d38fa01fb33 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:23.418586 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d9dca5-f6d9-48e9-8500-4d38fa01fb33 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:23.418873 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d9dca5-f6d9-48e9-8500-4d38fa01fb33 None admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:23.419575 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d9dca5-f6d9-48e9-8500-4d38fa01fb33 None admin] RBAC: Adding query filter params (name=member) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:23.419880 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d9dca5-f6d9-48e9-8500-4d38fa01fb33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:23.421386 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d9dca5-f6d9-48e9-8500-4d38fa01fb33 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:23.424464 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab5f780-5a3b-4018-b276-08bb3b215f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:23.425593 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab5f780-5a3b-4018-b276-08bb3b215f54 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:23.426013 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab5f780-5a3b-4018-b276-08bb3b215f54 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:23.426437 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab5f780-5a3b-4018-b276-08bb3b215f54 None admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:23.427229 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab5f780-5a3b-4018-b276-08bb3b215f54 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:23.427753 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab5f780-5a3b-4018-b276-08bb3b215f54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:23.430026 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab5f780-5a3b-4018-b276-08bb3b215f54 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:23.436511 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 207/428] 10.222.0.49 () {56 vars in 1101 bytes} [Thu Sep 29 01:58:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:23.437538 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d9dca5-f6d9-48e9-8500-4d38fa01fb33 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:23.440142 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 222/429] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Sep 29 01:58:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:23.441443 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab5f780-5a3b-4018-b276-08bb3b215f54 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:23.538256 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:23.546986 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:23.557344 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d9dca5-f6d9-48e9-8500-4d38fa01fb33 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:23.567095 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab5f780-5a3b-4018-b276-08bb3b215f54 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:23.597932 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c49ed89-b728-4927-835e-68a357411be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:23.598597 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c49ed89-b728-4927-835e-68a357411be9 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:23.598842 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c49ed89-b728-4927-835e-68a357411be9 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:23.599142 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c49ed89-b728-4927-835e-68a357411be9 None admin] PATH_INFO: `/v3/groups/6702610c615b4999a7423f721152834f` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:23.600383 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c49ed89-b728-4927-835e-68a357411be9 None admin] RBAC: Authorizing `identity:get_group(group_id=6702610c615b4999a7423f721152834f)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:23.602023 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c49ed89-b728-4927-835e-68a357411be9 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:23.608725 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 208/430] 10.222.0.49 () {56 vars in 1180 bytes} [Thu Sep 29 01:58:23 2022] GET /identity/v3/groups/6702610c615b4999a7423f721152834f => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:23.609598 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c49ed89-b728-4927-835e-68a357411be9 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:23.612206 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c344e73-ae9e-48cc-af66-8d3581386f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:23.613192 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c344e73-ae9e-48cc-af66-8d3581386f9b None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:23.614490 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c344e73-ae9e-48cc-af66-8d3581386f9b None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:23.614968 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c344e73-ae9e-48cc-af66-8d3581386f9b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:23.696368 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c344e73-ae9e-48cc-af66-8d3581386f9b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:23.697902 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c344e73-ae9e-48cc-af66-8d3581386f9b None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:23.734678 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c49ed89-b728-4927-835e-68a357411be9 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:23.780392 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20de398b-8106-4d0b-9143-fa10ea1b7cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:23.781396 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20de398b-8106-4d0b-9143-fa10ea1b7cb7 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:23.781846 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20de398b-8106-4d0b-9143-fa10ea1b7cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:23.782286 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20de398b-8106-4d0b-9143-fa10ea1b7cb7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:23.796027 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:23.817629 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:23.823986 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 223/431] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Sep 29 01:58:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 29 01:58:23.825162 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c344e73-ae9e-48cc-af66-8d3581386f9b None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:23.878213 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20de398b-8106-4d0b-9143-fa10ea1b7cb7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:23.880446 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20de398b-8106-4d0b-9143-fa10ea1b7cb7 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:23.945976 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c344e73-ae9e-48cc-af66-8d3581386f9b None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:23.990922 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bea3f2d-2a33-4cf5-ab04-9bf43c255b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:23.992058 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bea3f2d-2a33-4cf5-ab04-9bf43c255b02 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:23.992479 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bea3f2d-2a33-4cf5-ab04-9bf43c255b02 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:23.992888 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bea3f2d-2a33-4cf5-ab04-9bf43c255b02 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:23.993974 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bea3f2d-2a33-4cf5-ab04-9bf43c255b02 None admin] RBAC: Adding query filter params (group.id=6702610c615b4999a7423f721152834f, role.id=f157f905c9c94ccfbfb46e52d443e8f2, scope.project.id=ca184432008d4efaa18beac740258875) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:23.994851 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bea3f2d-2a33-4cf5-ab04-9bf43c255b02 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:23.996808 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bea3f2d-2a33-4cf5-ab04-9bf43c255b02 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:23.998603 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 209/432] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Sep 29 01:58:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 29 01:58:23.999478 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20de398b-8106-4d0b-9143-fa10ea1b7cb7 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:24.006088 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 224/433] 10.222.0.49 () {56 vars in 1376 bytes} [Thu Sep 29 01:58:23 2022] GET /identity/v3/role_assignments?group.id=6702610c615b4999a7423f721152834f&scope.project.id=ca184432008d4efaa18beac740258875&role.id=f157f905c9c94ccfbfb46e52d443e8f2 => generated 611 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:24.007357 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bea3f2d-2a33-4cf5-ab04-9bf43c255b02 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:24.070892 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:24.134963 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:24.138644 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bea3f2d-2a33-4cf5-ab04-9bf43c255b02 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:24.185878 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20746d6d-da67-4728-ac79-fb912c37234e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:24.187377 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20746d6d-da67-4728-ac79-fb912c37234e None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:24.187740 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20746d6d-da67-4728-ac79-fb912c37234e None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:24.188299 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20746d6d-da67-4728-ac79-fb912c37234e None admin] PATH_INFO: `/v3/projects/ca184432008d4efaa18beac740258875` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:24.190611 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20746d6d-da67-4728-ac79-fb912c37234e None admin] RBAC: Authorizing `identity:get_project(project_id=ca184432008d4efaa18beac740258875)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:24.192604 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20746d6d-da67-4728-ac79-fb912c37234e None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:24.195434 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 225/434] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Sep 29 01:58:24 2022] GET /identity/v3/projects/ca184432008d4efaa18beac740258875 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:24.196272 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20de398b-8106-4d0b-9143-fa10ea1b7cb7 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:24.196767 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8c220d-d0a7-4319-953d-c04d1c743de0 None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:24.197056 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8c220d-d0a7-4319-953d-c04d1c743de0 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:24.197346 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8c220d-d0a7-4319-953d-c04d1c743de0 None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:24.200216 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 226/435] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:58:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:58:24.201024 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8c220d-d0a7-4319-953d-c04d1c743de0 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:24.257938 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85183173-ab9e-4665-a4d8-5234bb04fdef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:24.258560 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85183173-ab9e-4665-a4d8-5234bb04fdef None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:24.258774 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85183173-ab9e-4665-a4d8-5234bb04fdef None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:24.259048 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85183173-ab9e-4665-a4d8-5234bb04fdef None admin] PATH_INFO: `/v3/projects/7ed8ec70d1f649c6b36156f0f44f2271` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:24.261641 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85183173-ab9e-4665-a4d8-5234bb04fdef None admin] RBAC: Authorizing `identity:get_project(project_id=7ed8ec70d1f649c6b36156f0f44f2271)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:24.263078 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85183173-ab9e-4665-a4d8-5234bb04fdef None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:24.266580 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 210/436] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Sep 29 01:58:23 2022] GET /identity/v3/projects/7ed8ec70d1f649c6b36156f0f44f2271 => generated 302 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:24.270357 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aad780-b0fe-4aac-b62e-aa8dbd890698 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:24.270645 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aad780-b0fe-4aac-b62e-aa8dbd890698 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:24.271396 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aad780-b0fe-4aac-b62e-aa8dbd890698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:24.291980 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-87aad780-b0fe-4aac-b62e-aa8dbd890698 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:24.293927 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-87aad780-b0fe-4aac-b62e-aa8dbd890698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:24.349070 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8c220d-d0a7-4319-953d-c04d1c743de0 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:24.368960 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:24.380386 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 211/437] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:58:24.382230 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aad780-b0fe-4aac-b62e-aa8dbd890698 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:24.395294 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d948e3-8477-4aa6-83a3-afbb381b9842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:24.396236 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d948e3-8477-4aa6-83a3-afbb381b9842 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:24.396514 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d948e3-8477-4aa6-83a3-afbb381b9842 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:24.396783 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d948e3-8477-4aa6-83a3-afbb381b9842 None admin] PATH_INFO: `/v3/groups/6702610c615b4999a7423f721152834f` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:24.397903 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d948e3-8477-4aa6-83a3-afbb381b9842 None admin] RBAC: Authorizing `identity:get_group(group_id=6702610c615b4999a7423f721152834f)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:24.399586 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d948e3-8477-4aa6-83a3-afbb381b9842 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:24.400905 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 227/438] 10.222.0.49 () {56 vars in 1180 bytes} [Thu Sep 29 01:58:24 2022] GET /identity/v3/groups/6702610c615b4999a7423f721152834f => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:24.402075 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aaf43a-e00a-4d56-863a-4e82b06ec463 None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:24.402312 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aaf43a-e00a-4d56-863a-4e82b06ec463 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:24.402575 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aaf43a-e00a-4d56-863a-4e82b06ec463 None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:24.403869 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 228/439] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:58:24 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:58:24.406656 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aaf43a-e00a-4d56-863a-4e82b06ec463 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:24.469356 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:24.531500 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aad780-b0fe-4aac-b62e-aa8dbd890698 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:24.533840 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aaf43a-e00a-4d56-863a-4e82b06ec463 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:24.574673 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52e5bf1-33ea-4b67-b02d-b8feae5e6715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:24.575465 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e5bf1-33ea-4b67-b02d-b8feae5e6715 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:24.575577 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73abf5e5-1961-42e5-8f2d-20276c0c796e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:24.575916 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e5bf1-33ea-4b67-b02d-b8feae5e6715 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:24.576134 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73abf5e5-1961-42e5-8f2d-20276c0c796e None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:24.576357 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e5bf1-33ea-4b67-b02d-b8feae5e6715 None admin] PATH_INFO: `/v3/groups/6702610c615b4999a7423f721152834f` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:24.576459 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73abf5e5-1961-42e5-8f2d-20276c0c796e None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:24.576673 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73abf5e5-1961-42e5-8f2d-20276c0c796e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:24.577670 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73abf5e5-1961-42e5-8f2d-20276c0c796e None admin] RBAC: Adding query filter params (group.id=6702610c615b4999a7423f721152834f, role.id=8de931d79c9d4c8daf717aaea348dda9, scope.project.id=ca184432008d4efaa18beac740258875) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:24.577771 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52e5bf1-33ea-4b67-b02d-b8feae5e6715 None admin] RBAC: Authorizing `identity:get_group(group_id=6702610c615b4999a7423f721152834f)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:24.577976 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73abf5e5-1961-42e5-8f2d-20276c0c796e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:24.579191 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52e5bf1-33ea-4b67-b02d-b8feae5e6715 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:24.579449 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73abf5e5-1961-42e5-8f2d-20276c0c796e None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:24.581211 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 212/440] 10.222.0.49 () {56 vars in 1180 bytes} [Thu Sep 29 01:58:24 2022] GET /identity/v3/groups/6702610c615b4999a7423f721152834f => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:24.582869 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69f3c2a-116a-4c8f-9850-e2be54d6e517 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:24.583149 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69f3c2a-116a-4c8f-9850-e2be54d6e517 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:24.583418 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69f3c2a-116a-4c8f-9850-e2be54d6e517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:24.587436 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 229/441] 10.222.0.49 () {56 vars in 1376 bytes} [Thu Sep 29 01:58:24 2022] GET /identity/v3/role_assignments?group.id=6702610c615b4999a7423f721152834f&scope.project.id=ca184432008d4efaa18beac740258875&role.id=8de931d79c9d4c8daf717aaea348dda9 => generated 611 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:58:24.589439 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73abf5e5-1961-42e5-8f2d-20276c0c796e None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:24.613855 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-d69f3c2a-116a-4c8f-9850-e2be54d6e517 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:24.615456 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-d69f3c2a-116a-4c8f-9850-e2be54d6e517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:24.659667 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:24.697476 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 213/442] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:58:24.698272 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69f3c2a-116a-4c8f-9850-e2be54d6e517 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:24.724115 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73abf5e5-1961-42e5-8f2d-20276c0c796e None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:24.764535 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:24.764727 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad92850-55d5-4264-9baa-33f14a93eaa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:24.765847 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad92850-55d5-4264-9baa-33f14a93eaa1 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:24.766235 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad92850-55d5-4264-9baa-33f14a93eaa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:24.766616 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad92850-55d5-4264-9baa-33f14a93eaa1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:24.767651 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad92850-55d5-4264-9baa-33f14a93eaa1 None admin] RBAC: Adding query filter params (group.id=6702610c615b4999a7423f721152834f, role.id=f157f905c9c94ccfbfb46e52d443e8f2, scope.project.id=7ed8ec70d1f649c6b36156f0f44f2271) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:24.768055 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad92850-55d5-4264-9baa-33f14a93eaa1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:24.769980 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad92850-55d5-4264-9baa-33f14a93eaa1 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:24.776610 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 230/443] 10.222.0.49 () {56 vars in 1376 bytes} [Thu Sep 29 01:58:24 2022] GET /identity/v3/role_assignments?group.id=6702610c615b4999a7423f721152834f&scope.project.id=7ed8ec70d1f649c6b36156f0f44f2271&role.id=f157f905c9c94ccfbfb46e52d443e8f2 => generated 611 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:24.824867 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69f3c2a-116a-4c8f-9850-e2be54d6e517 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:24.867359 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f3ece7-3ecd-4f60-ba2b-f0cbb9ce4656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:24.868008 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f3ece7-3ecd-4f60-ba2b-f0cbb9ce4656 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:24.868286 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f3ece7-3ecd-4f60-ba2b-f0cbb9ce4656 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:24.868546 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f3ece7-3ecd-4f60-ba2b-f0cbb9ce4656 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:24.881771 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f3ece7-3ecd-4f60-ba2b-f0cbb9ce4656 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:58:24.886789 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-25f3ece7-3ecd-4f60-ba2b-f0cbb9ce4656 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 29 01:58:24.886789 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:24.886789 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:24.886789 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:24.886789 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:24.886789 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:24.886789 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:24.886789 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:24.886789 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:24.886789 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:24.886789 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:24.886789 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:24.886789 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:58:24.886789 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:58:24.886789 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:58:24.886789 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:58:24.887730 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:58:24.887730 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:58:24.887730 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:58:24.887730 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:58:24.887730 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:24.887730 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:24.887730 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:24.887730 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:24.887730 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:24.887730 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:24.887730 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:24.887730 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:24.887730 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:24.887730 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:24.887730 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:24.887730 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:24.888535 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:24.888535 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:24.888535 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:24.888535 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:24.888535 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:58:24.888535 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:58:24.888535 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:58:24.888535 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:58:24.888535 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:58:24.888535 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:58:24.888535 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 29 01:58:24.888535 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:58:24.888535 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 214/444] 10.222.0.49 () {56 vars in 1114 bytes} [Thu Sep 29 01:58:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:24.895656 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad92850-55d5-4264-9baa-33f14a93eaa1 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:24.995061 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f3ece7-3ecd-4f60-ba2b-f0cbb9ce4656 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:25.021478 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad92850-55d5-4264-9baa-33f14a93eaa1 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:25.038700 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:25.064580 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93613612-fd9d-42c4-88f6-4bbb353d43fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:25.065257 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93613612-fd9d-42c4-88f6-4bbb353d43fc None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:25.065605 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93613612-fd9d-42c4-88f6-4bbb353d43fc None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:25.065849 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93613612-fd9d-42c4-88f6-4bbb353d43fc None admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:25.066513 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93613612-fd9d-42c4-88f6-4bbb353d43fc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:25.066811 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93613612-fd9d-42c4-88f6-4bbb353d43fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:25.068314 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93613612-fd9d-42c4-88f6-4bbb353d43fc None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:25.077023 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 231/445] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Sep 29 01:58:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:25.083467 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93613612-fd9d-42c4-88f6-4bbb353d43fc None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:25.125926 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f3ece7-3ecd-4f60-ba2b-f0cbb9ce4656 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:25.140960 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:25.166904 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6184ee41-c216-4ca5-9588-2569af775b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:25.167786 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6184ee41-c216-4ca5-9588-2569af775b63 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:25.168056 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6184ee41-c216-4ca5-9588-2569af775b63 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:25.168318 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6184ee41-c216-4ca5-9588-2569af775b63 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:25.181296 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6184ee41-c216-4ca5-9588-2569af775b63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:58:25.187025 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-6184ee41-c216-4ca5-9588-2569af775b63 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 01:58:25.187025 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:25.187025 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:25.187025 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:25.187025 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:25.187025 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:25.187025 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:25.187025 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:25.187025 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:25.187025 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:25.187025 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:25.187025 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:25.187025 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:58:25.187025 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:58:25.187025 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:58:25.187025 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:58:25.187882 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:58:25.187882 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:58:25.187882 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:58:25.187882 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:58:25.187882 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:25.187882 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:25.187882 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:25.187882 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:25.187882 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:25.187882 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:25.187882 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:25.187882 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:25.187882 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:25.187882 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:25.187882 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:25.187882 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:25.190161 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:25.190161 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:25.190161 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:25.190161 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:25.190161 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:58:25.190161 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:58:25.190161 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:58:25.190161 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:58:25.190161 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:58:25.190161 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:58:25.190161 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 01:58:25.190161 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:58:25.190161 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 215/446] 10.222.0.49 () {56 vars in 1096 bytes} [Thu Sep 29 01:58:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 01:58:25.194495 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6184ee41-c216-4ca5-9588-2569af775b63 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:25.212399 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93613612-fd9d-42c4-88f6-4bbb353d43fc None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:25.256104 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1a2fc4-64aa-410f-9b46-1a95d65ed6b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:25.256717 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a2fc4-64aa-410f-9b46-1a95d65ed6b0 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:25.256995 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a2fc4-64aa-410f-9b46-1a95d65ed6b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:25.257263 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a2fc4-64aa-410f-9b46-1a95d65ed6b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:25.302413 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:25.304079 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6184ee41-c216-4ca5-9588-2569af775b63 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:25.326072 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1a2fc4-64aa-410f-9b46-1a95d65ed6b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:25.327581 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1a2fc4-64aa-410f-9b46-1a95d65ed6b0 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:25.339165 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f034c52-021a-4ed3-ac4d-d1f6fe2cbe57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:25.339760 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f034c52-021a-4ed3-ac4d-d1f6fe2cbe57 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:25.340032 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f034c52-021a-4ed3-ac4d-d1f6fe2cbe57 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:25.340295 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f034c52-021a-4ed3-ac4d-d1f6fe2cbe57 None admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:25.341234 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f034c52-021a-4ed3-ac4d-d1f6fe2cbe57 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:25.341563 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f034c52-021a-4ed3-ac4d-d1f6fe2cbe57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:25.342900 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f034c52-021a-4ed3-ac4d-d1f6fe2cbe57 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:25.350972 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 216/447] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Sep 29 01:58:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:25.356616 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f034c52-021a-4ed3-ac4d-d1f6fe2cbe57 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:25.389322 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:25.432950 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 232/448] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Sep 29 01:58:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 29 01:58:25.438568 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1a2fc4-64aa-410f-9b46-1a95d65ed6b0 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:25.457767 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f034c52-021a-4ed3-ac4d-d1f6fe2cbe57 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:25.492450 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056f8ca4-c407-4c37-85cd-5e7b16820bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:25.493053 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f8ca4-c407-4c37-85cd-5e7b16820bbe None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:25.493361 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f8ca4-c407-4c37-85cd-5e7b16820bbe None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:25.493630 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f8ca4-c407-4c37-85cd-5e7b16820bbe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:25.513033 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:25.538216 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1a2fc4-64aa-410f-9b46-1a95d65ed6b0 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:25.561369 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056f8ca4-c407-4c37-85cd-5e7b16820bbe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:25.562966 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056f8ca4-c407-4c37-85cd-5e7b16820bbe None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:25.572607 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb179a6-6e99-46b9-b849-7d56a99b27b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:25.573237 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb179a6-6e99-46b9-b849-7d56a99b27b2 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:25.573546 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb179a6-6e99-46b9-b849-7d56a99b27b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:25.573822 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb179a6-6e99-46b9-b849-7d56a99b27b2 None admin] PATH_INFO: `/v3/projects/7ed8ec70d1f649c6b36156f0f44f2271` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:25.574935 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb179a6-6e99-46b9-b849-7d56a99b27b2 None admin] RBAC: Authorizing `identity:get_project(project_id=7ed8ec70d1f649c6b36156f0f44f2271)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:25.576358 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb179a6-6e99-46b9-b849-7d56a99b27b2 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:25.578083 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 233/449] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Sep 29 01:58:25 2022] GET /identity/v3/projects/7ed8ec70d1f649c6b36156f0f44f2271 => generated 302 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:58:25.584022 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb179a6-6e99-46b9-b849-7d56a99b27b2 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:25.596969 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:25.662014 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 217/450] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Sep 29 01:58:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 29 01:58:25.667827 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056f8ca4-c407-4c37-85cd-5e7b16820bbe None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:25.682723 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb179a6-6e99-46b9-b849-7d56a99b27b2 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:25.716680 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc7da06-0820-4a11-9764-242cb69b011f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:25.717326 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc7da06-0820-4a11-9764-242cb69b011f None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:25.717614 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc7da06-0820-4a11-9764-242cb69b011f None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:25.717888 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc7da06-0820-4a11-9764-242cb69b011f None admin] PATH_INFO: `/v3/groups/6702610c615b4999a7423f721152834f` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:25.719008 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc7da06-0820-4a11-9764-242cb69b011f None admin] RBAC: Authorizing `identity:get_group(group_id=6702610c615b4999a7423f721152834f)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:25.721159 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc7da06-0820-4a11-9764-242cb69b011f None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:25.722660 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 234/451] 10.222.0.49 () {56 vars in 1180 bytes} [Thu Sep 29 01:58:25 2022] GET /identity/v3/groups/6702610c615b4999a7423f721152834f => generated 226 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:58:25.728310 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc7da06-0820-4a11-9764-242cb69b011f None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:25.742934 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:25.765447 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056f8ca4-c407-4c37-85cd-5e7b16820bbe None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:25.801391 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ad2049-a797-423f-b53d-7c1f0eea0945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:25.802126 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ad2049-a797-423f-b53d-7c1f0eea0945 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:25.802416 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ad2049-a797-423f-b53d-7c1f0eea0945 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:25.802683 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ad2049-a797-423f-b53d-7c1f0eea0945 None admin] PATH_INFO: `/v3/projects/3a47c9ae604c439cb80f84e69bc4f995` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:25.803822 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ad2049-a797-423f-b53d-7c1f0eea0945 None admin] RBAC: Authorizing `identity:get_project(project_id=3a47c9ae604c439cb80f84e69bc4f995)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:25.805254 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ad2049-a797-423f-b53d-7c1f0eea0945 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:25.806913 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 218/452] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Sep 29 01:58:25 2022] GET /identity/v3/projects/3a47c9ae604c439cb80f84e69bc4f995 => generated 344 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:58:25.812406 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ad2049-a797-423f-b53d-7c1f0eea0945 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:25.815493 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:25.832119 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc7da06-0820-4a11-9764-242cb69b011f None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:25.864801 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edddf431-b6c7-4bd6-b3a1-bb81c48c5a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:25.865420 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edddf431-b6c7-4bd6-b3a1-bb81c48c5a3a None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:25.865698 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edddf431-b6c7-4bd6-b3a1-bb81c48c5a3a None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:25.865971 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edddf431-b6c7-4bd6-b3a1-bb81c48c5a3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:25.866677 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edddf431-b6c7-4bd6-b3a1-bb81c48c5a3a None admin] RBAC: Adding query filter params (group.id=6702610c615b4999a7423f721152834f, role.id=8de931d79c9d4c8daf717aaea348dda9, scope.project.id=7ed8ec70d1f649c6b36156f0f44f2271) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:25.866974 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edddf431-b6c7-4bd6-b3a1-bb81c48c5a3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:25.868399 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edddf431-b6c7-4bd6-b3a1-bb81c48c5a3a None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:25.873907 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 235/453] 10.222.0.49 () {56 vars in 1376 bytes} [Thu Sep 29 01:58:25 2022] GET /identity/v3/role_assignments?group.id=6702610c615b4999a7423f721152834f&scope.project.id=7ed8ec70d1f649c6b36156f0f44f2271&role.id=8de931d79c9d4c8daf717aaea348dda9 => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:58:25.923735 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ad2049-a797-423f-b53d-7c1f0eea0945 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:25.961845 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ed38d4-4153-433b-aee4-d45ccf033431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:25.962487 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed38d4-4153-433b-aee4-d45ccf033431 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:25.962765 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed38d4-4153-433b-aee4-d45ccf033431 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:25.963036 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed38d4-4153-433b-aee4-d45ccf033431 None admin] PATH_INFO: `/v3/groups/ec63d251566641e78099c5e20241448f` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:25.964250 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ed38d4-4153-433b-aee4-d45ccf033431 None admin] RBAC: Authorizing `identity:get_group(group_id=ec63d251566641e78099c5e20241448f)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:25.965765 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ed38d4-4153-433b-aee4-d45ccf033431 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:25.967460 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 219/454] 10.222.0.49 () {56 vars in 1180 bytes} [Thu Sep 29 01:58:25 2022] GET /identity/v3/groups/ec63d251566641e78099c5e20241448f => generated 229 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:58:25.974004 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edddf431-b6c7-4bd6-b3a1-bb81c48c5a3a None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:26.056962 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:26.081492 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edddf431-b6c7-4bd6-b3a1-bb81c48c5a3a None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:26.115984 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5de8d3-16a7-45f1-9bbf-5826e4efe511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:26.116529 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5de8d3-16a7-45f1-9bbf-5826e4efe511 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:26.116803 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5de8d3-16a7-45f1-9bbf-5826e4efe511 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:26.117069 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5de8d3-16a7-45f1-9bbf-5826e4efe511 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:26.117810 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5de8d3-16a7-45f1-9bbf-5826e4efe511 None admin] RBAC: Adding query filter params (group.id=ec63d251566641e78099c5e20241448f, role.id=fe9bbc67742f4f5893f39b18eb31d59a, scope.project.id=3a47c9ae604c439cb80f84e69bc4f995) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:26.118114 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5de8d3-16a7-45f1-9bbf-5826e4efe511 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:26.119536 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5de8d3-16a7-45f1-9bbf-5826e4efe511 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:26.125548 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 236/455] 10.222.0.49 () {56 vars in 1376 bytes} [Thu Sep 29 01:58:25 2022] GET /identity/v3/role_assignments?group.id=ec63d251566641e78099c5e20241448f&scope.project.id=3a47c9ae604c439cb80f84e69bc4f995&role.id=fe9bbc67742f4f5893f39b18eb31d59a => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:28.728464 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f839bd4f-a91b-4584-833c-e784756ac586 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:28.729520 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f839bd4f-a91b-4584-833c-e784756ac586 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:28.729994 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f839bd4f-a91b-4584-833c-e784756ac586 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:28.731803 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 220/456] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:58:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:58:28.737554 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c01b7-cd91-41ef-9233-8c1e3a646bcc None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:28.738379 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c01b7-cd91-41ef-9233-8c1e3a646bcc None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:28.738847 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c01b7-cd91-41ef-9233-8c1e3a646bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:28.762280 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-a22c01b7-cd91-41ef-9233-8c1e3a646bcc None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:28.763811 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-a22c01b7-cd91-41ef-9233-8c1e3a646bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:28.855350 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 237/457] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 29 01:58:28.939298 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6cfdaa-686f-4725-a382-8897869f568d None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:28.939772 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6cfdaa-686f-4725-a382-8897869f568d None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:28.940048 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6cfdaa-686f-4725-a382-8897869f568d None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:28.941653 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 221/458] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:58:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:58:28.946697 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7548b7-0ce9-4539-811b-fcbc71dab0de None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:28.946981 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7548b7-0ce9-4539-811b-fcbc71dab0de None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:28.947249 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7548b7-0ce9-4539-811b-fcbc71dab0de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:28.974323 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-8f7548b7-0ce9-4539-811b-fcbc71dab0de None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:28.975514 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-8f7548b7-0ce9-4539-811b-fcbc71dab0de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:29.047245 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:29.052234 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 238/459] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:58:29.243762 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6cfdaa-686f-4725-a382-8897869f568d None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:29.341056 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:29.387486 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6cfdaa-686f-4725-a382-8897869f568d None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:29.422978 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb252cf-cfb6-4f32-aca6-6afdf9319b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:29.424116 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb252cf-cfb6-4f32-aca6-6afdf9319b1e None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:29.424389 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb252cf-cfb6-4f32-aca6-6afdf9319b1e None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:29.424652 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb252cf-cfb6-4f32-aca6-6afdf9319b1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:29.434789 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb252cf-cfb6-4f32-aca6-6afdf9319b1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:29.436212 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb252cf-cfb6-4f32-aca6-6afdf9319b1e None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:29.447397 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7548b7-0ce9-4539-811b-fcbc71dab0de None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:29.451259 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-edb252cf-cfb6-4f32-aca6-6afdf9319b1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:29.451259 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:29.451259 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:29.451259 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:29.451259 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:29.451259 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:29.451259 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:29.451259 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:29.451259 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:29.451259 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:29.451259 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:29.451259 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:29.451259 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:58:29.451259 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:58:29.451259 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:58:29.451259 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:58:29.452206 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:29.452206 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:29.452206 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:29.452206 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:29.452206 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:29.452206 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:29.452206 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:29.452206 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:29.452206 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:29.452206 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:29.452206 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:29.452206 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:29.452206 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:29.452206 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:29.452206 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:29.452206 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:29.452206 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:58:29.453023 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:58:29.453023 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:29.453023 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:58:29.453023 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 222/460] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 01:58:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:29.463557 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb252cf-cfb6-4f32-aca6-6afdf9319b1e None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:29.592157 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7548b7-0ce9-4539-811b-fcbc71dab0de None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:29.608694 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb252cf-cfb6-4f32-aca6-6afdf9319b1e None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:29.627091 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25ba476-e037-48cf-b073-fc2ea46dc604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:29.627717 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ba476-e037-48cf-b073-fc2ea46dc604 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:29.627999 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ba476-e037-48cf-b073-fc2ea46dc604 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:29.628272 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ba476-e037-48cf-b073-fc2ea46dc604 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:29.634402 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:29.638798 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25ba476-e037-48cf-b073-fc2ea46dc604 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:29.640244 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25ba476-e037-48cf-b073-fc2ea46dc604 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:29.651065 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb47972-7e0b-4df5-98a3-01317f3f18ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:29.651959 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb47972-7e0b-4df5-98a3-01317f3f18ab None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:29.652442 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb47972-7e0b-4df5-98a3-01317f3f18ab None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:29.652933 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb47972-7e0b-4df5-98a3-01317f3f18ab None admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:29.653819 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb47972-7e0b-4df5-98a3-01317f3f18ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:29.654381 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb47972-7e0b-4df5-98a3-01317f3f18ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:29.655448 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-f25ba476-e037-48cf-b073-fc2ea46dc604 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:29.655448 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:29.655448 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:29.655448 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:29.655448 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:29.655448 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:29.655448 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:29.655448 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:29.655448 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:29.655448 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:29.655448 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:29.655448 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:29.655448 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:58:29.655448 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:58:29.655448 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:58:29.655448 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:58:29.656335 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:29.656335 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:29.656335 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:29.656335 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:29.656335 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:29.656335 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:29.656335 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:29.656335 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:29.656335 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:29.656335 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:29.656335 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:29.656335 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:29.656335 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:29.656335 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:29.656335 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:29.656335 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:29.656335 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:58:29.662418 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:58:29.662418 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:29.662418 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:58:29.662593 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb47972-7e0b-4df5-98a3-01317f3f18ab None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:29.662664 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 239/461] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 01:58:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:29.662664 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adfb5ff-1c25-4e72-b43d-e94d3f34bf7a None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:29.662664 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adfb5ff-1c25-4e72-b43d-e94d3f34bf7a None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:29.662664 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adfb5ff-1c25-4e72-b43d-e94d3f34bf7a None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:29.662664 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 240/462] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:58:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:58:29.662664 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0587ef43-0a20-4889-b66a-d7728342329b None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:29.662664 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0587ef43-0a20-4889-b66a-d7728342329b None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:29.663035 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0587ef43-0a20-4889-b66a-d7728342329b None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:29.663035 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 241/463] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:58:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:58:29.668448 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0587ef43-0a20-4889-b66a-d7728342329b None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:29.670830 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 223/464] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Sep 29 01:58:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:29.673158 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672cf703-b292-4629-85a3-7da158b3ab40 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:29.673510 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672cf703-b292-4629-85a3-7da158b3ab40 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:29.673741 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672cf703-b292-4629-85a3-7da158b3ab40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:29.693625 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-672cf703-b292-4629-85a3-7da158b3ab40 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:29.694940 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-672cf703-b292-4629-85a3-7da158b3ab40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:29.726554 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:29.777335 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 224/465] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:58:29.777335 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb966add-b9b1-4f3a-b623-3c0d20686547 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:29.777335 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb966add-b9b1-4f3a-b623-3c0d20686547 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:29.777335 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb966add-b9b1-4f3a-b623-3c0d20686547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:29.785889 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0587ef43-0a20-4889-b66a-d7728342329b None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:29.795511 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-fb966add-b9b1-4f3a-b623-3c0d20686547 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:29.796807 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-fb966add-b9b1-4f3a-b623-3c0d20686547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:29.822295 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d412b21-8765-48d5-b8d6-05e4f01142e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:29.822960 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d412b21-8765-48d5-b8d6-05e4f01142e1 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:29.823241 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d412b21-8765-48d5-b8d6-05e4f01142e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:29.823551 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d412b21-8765-48d5-b8d6-05e4f01142e1 None admin] PATH_INFO: `/v3/domains` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:29.824352 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d412b21-8765-48d5-b8d6-05e4f01142e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:29.824681 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d412b21-8765-48d5-b8d6-05e4f01142e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:29.826819 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d412b21-8765-48d5-b8d6-05e4f01142e1 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:29.855126 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 242/466] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Sep 29 01:58:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:29.855894 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d412b21-8765-48d5-b8d6-05e4f01142e1 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:29.889456 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 225/467] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:58:29.890382 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb966add-b9b1-4f3a-b623-3c0d20686547 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:29.970935 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:30.030271 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb966add-b9b1-4f3a-b623-3c0d20686547 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:30.067767 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9c97e4-a3a9-4547-879d-7e28987f6655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:30.068375 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c97e4-a3a9-4547-879d-7e28987f6655 None admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:30.068652 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c97e4-a3a9-4547-879d-7e28987f6655 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:30.068922 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c97e4-a3a9-4547-879d-7e28987f6655 None admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:30.069604 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9c97e4-a3a9-4547-879d-7e28987f6655 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:30.071189 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9c97e4-a3a9-4547-879d-7e28987f6655 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:30.103019 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d412b21-8765-48d5-b8d6-05e4f01142e1 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:30.114853 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 226/468] 10.222.0.49 () {60 vars in 1132 bytes} [Thu Sep 29 01:58:29 2022] POST /identity/v3/users => generated 248 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 01:58:30.116149 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9c97e4-a3a9-4547-879d-7e28987f6655 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:30.139539 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:30.199749 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fafab32-50bd-4b40-a08d-bfa995486cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:30.200386 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fafab32-50bd-4b40-a08d-bfa995486cc8 None admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:30.200665 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fafab32-50bd-4b40-a08d-bfa995486cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:30.200937 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fafab32-50bd-4b40-a08d-bfa995486cc8 None admin] PATH_INFO: `/v3/users` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:30.201652 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fafab32-50bd-4b40-a08d-bfa995486cc8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:30.203160 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fafab32-50bd-4b40-a08d-bfa995486cc8 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:30.232111 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 243/469] 10.222.0.49 () {60 vars in 1132 bytes} [Thu Sep 29 01:58:29 2022] POST /identity/v3/users => generated 246 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 01:58:30.232842 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fafab32-50bd-4b40-a08d-bfa995486cc8 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:30.249770 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:30.254004 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9c97e4-a3a9-4547-879d-7e28987f6655 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:30.302401 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961f5208-4132-436f-93c9-2b75a9889d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:30.304203 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f5208-4132-436f-93c9-2b75a9889d1b None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:30.305067 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f5208-4132-436f-93c9-2b75a9889d1b None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:30.305605 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f5208-4132-436f-93c9-2b75a9889d1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:30.320676 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961f5208-4132-436f-93c9-2b75a9889d1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:30.323102 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961f5208-4132-436f-93c9-2b75a9889d1b None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:30.347581 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-961f5208-4132-436f-93c9-2b75a9889d1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:30.347581 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:30.347581 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:30.347581 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:30.347581 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:30.347581 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:30.347581 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:30.347581 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:30.347581 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:30.347581 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:30.347581 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:30.347581 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:30.347581 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:58:30.347581 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:58:30.347581 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:58:30.347581 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:58:30.348556 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:30.348556 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:30.348556 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:30.348556 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:30.348556 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:30.348556 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:30.348556 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:30.348556 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:30.348556 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:30.348556 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:30.348556 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:30.348556 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:30.348556 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:30.348556 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:30.348556 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:30.348556 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:30.348556 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:58:30.349400 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:58:30.349400 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:30.349400 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:58:30.355468 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 227/470] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 01:58:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:30.355468 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa84a0e1-7e2a-4e5a-9980-30588984db5b None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:30.355468 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa84a0e1-7e2a-4e5a-9980-30588984db5b None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:30.355468 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa84a0e1-7e2a-4e5a-9980-30588984db5b None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:30.355468 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 228/471] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:58:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:58:30.358093 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa84a0e1-7e2a-4e5a-9980-30588984db5b None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:30.370320 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fafab32-50bd-4b40-a08d-bfa995486cc8 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:30.415763 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead824be-6c66-49b7-9495-37ee9de8010d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:30.416757 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead824be-6c66-49b7-9495-37ee9de8010d None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:30.417599 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead824be-6c66-49b7-9495-37ee9de8010d None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:30.418075 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead824be-6c66-49b7-9495-37ee9de8010d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:30.433004 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead824be-6c66-49b7-9495-37ee9de8010d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:30.434707 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead824be-6c66-49b7-9495-37ee9de8010d None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:30.455257 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-ead824be-6c66-49b7-9495-37ee9de8010d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:30.455257 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:30.455257 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:30.455257 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:30.455257 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:30.455257 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:30.455257 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:30.455257 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:30.455257 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:30.455257 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:30.455257 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:30.455257 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:30.455257 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:58:30.455257 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:58:30.455257 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:58:30.455257 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:58:30.456188 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:30.456188 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:30.456188 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:30.456188 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:30.456188 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:30.456188 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:30.456188 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:30.456188 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:30.456188 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:30.456188 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:30.456188 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:30.456188 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:30.456188 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:30.456188 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:30.456188 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:30.456188 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:30.456188 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:58:30.457107 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:58:30.457107 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:30.457107 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:58:30.457107 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 244/472] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 01:58:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:30.458107 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1801832-9dd9-4be0-be2c-edb53f4944e2 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:30.458107 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1801832-9dd9-4be0-be2c-edb53f4944e2 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:30.458360 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1801832-9dd9-4be0-be2c-edb53f4944e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:30.481545 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-a1801832-9dd9-4be0-be2c-edb53f4944e2 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:30.483033 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-a1801832-9dd9-4be0-be2c-edb53f4944e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:30.497958 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa84a0e1-7e2a-4e5a-9980-30588984db5b None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:30.508956 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:30.540282 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981a32c5-4607-491c-9abd-81961d01bfdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:30.540891 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a32c5-4607-491c-9abd-81961d01bfdb None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:30.541166 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a32c5-4607-491c-9abd-81961d01bfdb None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:30.541464 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a32c5-4607-491c-9abd-81961d01bfdb None admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:30.542112 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981a32c5-4607-491c-9abd-81961d01bfdb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:30.542662 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981a32c5-4607-491c-9abd-81961d01bfdb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:30.544021 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981a32c5-4607-491c-9abd-81961d01bfdb None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:30.557726 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 229/473] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Sep 29 01:58:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:30.558705 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981a32c5-4607-491c-9abd-81961d01bfdb None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:30.571724 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:30.584748 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 245/474] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:58:30.585930 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1801832-9dd9-4be0-be2c-edb53f4944e2 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:30.670698 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981a32c5-4607-491c-9abd-81961d01bfdb None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:30.720542 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1801832-9dd9-4be0-be2c-edb53f4944e2 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:30.732678 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0b691b-e71c-493a-8d94-5110ab9368b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:30.733277 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b691b-e71c-493a-8d94-5110ab9368b5 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:30.733584 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b691b-e71c-493a-8d94-5110ab9368b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:30.733854 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b691b-e71c-493a-8d94-5110ab9368b5 None admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:30.734556 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0b691b-e71c-493a-8d94-5110ab9368b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:30.734853 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0b691b-e71c-493a-8d94-5110ab9368b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:30.736442 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0b691b-e71c-493a-8d94-5110ab9368b5 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:30.760844 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80214e14-13a6-41fb-a794-5546af6712b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:30.761727 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 230/475] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Sep 29 01:58:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:30.761866 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80214e14-13a6-41fb-a794-5546af6712b3 None admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:30.762268 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80214e14-13a6-41fb-a794-5546af6712b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:30.762787 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80214e14-13a6-41fb-a794-5546af6712b3 None admin] PATH_INFO: `/v3/users` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:30.763632 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80214e14-13a6-41fb-a794-5546af6712b3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:30.765220 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80214e14-13a6-41fb-a794-5546af6712b3 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:30.766647 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0b691b-e71c-493a-8d94-5110ab9368b5 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:30.791325 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 246/476] 10.222.0.49 () {60 vars in 1132 bytes} [Thu Sep 29 01:58:30 2022] POST /identity/v3/users => generated 249 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 01:58:30.869301 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:30.907254 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0b691b-e71c-493a-8d94-5110ab9368b5 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:30.945985 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd01f20-6042-455e-a795-243a5a8390bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:30.946511 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd01f20-6042-455e-a795-243a5a8390bf None admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:30.946787 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd01f20-6042-455e-a795-243a5a8390bf None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:30.947058 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd01f20-6042-455e-a795-243a5a8390bf None admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:30.947711 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd01f20-6042-455e-a795-243a5a8390bf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:30.949147 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd01f20-6042-455e-a795-243a5a8390bf None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:30.975348 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 231/477] 10.222.0.49 () {60 vars in 1132 bytes} [Thu Sep 29 01:58:30 2022] POST /identity/v3/users => generated 248 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 29 01:58:30.993642 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80214e14-13a6-41fb-a794-5546af6712b3 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:31.005456 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:31.117036 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80214e14-13a6-41fb-a794-5546af6712b3 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:31.155812 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156cd5a8-a97f-4299-b4f1-1993f205a1c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:31.156446 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156cd5a8-a97f-4299-b4f1-1993f205a1c3 None admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:31.156722 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156cd5a8-a97f-4299-b4f1-1993f205a1c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:31.157077 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156cd5a8-a97f-4299-b4f1-1993f205a1c3 None admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:31.158386 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156cd5a8-a97f-4299-b4f1-1993f205a1c3 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:31.159814 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156cd5a8-a97f-4299-b4f1-1993f205a1c3 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:31.169329 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.sql.core [None req-156cd5a8-a97f-4299-b4f1-1993f205a1c3 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 29 01:58:31.169329 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 29 01:58:31.169329 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [parameters: {'id': '2cca02329b104b9f811c6b36d502b917', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 29 01:58:31.169329 dv-cinder-740146-21-smb devstack@keystone.service[81648]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81648) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 29 01:58:31.187024 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-156cd5a8-a97f-4299-b4f1-1993f205a1c3 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 29 01:58:31.187024 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:31.187024 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 29 01:58:31.187024 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 29 01:58:31.187024 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 29 01:58:31.187024 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 29 01:58:31.187024 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 29 01:58:31.187024 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application result = self._query(query) Sep 29 01:58:31.187024 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 29 01:58:31.187024 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application conn.query(q) Sep 29 01:58:31.187024 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 29 01:58:31.187024 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 29 01:58:31.187024 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 29 01:58:31.187024 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application result.read() Sep 29 01:58:31.187024 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 29 01:58:31.187935 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 29 01:58:31.187935 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 29 01:58:31.187935 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 29 01:58:31.187935 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 29 01:58:31.187935 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 29 01:58:31.187935 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 29 01:58:31.187935 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 29 01:58:31.187935 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 29 01:58:31.187935 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:58:31.187935 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 29 01:58:31.187935 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:58:31.187935 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:31.187935 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 29 01:58:31.187935 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 29 01:58:31.187935 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 29 01:58:31.187935 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return ref.to_dict() Sep 29 01:58:31.187935 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 29 01:58:31.187935 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application next(self.gen) Sep 29 01:58:31.189404 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 29 01:58:31.189404 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application yield resource Sep 29 01:58:31.189404 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 29 01:58:31.189404 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application next(self.gen) Sep 29 01:58:31.189404 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 29 01:58:31.189404 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application self.session.rollback() Sep 29 01:58:31.189404 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 29 01:58:31.189404 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application self.force_reraise() Sep 29 01:58:31.189404 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 29 01:58:31.189404 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise self.value Sep 29 01:58:31.189404 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 29 01:58:31.189404 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 29 01:58:31.189404 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 29 01:58:31.189404 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application session.commit() Sep 29 01:58:31.189404 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 29 01:58:31.189404 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 29 01:58:31.189404 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 29 01:58:31.190247 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application self._prepare_impl() Sep 29 01:58:31.190247 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 29 01:58:31.190247 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application self.session.flush() Sep 29 01:58:31.190247 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 29 01:58:31.190247 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application self._flush(objects) Sep 29 01:58:31.190247 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 29 01:58:31.190247 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 29 01:58:31.190247 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 29 01:58:31.190247 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application compat.raise_( Sep 29 01:58:31.190247 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 29 01:58:31.190247 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception Sep 29 01:58:31.190247 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 29 01:58:31.190247 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application flush_context.execute() Sep 29 01:58:31.190247 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 29 01:58:31.190247 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rec.execute(self) Sep 29 01:58:31.190247 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 29 01:58:31.190247 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 29 01:58:31.191136 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 29 01:58:31.191136 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 29 01:58:31.191136 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 29 01:58:31.191136 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 29 01:58:31.191136 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 29 01:58:31.191136 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 29 01:58:31.191136 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 29 01:58:31.191136 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 29 01:58:31.191136 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 29 01:58:31.191136 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 29 01:58:31.191136 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 29 01:58:31.191136 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 29 01:58:31.191136 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 29 01:58:31.191136 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 29 01:58:31.191136 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 29 01:58:31.191136 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception Sep 29 01:58:31.191932 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 29 01:58:31.191932 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 29 01:58:31.191932 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 29 01:58:31.191932 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 29 01:58:31.191932 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 29 01:58:31.191932 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application result = self._query(query) Sep 29 01:58:31.191932 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 29 01:58:31.191932 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application conn.query(q) Sep 29 01:58:31.191932 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 29 01:58:31.191932 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 29 01:58:31.191932 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 29 01:58:31.191932 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application result.read() Sep 29 01:58:31.191932 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 29 01:58:31.191932 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 29 01:58:31.191932 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 29 01:58:31.191932 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 29 01:58:31.192701 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 29 01:58:31.192701 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 29 01:58:31.192701 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 29 01:58:31.192701 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 29 01:58:31.192701 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 29 01:58:31.192701 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 29 01:58:31.192701 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [parameters: {'id': '2cca02329b104b9f811c6b36d502b917', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 29 01:58:31.192701 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 29 01:58:31.192701 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:58:31.192701 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 29 01:58:31.192701 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:58:31.192701 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:31.192701 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:31.192701 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:31.192701 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:31.192701 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:31.194864 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:31.194864 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:31.194864 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:31.194864 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:31.194864 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:31.194864 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:31.194864 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 29 01:58:31.194864 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 29 01:58:31.194864 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:31.194864 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:31.194864 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 29 01:58:31.194864 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 29 01:58:31.194864 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 29 01:58:31.194864 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 29 01:58:31.194864 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 29 01:58:31.194864 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:58:31.196815 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 247/478] 10.222.0.49 () {60 vars in 1131 bytes} [Thu Sep 29 01:58:30 2022] POST /identity/v3/roles => generated 144 bytes in 196 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:31.196916 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd01f20-6042-455e-a795-243a5a8390bf None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:31.310634 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd01f20-6042-455e-a795-243a5a8390bf None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:31.342184 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:31.354904 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a473fd99-4d8f-4f86-9ced-36170155d294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:31.356081 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a473fd99-4d8f-4f86-9ced-36170155d294 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:31.356775 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a473fd99-4d8f-4f86-9ced-36170155d294 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:31.357047 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a473fd99-4d8f-4f86-9ced-36170155d294 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:31.368593 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a473fd99-4d8f-4f86-9ced-36170155d294 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:58:31.374167 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-a473fd99-4d8f-4f86-9ced-36170155d294 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 29 01:58:31.374167 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:31.374167 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:31.374167 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:31.374167 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:31.374167 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:31.374167 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:31.374167 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:31.374167 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:31.374167 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:31.374167 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:31.374167 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:31.374167 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:58:31.374167 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:58:31.374167 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:58:31.374167 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:58:31.375107 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:58:31.375107 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:58:31.375107 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:58:31.375107 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:58:31.375107 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:31.375107 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:31.375107 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:31.375107 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:31.375107 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:31.375107 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:31.375107 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:31.375107 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:31.375107 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:31.375107 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:31.375107 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:31.375107 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:31.375908 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:31.375908 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:31.375908 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:31.375908 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:31.375908 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:58:31.375908 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:58:31.375908 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:58:31.375908 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:58:31.375908 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:58:31.375908 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:58:31.375908 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 29 01:58:31.375908 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:58:31.375908 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 232/479] 10.222.0.49 () {56 vars in 1114 bytes} [Thu Sep 29 01:58:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:31.382333 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156cd5a8-a97f-4299-b4f1-1993f205a1c3 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:31.457851 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:31.491455 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156cd5a8-a97f-4299-b4f1-1993f205a1c3 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:31.528027 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8180f6-e40a-4305-b4b4-c47620c78f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:31.528653 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8180f6-e40a-4305-b4b4-c47620c78f6d None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:31.528931 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8180f6-e40a-4305-b4b4-c47620c78f6d None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:31.529203 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8180f6-e40a-4305-b4b4-c47620c78f6d None admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:31.529962 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8180f6-e40a-4305-b4b4-c47620c78f6d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:31.530263 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8180f6-e40a-4305-b4b4-c47620c78f6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:31.531745 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8180f6-e40a-4305-b4b4-c47620c78f6d None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:31.541043 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 248/480] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Sep 29 01:58:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:32.847062 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce58ae99-3d23-4b86-a62f-5f15240ded4c None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:32.847593 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce58ae99-3d23-4b86-a62f-5f15240ded4c None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:32.847593 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce58ae99-3d23-4b86-a62f-5f15240ded4c None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:32.848970 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 233/481] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:58:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:58:32.854865 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabea91c-7f60-49ec-8a5f-092a3ce933c3 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:32.855318 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabea91c-7f60-49ec-8a5f-092a3ce933c3 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:32.855391 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabea91c-7f60-49ec-8a5f-092a3ce933c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:32.877852 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf13bfc-3844-470a-91de-539a1eba64db None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:32.878146 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf13bfc-3844-470a-91de-539a1eba64db None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:32.878330 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-aabea91c-7f60-49ec-8a5f-092a3ce933c3 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:32.878433 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf13bfc-3844-470a-91de-539a1eba64db None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:32.879542 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-aabea91c-7f60-49ec-8a5f-092a3ce933c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:32.879923 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 234/482] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:58:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:58:32.885029 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d6679c-edff-407f-876c-3a5cdf5e7e04 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:32.885320 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d6679c-edff-407f-876c-3a5cdf5e7e04 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:32.885602 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d6679c-edff-407f-876c-3a5cdf5e7e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:32.934303 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-c4d6679c-edff-407f-876c-3a5cdf5e7e04 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:32.935510 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-c4d6679c-edff-407f-876c-3a5cdf5e7e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:32.956263 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 249/483] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:58:33.042855 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 235/484] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 29 01:58:33.275828 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabea91c-7f60-49ec-8a5f-092a3ce933c3 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:33.331914 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d6679c-edff-407f-876c-3a5cdf5e7e04 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:33.352889 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:33.437590 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d6679c-edff-407f-876c-3a5cdf5e7e04 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:33.440061 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabea91c-7f60-49ec-8a5f-092a3ce933c3 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:33.457678 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:33.487099 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271ff78a-4b0b-4057-9d13-51c94747371f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:33.487763 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271ff78a-4b0b-4057-9d13-51c94747371f None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:33.488023 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271ff78a-4b0b-4057-9d13-51c94747371f None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:33.488296 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271ff78a-4b0b-4057-9d13-51c94747371f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:33.506948 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271ff78a-4b0b-4057-9d13-51c94747371f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:58:33.511837 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-271ff78a-4b0b-4057-9d13-51c94747371f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 29 01:58:33.511837 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:33.511837 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:33.511837 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:33.511837 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:33.511837 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:33.511837 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:33.511837 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:33.511837 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:33.511837 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:33.511837 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:33.511837 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:33.511837 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:58:33.511837 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:58:33.511837 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:58:33.511837 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:58:33.512690 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:58:33.512690 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:58:33.512690 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:58:33.512690 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:58:33.512690 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:33.512690 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:33.512690 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:33.512690 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:33.512690 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:33.512690 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:33.512690 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:33.512690 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:33.512690 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:33.512690 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:33.512690 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:33.512690 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:33.513488 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:33.513488 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:33.513488 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:33.513488 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:33.513488 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:58:33.513488 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:58:33.513488 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:58:33.513488 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:58:33.513488 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:58:33.513488 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:58:33.513488 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 29 01:58:33.513488 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:58:33.514638 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 236/485] 10.222.0.49 () {56 vars in 1102 bytes} [Thu Sep 29 01:58:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:33.521777 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ad5303-5903-4fca-8b24-6c056c0ebb0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:33.522433 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad5303-5903-4fca-8b24-6c056c0ebb0c None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:33.522712 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad5303-5903-4fca-8b24-6c056c0ebb0c None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:33.522983 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad5303-5903-4fca-8b24-6c056c0ebb0c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:33.529930 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271ff78a-4b0b-4057-9d13-51c94747371f None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:33.547429 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ad5303-5903-4fca-8b24-6c056c0ebb0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:58:33.559413 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-41ad5303-5903-4fca-8b24-6c056c0ebb0c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 29 01:58:33.559413 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:33.559413 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:33.559413 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:33.559413 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:33.559413 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:33.559413 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:33.559413 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:33.559413 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:33.559413 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:33.559413 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:33.559413 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:33.559413 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:58:33.559413 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:58:33.559413 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:58:33.559413 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:58:33.560340 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:58:33.560340 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:58:33.560340 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:58:33.560340 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:58:33.560340 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:33.560340 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:33.560340 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:33.560340 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:33.560340 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:33.560340 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:33.560340 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:33.560340 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:33.560340 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:33.560340 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:33.560340 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:33.560340 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:33.561137 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:33.561137 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:33.561137 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:33.561137 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:33.561137 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:58:33.561137 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:58:33.561137 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:58:33.561137 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:58:33.561137 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:58:33.561137 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:58:33.561137 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 29 01:58:33.561137 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:58:33.561768 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 250/486] 10.222.0.49 () {56 vars in 1102 bytes} [Thu Sep 29 01:58:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:33.570244 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ad5303-5903-4fca-8b24-6c056c0ebb0c None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:33.670147 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271ff78a-4b0b-4057-9d13-51c94747371f None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:33.708839 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02af6d19-b00a-4b45-8b55-4ed58264bd84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:33.709863 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af6d19-b00a-4b45-8b55-4ed58264bd84 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:33.710136 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af6d19-b00a-4b45-8b55-4ed58264bd84 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:33.710405 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af6d19-b00a-4b45-8b55-4ed58264bd84 None admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:33.711068 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02af6d19-b00a-4b45-8b55-4ed58264bd84 None admin] RBAC: Adding query filter params (name=service) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:33.711365 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02af6d19-b00a-4b45-8b55-4ed58264bd84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:33.712732 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02af6d19-b00a-4b45-8b55-4ed58264bd84 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:33.722165 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 237/487] 10.222.0.49 () {56 vars in 1103 bytes} [Thu Sep 29 01:58:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:33.727667 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02af6d19-b00a-4b45-8b55-4ed58264bd84 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:33.815764 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:33.820307 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ad5303-5903-4fca-8b24-6c056c0ebb0c None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:33.846938 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:33.862171 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659ebf74-b76f-4f49-ab91-b0c26aab3fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:33.862843 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ebf74-b76f-4f49-ab91-b0c26aab3fcf None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:33.863056 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ebf74-b76f-4f49-ab91-b0c26aab3fcf None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:33.863322 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ebf74-b76f-4f49-ab91-b0c26aab3fcf None admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:33.864004 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659ebf74-b76f-4f49-ab91-b0c26aab3fcf None admin] RBAC: Adding query filter params (name=service) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:33.864302 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659ebf74-b76f-4f49-ab91-b0c26aab3fcf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:33.865939 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659ebf74-b76f-4f49-ab91-b0c26aab3fcf None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:33.880320 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 251/488] 10.222.0.49 () {56 vars in 1103 bytes} [Thu Sep 29 01:58:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:58:33.881628 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9227689-9b2e-4d1a-abea-d664dbd05271 None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:33.882110 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9227689-9b2e-4d1a-abea-d664dbd05271 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:33.882382 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9227689-9b2e-4d1a-abea-d664dbd05271 None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:33.885067 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 252/489] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:58:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:58:33.887276 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9227689-9b2e-4d1a-abea-d664dbd05271 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:33.932347 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02af6d19-b00a-4b45-8b55-4ed58264bd84 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:33.970442 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee959814-deaa-4e1d-92f3-a458f3e0e8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:33.971346 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee959814-deaa-4e1d-92f3-a458f3e0e8b9 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:33.971761 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee959814-deaa-4e1d-92f3-a458f3e0e8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:33.972270 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee959814-deaa-4e1d-92f3-a458f3e0e8b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:33.983706 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee959814-deaa-4e1d-92f3-a458f3e0e8b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:33.986047 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee959814-deaa-4e1d-92f3-a458f3e0e8b9 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:34.001822 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-ee959814-deaa-4e1d-92f3-a458f3e0e8b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:34.001822 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:34.001822 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:34.001822 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:34.001822 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:34.001822 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:34.001822 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:34.001822 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:34.001822 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:34.001822 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:34.001822 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:34.001822 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:34.001822 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:58:34.001822 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:58:34.001822 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:58:34.001822 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:58:34.002989 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:34.002989 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:34.002989 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:34.002989 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:34.002989 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:34.002989 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:34.002989 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:34.002989 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:34.002989 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:34.002989 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:34.002989 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:34.002989 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:34.002989 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:34.002989 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:34.002989 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:34.002989 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:34.002989 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:58:34.003842 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:58:34.003842 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:34.003842 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:58:34.003842 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 238/490] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 01:58:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:34.004495 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1214de-261e-42cf-885e-132cf5cd2e05 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:34.004768 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1214de-261e-42cf-885e-132cf5cd2e05 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:34.005031 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1214de-261e-42cf-885e-132cf5cd2e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:34.015730 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9227689-9b2e-4d1a-abea-d664dbd05271 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:34.025072 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-af1214de-261e-42cf-885e-132cf5cd2e05 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:34.026406 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-af1214de-261e-42cf-885e-132cf5cd2e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:34.050465 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db98cc9-ae66-46c0-a7c0-f9dee093fbed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:34.051095 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db98cc9-ae66-46c0-a7c0-f9dee093fbed None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:34.051389 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db98cc9-ae66-46c0-a7c0-f9dee093fbed None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:34.051637 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db98cc9-ae66-46c0-a7c0-f9dee093fbed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:34.061981 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db98cc9-ae66-46c0-a7c0-f9dee093fbed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:34.063432 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db98cc9-ae66-46c0-a7c0-f9dee093fbed None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:34.078390 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-5db98cc9-ae66-46c0-a7c0-f9dee093fbed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:34.078390 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:34.078390 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:34.078390 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:34.078390 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:34.078390 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:34.078390 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:34.078390 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:34.078390 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:34.078390 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:34.078390 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:34.078390 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:34.078390 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:58:34.078390 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:58:34.078390 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:58:34.078390 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:58:34.079787 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:34.079787 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:34.079787 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:34.079787 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:34.079787 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:34.079787 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:34.079787 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:34.079787 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:34.079787 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:34.079787 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:34.079787 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:34.079787 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:34.079787 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:34.079787 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:34.079787 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:34.079787 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:34.079787 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:58:34.080711 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:58:34.080711 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:34.080711 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:58:34.080711 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 253/491] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 01:58:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:34.081415 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6638eca2-2714-468e-a997-0cb173f9b917 None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:34.081583 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6638eca2-2714-468e-a997-0cb173f9b917 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:34.081833 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6638eca2-2714-468e-a997-0cb173f9b917 None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:34.084699 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 254/492] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:58:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:58:34.084699 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6638eca2-2714-468e-a997-0cb173f9b917 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:34.107263 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 239/493] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:58:34.114229 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1214de-261e-42cf-885e-132cf5cd2e05 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:34.136028 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:34.142659 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:34.228156 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6638eca2-2714-468e-a997-0cb173f9b917 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:34.239470 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1214de-261e-42cf-885e-132cf5cd2e05 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:34.280579 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221bab0b-c151-4b83-bff8-9ba109223e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:34.281588 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221bab0b-c151-4b83-bff8-9ba109223e5c None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:34.282060 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221bab0b-c151-4b83-bff8-9ba109223e5c None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:34.283154 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221bab0b-c151-4b83-bff8-9ba109223e5c None admin] PATH_INFO: `/v3/domains` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:34.284000 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221bab0b-c151-4b83-bff8-9ba109223e5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:34.284424 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72572aa0-9a14-43e0-83f4-689293b5c1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:34.284749 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221bab0b-c151-4b83-bff8-9ba109223e5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:34.285046 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72572aa0-9a14-43e0-83f4-689293b5c1e2 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:34.285405 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72572aa0-9a14-43e0-83f4-689293b5c1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:34.285681 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72572aa0-9a14-43e0-83f4-689293b5c1e2 None admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:34.286384 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72572aa0-9a14-43e0-83f4-689293b5c1e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:34.286689 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72572aa0-9a14-43e0-83f4-689293b5c1e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:34.287384 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221bab0b-c151-4b83-bff8-9ba109223e5c None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:34.288040 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72572aa0-9a14-43e0-83f4-689293b5c1e2 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:34.302807 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 255/494] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Sep 29 01:58:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:34.304358 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb8aba-b082-4f6c-aef2-1b7c85cb3c7d None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:34.304855 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb8aba-b082-4f6c-aef2-1b7c85cb3c7d None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:34.305376 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb8aba-b082-4f6c-aef2-1b7c85cb3c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:34.307904 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 240/495] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Sep 29 01:58:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:34.308994 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72572aa0-9a14-43e0-83f4-689293b5c1e2 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:34.332911 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-cebb8aba-b082-4f6c-aef2-1b7c85cb3c7d None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:34.334184 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-cebb8aba-b082-4f6c-aef2-1b7c85cb3c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:34.399872 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:34.412471 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 256/496] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:58:34.413329 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebb8aba-b082-4f6c-aef2-1b7c85cb3c7d None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:34.430113 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72572aa0-9a14-43e0-83f4-689293b5c1e2 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:34.442845 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:34.466153 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea820447-3284-404e-bedd-edc0d63d0019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:34.466775 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea820447-3284-404e-bedd-edc0d63d0019 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:34.467049 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea820447-3284-404e-bedd-edc0d63d0019 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:34.467313 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea820447-3284-404e-bedd-edc0d63d0019 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:34.476650 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea820447-3284-404e-bedd-edc0d63d0019 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:34.478113 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea820447-3284-404e-bedd-edc0d63d0019 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:34.495382 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-ea820447-3284-404e-bedd-edc0d63d0019 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 29 01:58:34.495382 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:34.495382 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:34.495382 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:34.495382 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:34.495382 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:34.495382 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:34.495382 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:34.495382 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:34.495382 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:34.495382 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:34.495382 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:34.495382 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 29 01:58:34.495382 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 29 01:58:34.495382 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 29 01:58:34.495382 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 29 01:58:34.496301 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:34.496301 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:34.496301 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 29 01:58:34.496301 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:58:34.496301 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 29 01:58:34.496301 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:58:34.496301 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:34.496301 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:34.496301 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:34.496301 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:34.496301 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:34.496301 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:34.496301 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:34.496301 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:34.496301 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:34.496301 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:34.496301 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:34.496301 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:34.497190 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:34.497190 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:34.497190 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 29 01:58:34.497190 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 29 01:58:34.497190 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 29 01:58:34.497190 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 29 01:58:34.497190 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 29 01:58:34.497190 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 29 01:58:34.497190 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 29 01:58:34.497190 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:58:34.497190 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 241/497] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Sep 29 01:58:34 2022] GET /identity/v3/users/glance => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:34.498366 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3647df-208f-4377-a077-0f62d0075118 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:34.498366 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3647df-208f-4377-a077-0f62d0075118 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:34.498366 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3647df-208f-4377-a077-0f62d0075118 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:34.503016 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 242/498] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:58:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:58:34.503016 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3647df-208f-4377-a077-0f62d0075118 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:34.526519 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebb8aba-b082-4f6c-aef2-1b7c85cb3c7d None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:34.562264 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111d6ca5-6572-4973-b54a-db529e956e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:34.562888 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111d6ca5-6572-4973-b54a-db529e956e11 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:34.563427 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111d6ca5-6572-4973-b54a-db529e956e11 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:34.563427 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111d6ca5-6572-4973-b54a-db529e956e11 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:34.570498 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111d6ca5-6572-4973-b54a-db529e956e11 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:34.571873 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111d6ca5-6572-4973-b54a-db529e956e11 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:34.586372 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-111d6ca5-6572-4973-b54a-db529e956e11 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 29 01:58:34.586372 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:34.586372 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:34.586372 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:34.586372 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:34.586372 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:34.586372 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:34.586372 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:34.586372 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:34.586372 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:34.586372 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:34.586372 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:34.586372 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 29 01:58:34.586372 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 29 01:58:34.586372 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 29 01:58:34.586372 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 29 01:58:34.587263 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:34.587263 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:34.587263 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 29 01:58:34.587263 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:58:34.587263 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 29 01:58:34.587263 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:58:34.587263 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:34.587263 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:34.587263 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:34.587263 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:34.587263 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:34.587263 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:34.587263 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:34.587263 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:34.587263 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:34.587263 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:34.587263 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:34.587263 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:34.588119 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:34.588119 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:34.588119 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 29 01:58:34.588119 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 29 01:58:34.588119 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 29 01:58:34.588119 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 29 01:58:34.588119 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 29 01:58:34.588119 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 29 01:58:34.588119 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 29 01:58:34.588119 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:58:34.588119 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 257/499] 10.222.0.49 () {56 vars in 1093 bytes} [Thu Sep 29 01:58:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:34.588669 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111d6ca5-6572-4973-b54a-db529e956e11 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:34.618147 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3647df-208f-4377-a077-0f62d0075118 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:34.652366 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a50bf8-c139-4ec7-ac4d-872e2f7cfe95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:34.653002 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a50bf8-c139-4ec7-ac4d-872e2f7cfe95 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:34.653281 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a50bf8-c139-4ec7-ac4d-872e2f7cfe95 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:34.653585 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a50bf8-c139-4ec7-ac4d-872e2f7cfe95 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:34.662438 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:34.669372 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a50bf8-c139-4ec7-ac4d-872e2f7cfe95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:58:34.674885 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-05a50bf8-c139-4ec7-ac4d-872e2f7cfe95 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 29 01:58:34.674885 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:34.674885 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:34.674885 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:34.674885 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:34.674885 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:34.674885 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:34.674885 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:34.674885 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:34.674885 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:34.674885 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:34.674885 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:34.674885 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:58:34.674885 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:58:34.674885 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:58:34.674885 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:58:34.675916 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:58:34.675916 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:58:34.675916 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:58:34.675916 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:58:34.675916 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:34.675916 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:34.675916 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:34.675916 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:34.675916 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:34.675916 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:34.675916 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:34.675916 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:34.675916 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:34.675916 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:34.675916 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:34.675916 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:34.676823 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:34.676823 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:34.676823 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:34.676823 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:34.676823 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:58:34.676823 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:58:34.676823 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:58:34.676823 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:58:34.676823 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:58:34.676823 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:58:34.676823 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 29 01:58:34.676823 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:58:34.680869 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 243/500] 10.222.0.49 () {56 vars in 1102 bytes} [Thu Sep 29 01:58:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:34.682265 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82372ce-3f96-4d8f-a816-ae9ae7940529 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:34.682551 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82372ce-3f96-4d8f-a816-ae9ae7940529 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:34.682825 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82372ce-3f96-4d8f-a816-ae9ae7940529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:34.696913 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:34.701142 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-f82372ce-3f96-4d8f-a816-ae9ae7940529 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:34.702375 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-f82372ce-3f96-4d8f-a816-ae9ae7940529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:34.714083 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111d6ca5-6572-4973-b54a-db529e956e11 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:34.748977 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2133f79-2031-46ee-b27d-03cafe5c8acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:34.749621 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2133f79-2031-46ee-b27d-03cafe5c8acf None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:34.749904 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2133f79-2031-46ee-b27d-03cafe5c8acf None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:34.750179 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2133f79-2031-46ee-b27d-03cafe5c8acf None admin] PATH_INFO: `/v3/users` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:34.750897 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2133f79-2031-46ee-b27d-03cafe5c8acf None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:34.751497 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2133f79-2031-46ee-b27d-03cafe5c8acf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:34.752726 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2133f79-2031-46ee-b27d-03cafe5c8acf None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:34.769330 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 244/501] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:58:34.770200 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82372ce-3f96-4d8f-a816-ae9ae7940529 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:34.802549 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 258/502] 10.222.0.49 () {56 vars in 1137 bytes} [Thu Sep 29 01:58:34 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:34.803443 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2133f79-2031-46ee-b27d-03cafe5c8acf None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:34.896221 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82372ce-3f96-4d8f-a816-ae9ae7940529 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:34.931429 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:34.936308 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2133f79-2031-46ee-b27d-03cafe5c8acf None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:34.937584 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641d45a2-11a1-43a0-8026-0e5bda5e6c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:34.938274 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d45a2-11a1-43a0-8026-0e5bda5e6c78 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:34.939500 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d45a2-11a1-43a0-8026-0e5bda5e6c78 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:34.939776 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d45a2-11a1-43a0-8026-0e5bda5e6c78 None admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:34.940965 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641d45a2-11a1-43a0-8026-0e5bda5e6c78 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:34.941267 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641d45a2-11a1-43a0-8026-0e5bda5e6c78 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:34.943169 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641d45a2-11a1-43a0-8026-0e5bda5e6c78 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:34.983818 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 245/503] 10.222.0.49 () {56 vars in 1133 bytes} [Thu Sep 29 01:58:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:34.984674 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641d45a2-11a1-43a0-8026-0e5bda5e6c78 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:34.990548 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4280e730-0706-4e14-a8b4-13125490ff67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:34.991178 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4280e730-0706-4e14-a8b4-13125490ff67 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:34.991660 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4280e730-0706-4e14-a8b4-13125490ff67 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:34.992159 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4280e730-0706-4e14-a8b4-13125490ff67 None admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:34.993106 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4280e730-0706-4e14-a8b4-13125490ff67 None admin] RBAC: Adding query filter params (name=service) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:34.993471 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4280e730-0706-4e14-a8b4-13125490ff67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:34.995471 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4280e730-0706-4e14-a8b4-13125490ff67 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:35.013775 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 259/504] 10.222.0.49 () {56 vars in 1103 bytes} [Thu Sep 29 01:58:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:35.013775 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4280e730-0706-4e14-a8b4-13125490ff67 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:35.024444 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:35.108877 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641d45a2-11a1-43a0-8026-0e5bda5e6c78 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:35.148150 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18945aa-5ad0-4493-8310-33af891ae22e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:35.148953 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18945aa-5ad0-4493-8310-33af891ae22e None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:35.149228 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18945aa-5ad0-4493-8310-33af891ae22e None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:35.149521 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18945aa-5ad0-4493-8310-33af891ae22e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:35.154238 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4280e730-0706-4e14-a8b4-13125490ff67 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:35.160639 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18945aa-5ad0-4493-8310-33af891ae22e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:58:35.165531 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-f18945aa-5ad0-4493-8310-33af891ae22e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 29 01:58:35.165531 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:35.165531 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:35.165531 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:35.165531 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:35.165531 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:35.165531 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:35.165531 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:35.165531 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:35.165531 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:35.165531 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:35.165531 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:35.165531 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:58:35.165531 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:58:35.165531 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:58:35.165531 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:58:35.166518 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:58:35.166518 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:58:35.166518 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:58:35.166518 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:58:35.166518 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:35.166518 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:35.166518 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:35.166518 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:35.166518 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:35.166518 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:35.166518 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:35.166518 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:35.166518 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:35.166518 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:35.166518 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:35.166518 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:35.167556 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:35.167556 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:35.167556 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:35.167556 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:35.167556 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:58:35.167556 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:58:35.167556 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:58:35.167556 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:58:35.167556 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:58:35.167556 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:58:35.167556 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 29 01:58:35.167556 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:58:35.167556 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 246/505] 10.222.0.49 () {56 vars in 1102 bytes} [Thu Sep 29 01:58:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:35.168511 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18945aa-5ad0-4493-8310-33af891ae22e None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:35.194096 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc6e779-f4b2-471e-b1d6-4a077619c537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:35.195243 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc6e779-f4b2-471e-b1d6-4a077619c537 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:35.195243 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc6e779-f4b2-471e-b1d6-4a077619c537 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:35.195699 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc6e779-f4b2-471e-b1d6-4a077619c537 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:35.224371 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:35.270875 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc6e779-f4b2-471e-b1d6-4a077619c537 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:35.272372 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc6e779-f4b2-471e-b1d6-4a077619c537 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:35.280663 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:35.280985 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18945aa-5ad0-4493-8310-33af891ae22e None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:35.326090 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a3295d-6233-4bca-9402-6d54ee6042b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:35.326708 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a3295d-6233-4bca-9402-6d54ee6042b6 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:35.326990 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a3295d-6233-4bca-9402-6d54ee6042b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:35.327264 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a3295d-6233-4bca-9402-6d54ee6042b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:35.377794 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 260/506] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Sep 29 01:58:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 29 01:58:35.379743 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc6e779-f4b2-471e-b1d6-4a077619c537 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:35.397192 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a3295d-6233-4bca-9402-6d54ee6042b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:35.398773 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a3295d-6233-4bca-9402-6d54ee6042b6 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:35.455895 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:35.491198 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc6e779-f4b2-471e-b1d6-4a077619c537 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:35.499532 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:35.512982 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 247/507] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Sep 29 01:58:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 29 01:58:35.514072 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a3295d-6233-4bca-9402-6d54ee6042b6 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:35.529955 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1f4181-4190-45e5-b5c5-c8a3a8d7435e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:35.530591 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f4181-4190-45e5-b5c5-c8a3a8d7435e None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:35.530871 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f4181-4190-45e5-b5c5-c8a3a8d7435e None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:35.531148 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f4181-4190-45e5-b5c5-c8a3a8d7435e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:35.546555 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1f4181-4190-45e5-b5c5-c8a3a8d7435e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:35.548828 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1f4181-4190-45e5-b5c5-c8a3a8d7435e None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:35.565991 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-ce1f4181-4190-45e5-b5c5-c8a3a8d7435e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:35.565991 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:35.565991 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:35.565991 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:35.565991 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:35.565991 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:35.565991 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:35.565991 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:35.565991 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:35.565991 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:35.565991 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:35.565991 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:35.565991 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:58:35.565991 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:58:35.565991 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:58:35.565991 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:58:35.566972 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:35.566972 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:35.566972 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:35.566972 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:35.566972 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:35.566972 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:35.566972 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:35.566972 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:35.566972 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:35.566972 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:35.566972 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:35.566972 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:35.566972 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:35.566972 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:35.566972 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:35.566972 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:35.566972 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:58:35.567796 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:58:35.567796 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:35.567796 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:58:35.567796 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 261/508] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 01:58:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:35.568562 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1f4181-4190-45e5-b5c5-c8a3a8d7435e None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:35.630358 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a3295d-6233-4bca-9402-6d54ee6042b6 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:35.669794 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902137f4-816c-48bd-878d-255b51620a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:35.670358 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902137f4-816c-48bd-878d-255b51620a78 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:35.670834 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902137f4-816c-48bd-878d-255b51620a78 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:35.671273 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902137f4-816c-48bd-878d-255b51620a78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:35.680010 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1f4181-4190-45e5-b5c5-c8a3a8d7435e None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:35.683093 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902137f4-816c-48bd-878d-255b51620a78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:35.684659 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902137f4-816c-48bd-878d-255b51620a78 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:35.695018 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:35.703044 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-902137f4-816c-48bd-878d-255b51620a78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:35.703044 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:35.703044 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:35.703044 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:35.703044 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:35.703044 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:35.703044 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:35.703044 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:35.703044 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:35.703044 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:35.703044 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:35.703044 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:35.703044 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:58:35.703044 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:58:35.703044 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:58:35.703044 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:58:35.704793 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:35.704793 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:35.704793 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:35.704793 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:35.704793 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:35.704793 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:35.704793 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:35.704793 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:35.704793 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:35.704793 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:35.704793 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:35.704793 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:35.704793 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:35.704793 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:35.704793 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:35.704793 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:35.704793 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:58:35.706950 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:58:35.706950 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:35.706950 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:58:35.706950 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 248/509] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 01:58:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:35.706950 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902137f4-816c-48bd-878d-255b51620a78 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:35.720249 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f838af12-f69d-4211-85b4-e9cd57835de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:35.720973 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f838af12-f69d-4211-85b4-e9cd57835de5 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:35.721245 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f838af12-f69d-4211-85b4-e9cd57835de5 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:35.721541 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f838af12-f69d-4211-85b4-e9cd57835de5 None admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:35.722211 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f838af12-f69d-4211-85b4-e9cd57835de5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:35.722509 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f838af12-f69d-4211-85b4-e9cd57835de5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:35.723903 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f838af12-f69d-4211-85b4-e9cd57835de5 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:35.732242 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 262/510] 10.222.0.49 () {56 vars in 1103 bytes} [Thu Sep 29 01:58:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:35.732894 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f838af12-f69d-4211-85b4-e9cd57835de5 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:35.759291 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:35.814162 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902137f4-816c-48bd-878d-255b51620a78 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:35.837443 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f838af12-f69d-4211-85b4-e9cd57835de5 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:35.847717 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af18c1-8a51-4663-9e2f-0d330c56d732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:35.848345 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af18c1-8a51-4663-9e2f-0d330c56d732 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:35.848622 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af18c1-8a51-4663-9e2f-0d330c56d732 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:35.848894 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af18c1-8a51-4663-9e2f-0d330c56d732 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:35.859258 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9af18c1-8a51-4663-9e2f-0d330c56d732 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:35.860727 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9af18c1-8a51-4663-9e2f-0d330c56d732 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:35.871701 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8605944e-6461-480f-80f1-e3f78adc9419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:35.872323 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8605944e-6461-480f-80f1-e3f78adc9419 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:35.872599 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8605944e-6461-480f-80f1-e3f78adc9419 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:35.872864 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8605944e-6461-480f-80f1-e3f78adc9419 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:35.874932 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-c9af18c1-8a51-4663-9e2f-0d330c56d732 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:35.874932 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:35.874932 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:35.874932 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:35.874932 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:35.874932 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:35.874932 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:35.874932 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:35.874932 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:35.874932 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:35.874932 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:35.874932 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:35.874932 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:58:35.874932 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:58:35.874932 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:58:35.874932 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:58:35.876532 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:35.876532 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:35.876532 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:35.876532 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:35.876532 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:35.876532 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:35.876532 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:35.876532 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:35.876532 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:35.876532 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:35.876532 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:35.876532 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:35.876532 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:35.876532 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:35.876532 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:35.876532 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:35.876532 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:58:35.877941 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:58:35.877941 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:35.877941 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:58:35.881082 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 249/511] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 01:58:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:35.881939 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af18c1-8a51-4663-9e2f-0d330c56d732 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:35.886223 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8605944e-6461-480f-80f1-e3f78adc9419 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:35.887666 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8605944e-6461-480f-80f1-e3f78adc9419 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:35.902628 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-8605944e-6461-480f-80f1-e3f78adc9419 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:35.902628 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:35.902628 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:35.902628 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:35.902628 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:35.902628 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:35.902628 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:35.902628 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:35.902628 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:35.902628 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:35.902628 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:35.902628 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:35.902628 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:58:35.902628 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:58:35.902628 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:58:35.902628 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:58:35.903758 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:35.903758 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:35.903758 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:35.903758 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:35.903758 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:35.903758 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:35.903758 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:35.903758 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:35.903758 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:35.903758 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:35.903758 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:35.903758 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:35.903758 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:35.903758 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:35.903758 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:35.903758 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:35.903758 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:58:35.904594 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:58:35.904594 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:35.904594 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:58:35.904594 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 263/512] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 01:58:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:35.904951 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8605944e-6461-480f-80f1-e3f78adc9419 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:35.940846 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:35.974716 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:35.991285 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af18c1-8a51-4663-9e2f-0d330c56d732 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:36.006818 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8605944e-6461-480f-80f1-e3f78adc9419 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:36.024772 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f339831f-11e0-4b81-bbb5-82509a7a8e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:36.025398 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f339831f-11e0-4b81-bbb5-82509a7a8e1a None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:36.025674 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f339831f-11e0-4b81-bbb5-82509a7a8e1a None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:36.025958 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f339831f-11e0-4b81-bbb5-82509a7a8e1a None admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:36.026593 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f339831f-11e0-4b81-bbb5-82509a7a8e1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:36.026886 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f339831f-11e0-4b81-bbb5-82509a7a8e1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:36.028245 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f339831f-11e0-4b81-bbb5-82509a7a8e1a None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:36.040103 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 250/513] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Sep 29 01:58:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:36.040881 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f339831f-11e0-4b81-bbb5-82509a7a8e1a None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:36.046226 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89421077-dcd2-4d34-9a7a-b4b8a3abc03c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:36.046841 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89421077-dcd2-4d34-9a7a-b4b8a3abc03c None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:36.047122 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89421077-dcd2-4d34-9a7a-b4b8a3abc03c None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:36.047456 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89421077-dcd2-4d34-9a7a-b4b8a3abc03c None admin] PATH_INFO: `/v3/domains` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:36.048639 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89421077-dcd2-4d34-9a7a-b4b8a3abc03c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:36.049200 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89421077-dcd2-4d34-9a7a-b4b8a3abc03c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:36.052909 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89421077-dcd2-4d34-9a7a-b4b8a3abc03c None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:36.068314 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 264/514] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Sep 29 01:58:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:36.069230 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89421077-dcd2-4d34-9a7a-b4b8a3abc03c None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:36.144479 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f339831f-11e0-4b81-bbb5-82509a7a8e1a None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:36.157224 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:36.168324 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89421077-dcd2-4d34-9a7a-b4b8a3abc03c None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:36.179064 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9cd1ec-2080-4f02-8a17-92ba244788fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:36.179681 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9cd1ec-2080-4f02-8a17-92ba244788fb None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:36.179951 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9cd1ec-2080-4f02-8a17-92ba244788fb None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:36.180217 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9cd1ec-2080-4f02-8a17-92ba244788fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:36.190616 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9cd1ec-2080-4f02-8a17-92ba244788fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:36.192106 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9cd1ec-2080-4f02-8a17-92ba244788fb None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:36.198066 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:36.203441 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d378606-036c-4a79-9b54-de93b16b2f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:36.204188 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d378606-036c-4a79-9b54-de93b16b2f16 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:36.204447 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d378606-036c-4a79-9b54-de93b16b2f16 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:36.204726 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d378606-036c-4a79-9b54-de93b16b2f16 None admin] PATH_INFO: `/v3/domains` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:36.205384 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d378606-036c-4a79-9b54-de93b16b2f16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:36.205685 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d378606-036c-4a79-9b54-de93b16b2f16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:36.206805 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-8c9cd1ec-2080-4f02-8a17-92ba244788fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:36.206805 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:36.206805 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:36.206805 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:36.206805 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:36.206805 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:36.206805 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:36.206805 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:36.206805 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:36.206805 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:36.206805 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:36.206805 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:36.206805 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:58:36.206805 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:58:36.206805 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:58:36.206805 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:58:36.207851 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:36.207851 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:36.207851 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:36.207851 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:36.207851 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:36.207851 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:36.207851 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:36.207851 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:36.207851 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:36.207851 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:36.207851 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:36.207851 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:36.207851 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:36.207851 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:36.207851 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:36.207851 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:36.207851 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:58:36.208672 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:58:36.208672 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:36.208672 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:58:36.208846 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d378606-036c-4a79-9b54-de93b16b2f16 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:36.208913 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 251/515] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 01:58:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:36.208913 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9cd1ec-2080-4f02-8a17-92ba244788fb None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:36.222767 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 265/516] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Sep 29 01:58:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:36.223576 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d378606-036c-4a79-9b54-de93b16b2f16 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:36.310286 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9cd1ec-2080-4f02-8a17-92ba244788fb None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:36.321810 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d378606-036c-4a79-9b54-de93b16b2f16 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:36.343913 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfffc1fe-97b8-426e-bcfb-8bf83bbc64ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:36.344535 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfffc1fe-97b8-426e-bcfb-8bf83bbc64ba None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:36.345418 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfffc1fe-97b8-426e-bcfb-8bf83bbc64ba None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:36.345724 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfffc1fe-97b8-426e-bcfb-8bf83bbc64ba None admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:36.346403 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfffc1fe-97b8-426e-bcfb-8bf83bbc64ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:36.346699 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfffc1fe-97b8-426e-bcfb-8bf83bbc64ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:36.348052 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfffc1fe-97b8-426e-bcfb-8bf83bbc64ba None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:36.354985 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e0c8ba-fc02-45c2-85e9-348fa7c8ee96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:36.355611 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e0c8ba-fc02-45c2-85e9-348fa7c8ee96 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:36.355890 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e0c8ba-fc02-45c2-85e9-348fa7c8ee96 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:36.356161 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e0c8ba-fc02-45c2-85e9-348fa7c8ee96 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:36.359621 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 252/517] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Sep 29 01:58:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:36.360959 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfffc1fe-97b8-426e-bcfb-8bf83bbc64ba None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:36.365904 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e0c8ba-fc02-45c2-85e9-348fa7c8ee96 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:36.367431 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e0c8ba-fc02-45c2-85e9-348fa7c8ee96 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:36.378978 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-29e0c8ba-fc02-45c2-85e9-348fa7c8ee96 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 29 01:58:36.378978 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:36.378978 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:36.378978 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:36.378978 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:36.378978 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:36.378978 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:36.378978 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:36.378978 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:36.378978 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:36.378978 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:36.378978 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:36.378978 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 29 01:58:36.378978 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 29 01:58:36.378978 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 29 01:58:36.378978 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 29 01:58:36.384544 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:36.384544 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:36.384544 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 29 01:58:36.384544 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:58:36.384544 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 29 01:58:36.384544 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:58:36.384544 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:36.384544 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:36.384544 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:36.384544 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:36.384544 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:36.384544 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:36.384544 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:36.384544 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:36.384544 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:36.384544 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:36.384544 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:36.384544 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:36.385751 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:36.385751 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:36.385751 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 29 01:58:36.385751 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 29 01:58:36.385751 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 29 01:58:36.385751 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 29 01:58:36.385751 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 29 01:58:36.385751 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 29 01:58:36.385751 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 29 01:58:36.385751 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:58:36.385751 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 266/518] 10.222.0.49 () {56 vars in 1102 bytes} [Thu Sep 29 01:58:36 2022] GET /identity/v3/users/neutron => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:36.385751 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e0c8ba-fc02-45c2-85e9-348fa7c8ee96 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:36.387139 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:36.436372 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:36.461757 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfffc1fe-97b8-426e-bcfb-8bf83bbc64ba None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:36.488266 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e0c8ba-fc02-45c2-85e9-348fa7c8ee96 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:36.496519 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0d0aee-d13a-440f-8e38-1431c1919480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:36.497116 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d0aee-d13a-440f-8e38-1431c1919480 None admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:36.497430 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d0aee-d13a-440f-8e38-1431c1919480 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:36.497699 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d0aee-d13a-440f-8e38-1431c1919480 None admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:36.498340 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0d0aee-d13a-440f-8e38-1431c1919480 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:36.499766 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0d0aee-d13a-440f-8e38-1431c1919480 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:36.520347 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 253/519] 10.222.0.49 () {60 vars in 1132 bytes} [Thu Sep 29 01:58:36 2022] POST /identity/v3/users => generated 247 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 01:58:36.521241 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0d0aee-d13a-440f-8e38-1431c1919480 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:36.535131 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cb3bc4-bfe0-4a38-8923-974385eee118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:36.535909 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb3bc4-bfe0-4a38-8923-974385eee118 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:36.536258 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb3bc4-bfe0-4a38-8923-974385eee118 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:36.536599 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb3bc4-bfe0-4a38-8923-974385eee118 None admin] PATH_INFO: `/v3/domains` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:36.537373 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cb3bc4-bfe0-4a38-8923-974385eee118 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:36.537747 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cb3bc4-bfe0-4a38-8923-974385eee118 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:36.539266 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cb3bc4-bfe0-4a38-8923-974385eee118 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:36.554373 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 267/520] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Sep 29 01:58:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:36.555851 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cb3bc4-bfe0-4a38-8923-974385eee118 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:36.630689 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:36.653225 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0d0aee-d13a-440f-8e38-1431c1919480 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:36.681828 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cb3bc4-bfe0-4a38-8923-974385eee118 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:36.695978 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7f180f-afef-48e7-aec3-31131d91b9eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:36.696878 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7f180f-afef-48e7-aec3-31131d91b9eb None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:36.697162 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7f180f-afef-48e7-aec3-31131d91b9eb None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:36.698668 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7f180f-afef-48e7-aec3-31131d91b9eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:36.698799 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:36.706139 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7f180f-afef-48e7-aec3-31131d91b9eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:36.707611 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7f180f-afef-48e7-aec3-31131d91b9eb None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:36.721607 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-2c7f180f-afef-48e7-aec3-31131d91b9eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:58:36.721607 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:36.721607 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:36.721607 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:36.721607 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:36.721607 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:36.721607 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:36.721607 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:36.721607 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:36.721607 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:36.721607 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:36.721607 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:36.721607 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 29 01:58:36.721607 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 29 01:58:36.721607 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 29 01:58:36.722613 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 29 01:58:36.722613 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:36.722613 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:36.722613 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:36.722613 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:36.722613 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:36.722613 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:36.722613 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:36.722613 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:36.722613 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:36.722613 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:36.722613 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:36.722613 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:36.722613 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:36.722613 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:36.722613 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:36.722613 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:36.723727 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 29 01:58:36.723727 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 29 01:58:36.723727 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 29 01:58:36.723727 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 29 01:58:36.723727 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 29 01:58:36.723727 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 29 01:58:36.723727 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:58:36.723727 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:58:36.723727 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 254/521] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Sep 29 01:58:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:36.723727 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7f180f-afef-48e7-aec3-31131d91b9eb None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:36.725087 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c807f7-d4e2-4e15-a48a-f8ebbefe624f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:36.726193 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c807f7-d4e2-4e15-a48a-f8ebbefe624f None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:36.726193 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c807f7-d4e2-4e15-a48a-f8ebbefe624f None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:36.726382 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c807f7-d4e2-4e15-a48a-f8ebbefe624f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:36.734936 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c807f7-d4e2-4e15-a48a-f8ebbefe624f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:36.737760 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c807f7-d4e2-4e15-a48a-f8ebbefe624f None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:36.751709 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-90c807f7-d4e2-4e15-a48a-f8ebbefe624f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:58:36.751709 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:36.751709 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:36.751709 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:36.751709 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:36.751709 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:36.751709 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:36.751709 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:36.751709 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:36.751709 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:36.751709 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:36.751709 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:36.751709 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 29 01:58:36.751709 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 29 01:58:36.751709 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 29 01:58:36.752932 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 29 01:58:36.752932 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:36.752932 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:36.752932 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:36.752932 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:36.752932 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:36.752932 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:36.752932 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:36.752932 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:36.752932 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:36.752932 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:36.752932 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:36.752932 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:36.752932 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:36.752932 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:36.752932 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:36.752932 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:36.753988 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 29 01:58:36.753988 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 29 01:58:36.753988 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 29 01:58:36.753988 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 29 01:58:36.753988 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 29 01:58:36.753988 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 29 01:58:36.753988 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:58:36.753988 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:58:36.753988 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 268/522] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Sep 29 01:58:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:36.755206 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c807f7-d4e2-4e15-a48a-f8ebbefe624f None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:36.840309 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7f180f-afef-48e7-aec3-31131d91b9eb None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:36.858950 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c807f7-d4e2-4e15-a48a-f8ebbefe624f None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:36.878422 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99f3b4b-7f12-4c0d-9d1e-9a4f439da2f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:36.879242 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f3b4b-7f12-4c0d-9d1e-9a4f439da2f3 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:36.879520 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f3b4b-7f12-4c0d-9d1e-9a4f439da2f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:36.879778 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f3b4b-7f12-4c0d-9d1e-9a4f439da2f3 None admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:36.880504 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99f3b4b-7f12-4c0d-9d1e-9a4f439da2f3 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:36.880805 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99f3b4b-7f12-4c0d-9d1e-9a4f439da2f3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:36.882248 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99f3b4b-7f12-4c0d-9d1e-9a4f439da2f3 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:36.893627 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:36.895981 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8610324-552b-43cc-9df2-3dc70bf5ed8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:36.896716 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8610324-552b-43cc-9df2-3dc70bf5ed8c None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:36.897053 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8610324-552b-43cc-9df2-3dc70bf5ed8c None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:36.897411 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8610324-552b-43cc-9df2-3dc70bf5ed8c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:36.907394 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8610324-552b-43cc-9df2-3dc70bf5ed8c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:36.907394 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8610324-552b-43cc-9df2-3dc70bf5ed8c None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:36.914955 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 255/523] 10.222.0.49 () {56 vars in 1139 bytes} [Thu Sep 29 01:58:36 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:36.914955 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99f3b4b-7f12-4c0d-9d1e-9a4f439da2f3 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:36.920704 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-a8610324-552b-43cc-9df2-3dc70bf5ed8c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 29 01:58:36.920704 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:36.920704 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:36.920704 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:36.920704 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:36.920704 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:36.920704 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:36.920704 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:36.920704 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:36.920704 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:36.920704 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:36.920704 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:36.920704 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 29 01:58:36.920704 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 29 01:58:36.920704 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 29 01:58:36.920704 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 29 01:58:36.921896 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:36.921896 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:36.921896 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 29 01:58:36.921896 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:58:36.921896 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 29 01:58:36.921896 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:58:36.921896 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:36.921896 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:36.921896 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:36.921896 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:36.921896 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:36.921896 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:36.921896 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:36.921896 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:36.921896 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:36.921896 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:36.921896 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:36.921896 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:36.923596 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:36.923596 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:36.923596 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 29 01:58:36.923596 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 29 01:58:36.923596 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 29 01:58:36.923596 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 29 01:58:36.923596 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 29 01:58:36.923596 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 29 01:58:36.923596 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 29 01:58:36.923596 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:58:36.928644 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 269/524] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Sep 29 01:58:36 2022] GET /identity/v3/users/cinder => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:36.929522 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8610324-552b-43cc-9df2-3dc70bf5ed8c None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:36.964779 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:37.027745 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99f3b4b-7f12-4c0d-9d1e-9a4f439da2f3 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:37.046805 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8610324-552b-43cc-9df2-3dc70bf5ed8c None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:37.064403 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b760d310-4c62-491f-93f3-38587b10787b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:37.065559 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b760d310-4c62-491f-93f3-38587b10787b None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:37.065841 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b760d310-4c62-491f-93f3-38587b10787b None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:37.066265 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b760d310-4c62-491f-93f3-38587b10787b None admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:37.066964 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b760d310-4c62-491f-93f3-38587b10787b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:37.067277 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b760d310-4c62-491f-93f3-38587b10787b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:37.068701 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b760d310-4c62-491f-93f3-38587b10787b None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:37.084992 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf0f98a-bd67-44a6-9766-35ec1a37f558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:37.085645 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf0f98a-bd67-44a6-9766-35ec1a37f558 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:37.085918 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf0f98a-bd67-44a6-9766-35ec1a37f558 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:37.086181 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf0f98a-bd67-44a6-9766-35ec1a37f558 None admin] PATH_INFO: `/v3/projects` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:37.086855 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf0f98a-bd67-44a6-9766-35ec1a37f558 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:37.091938 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf0f98a-bd67-44a6-9766-35ec1a37f558 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:37.092094 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 256/525] 10.222.0.49 () {56 vars in 1148 bytes} [Thu Sep 29 01:58:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:37.092094 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b760d310-4c62-491f-93f3-38587b10787b None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:37.092281 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf0f98a-bd67-44a6-9766-35ec1a37f558 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:37.115002 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 270/526] 10.222.0.49 () {56 vars in 1148 bytes} [Thu Sep 29 01:58:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:37.115002 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf0f98a-bd67-44a6-9766-35ec1a37f558 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:37.157925 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:37.202186 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b760d310-4c62-491f-93f3-38587b10787b None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:37.214113 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:37.226219 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf0f98a-bd67-44a6-9766-35ec1a37f558 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:37.239040 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee01148-31b8-4e60-8a1a-46b0663fe831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:37.239790 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee01148-31b8-4e60-8a1a-46b0663fe831 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:37.240076 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee01148-31b8-4e60-8a1a-46b0663fe831 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:37.240345 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee01148-31b8-4e60-8a1a-46b0663fe831 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:37.262816 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e438917-8d07-45f9-b2ab-6139fccf1ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:37.263432 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e438917-8d07-45f9-b2ab-6139fccf1ea3 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:37.263708 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e438917-8d07-45f9-b2ab-6139fccf1ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:37.263978 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e438917-8d07-45f9-b2ab-6139fccf1ea3 None admin] PATH_INFO: `/v3/users` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:37.264705 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e438917-8d07-45f9-b2ab-6139fccf1ea3 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:37.265009 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e438917-8d07-45f9-b2ab-6139fccf1ea3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:37.266516 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e438917-8d07-45f9-b2ab-6139fccf1ea3 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:37.285870 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 271/527] 10.222.0.49 () {56 vars in 1137 bytes} [Thu Sep 29 01:58:37 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:37.286658 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e438917-8d07-45f9-b2ab-6139fccf1ea3 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:37.319194 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee01148-31b8-4e60-8a1a-46b0663fe831 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:37.320782 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee01148-31b8-4e60-8a1a-46b0663fe831 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:37.379881 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:37.394801 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e438917-8d07-45f9-b2ab-6139fccf1ea3 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:37.423164 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 257/528] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Sep 29 01:58:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 29 01:58:37.424404 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee01148-31b8-4e60-8a1a-46b0663fe831 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:37.437354 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495379de-9faf-4341-ae1d-983d23218e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:37.438232 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495379de-9faf-4341-ae1d-983d23218e10 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:37.439256 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495379de-9faf-4341-ae1d-983d23218e10 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:37.439935 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495379de-9faf-4341-ae1d-983d23218e10 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:37.440940 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495379de-9faf-4341-ae1d-983d23218e10 None admin] RBAC: Adding query filter params (role.id=393e6032e5cc4678b8351026fe4434f8, scope.project.id=6f1d8fd250c84c5887cb3173053ea2dd, user.id=5d36669146554031ba8596cb583cd6f9) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:37.441466 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495379de-9faf-4341-ae1d-983d23218e10 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:37.443143 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495379de-9faf-4341-ae1d-983d23218e10 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:37.449623 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 272/529] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Sep 29 01:58:37 2022] GET /identity/v3/role_assignments?user.id=5d36669146554031ba8596cb583cd6f9&scope.project.id=6f1d8fd250c84c5887cb3173053ea2dd&role.id=393e6032e5cc4678b8351026fe4434f8 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:37.450761 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495379de-9faf-4341-ae1d-983d23218e10 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:37.481122 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:37.557521 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee01148-31b8-4e60-8a1a-46b0663fe831 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:37.597294 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371d8c53-a9c0-4987-bfcf-febc4e8dd340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:37.598018 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d8c53-a9c0-4987-bfcf-febc4e8dd340 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:37.598343 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495379de-9faf-4341-ae1d-983d23218e10 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:37.598451 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d8c53-a9c0-4987-bfcf-febc4e8dd340 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:37.598727 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d8c53-a9c0-4987-bfcf-febc4e8dd340 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:37.599522 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371d8c53-a9c0-4987-bfcf-febc4e8dd340 None admin] RBAC: Adding query filter params (role.id=393e6032e5cc4678b8351026fe4434f8, scope.project.id=6f1d8fd250c84c5887cb3173053ea2dd, user.id=f3325a7111d447f4a9cf00c672d5420f) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:37.599891 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371d8c53-a9c0-4987-bfcf-febc4e8dd340 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:37.601438 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371d8c53-a9c0-4987-bfcf-febc4e8dd340 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:37.613775 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 258/530] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Sep 29 01:58:37 2022] GET /identity/v3/role_assignments?user.id=f3325a7111d447f4a9cf00c672d5420f&scope.project.id=6f1d8fd250c84c5887cb3173053ea2dd&role.id=393e6032e5cc4678b8351026fe4434f8 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:37.614842 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371d8c53-a9c0-4987-bfcf-febc4e8dd340 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:37.638926 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec0cfe0-ce15-431c-bba7-a613d10396e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:37.639568 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec0cfe0-ce15-431c-bba7-a613d10396e9 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:37.639844 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec0cfe0-ce15-431c-bba7-a613d10396e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:37.640113 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec0cfe0-ce15-431c-bba7-a613d10396e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:37.668798 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:37.724952 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec0cfe0-ce15-431c-bba7-a613d10396e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:37.726508 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec0cfe0-ce15-431c-bba7-a613d10396e9 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:37.743188 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:37.773763 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371d8c53-a9c0-4987-bfcf-febc4e8dd340 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:37.828346 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8be268-f6ee-4950-965a-15c1bd3ee559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:37.828921 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8be268-f6ee-4950-965a-15c1bd3ee559 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:37.833222 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8be268-f6ee-4950-965a-15c1bd3ee559 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:37.833542 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8be268-f6ee-4950-965a-15c1bd3ee559 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:37.859536 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8be268-f6ee-4950-965a-15c1bd3ee559 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:37.862323 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8be268-f6ee-4950-965a-15c1bd3ee559 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:37.870530 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 273/531] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Sep 29 01:58:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 29 01:58:37.880976 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec0cfe0-ce15-431c-bba7-a613d10396e9 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:37.885816 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-8f8be268-f6ee-4950-965a-15c1bd3ee559 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:37.885816 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:37.885816 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:37.885816 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:37.885816 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:37.885816 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:37.885816 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:37.885816 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:37.885816 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:37.885816 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:37.885816 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:37.885816 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:37.885816 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:58:37.885816 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:58:37.885816 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:58:37.885816 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:58:37.886725 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:37.886725 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:37.886725 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:37.886725 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:37.886725 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:37.886725 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:37.886725 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:37.886725 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:37.886725 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:37.886725 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:37.886725 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:37.886725 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:37.886725 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:37.886725 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:37.886725 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:37.886725 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:37.886725 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:58:37.887581 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:58:37.887581 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:37.887581 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:58:37.889716 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 259/532] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 01:58:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:37.895810 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8be268-f6ee-4950-965a-15c1bd3ee559 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:37.983240 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:38.000186 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec0cfe0-ce15-431c-bba7-a613d10396e9 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:38.011326 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8be268-f6ee-4950-965a-15c1bd3ee559 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:38.016057 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:38.046843 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81b7034-c399-4abb-9870-da3e3aac83cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:38.047495 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b7034-c399-4abb-9870-da3e3aac83cd None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:38.047849 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b7034-c399-4abb-9870-da3e3aac83cd None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:38.048146 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c78e711-4fda-4d13-a6e1-b1e74e8f678b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:38.048529 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b7034-c399-4abb-9870-da3e3aac83cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:38.049345 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c78e711-4fda-4d13-a6e1-b1e74e8f678b None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:38.049834 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c78e711-4fda-4d13-a6e1-b1e74e8f678b None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:38.050294 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c78e711-4fda-4d13-a6e1-b1e74e8f678b None admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:38.051131 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c78e711-4fda-4d13-a6e1-b1e74e8f678b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:38.051623 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c78e711-4fda-4d13-a6e1-b1e74e8f678b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:38.053188 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c78e711-4fda-4d13-a6e1-b1e74e8f678b None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:38.068813 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81b7034-c399-4abb-9870-da3e3aac83cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:38.070609 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81b7034-c399-4abb-9870-da3e3aac83cd None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:38.073088 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 260/533] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Sep 29 01:58:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:38.078584 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c78e711-4fda-4d13-a6e1-b1e74e8f678b None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:38.093609 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-d81b7034-c399-4abb-9870-da3e3aac83cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:38.093609 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:38.093609 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:38.093609 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:38.093609 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:38.093609 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:38.093609 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:38.093609 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:38.093609 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:38.093609 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:38.093609 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:38.093609 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:38.093609 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:58:38.093609 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:58:38.093609 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:58:38.093609 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:58:38.095125 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:38.095125 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:38.095125 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:38.095125 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:38.095125 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:38.095125 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:38.095125 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:38.095125 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:38.095125 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:38.095125 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:38.095125 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:38.095125 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:38.095125 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:38.095125 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:38.095125 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:38.095125 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:38.095125 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:58:38.096052 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:58:38.096052 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:38.096052 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:58:38.105766 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 274/534] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 01:58:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:38.106693 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81b7034-c399-4abb-9870-da3e3aac83cd None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:38.192882 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c78e711-4fda-4d13-a6e1-b1e74e8f678b None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:38.230767 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d8cefc-fc82-4648-9921-17b7a2f1c82e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:38.231780 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d8cefc-fc82-4648-9921-17b7a2f1c82e None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:38.232255 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d8cefc-fc82-4648-9921-17b7a2f1c82e None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:38.232724 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d8cefc-fc82-4648-9921-17b7a2f1c82e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:38.235619 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:38.247968 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d8cefc-fc82-4648-9921-17b7a2f1c82e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:38.249745 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d8cefc-fc82-4648-9921-17b7a2f1c82e None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:38.273339 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-13d8cefc-fc82-4648-9921-17b7a2f1c82e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:58:38.273339 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:38.273339 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:38.273339 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:38.273339 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:38.273339 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:38.273339 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:38.273339 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:38.273339 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:38.273339 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:38.273339 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:38.273339 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:38.273339 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 29 01:58:38.273339 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 29 01:58:38.273339 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 29 01:58:38.274224 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 29 01:58:38.274224 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:38.274224 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:38.274224 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:38.274224 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:38.274224 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:38.274224 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:38.274224 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:38.274224 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:38.274224 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:38.274224 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:38.274224 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:38.274224 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:38.274224 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:38.274224 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:38.274224 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:38.274224 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:38.275059 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 29 01:58:38.275059 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 29 01:58:38.275059 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 29 01:58:38.275059 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 29 01:58:38.275059 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 29 01:58:38.275059 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 29 01:58:38.275059 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:58:38.275059 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:58:38.283468 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 261/535] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Sep 29 01:58:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:38.287645 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d8cefc-fc82-4648-9921-17b7a2f1c82e None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:38.316246 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81b7034-c399-4abb-9870-da3e3aac83cd None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:38.364422 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c1ccef-05cd-4e21-b0a2-319cd482e3bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:38.365407 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1ccef-05cd-4e21-b0a2-319cd482e3bc None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:38.367462 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1ccef-05cd-4e21-b0a2-319cd482e3bc None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:38.367944 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1ccef-05cd-4e21-b0a2-319cd482e3bc None admin] PATH_INFO: `/v3/domains` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:38.369170 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c1ccef-05cd-4e21-b0a2-319cd482e3bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:38.372248 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c1ccef-05cd-4e21-b0a2-319cd482e3bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:38.373898 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c1ccef-05cd-4e21-b0a2-319cd482e3bc None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:38.402172 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 275/536] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Sep 29 01:58:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:38.407585 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c1ccef-05cd-4e21-b0a2-319cd482e3bc None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:38.447475 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:38.495802 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d8cefc-fc82-4648-9921-17b7a2f1c82e None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:38.557999 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed10fa0c-73b3-4bf6-862e-d6131333a84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:38.558618 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed10fa0c-73b3-4bf6-862e-d6131333a84f None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:38.558894 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed10fa0c-73b3-4bf6-862e-d6131333a84f None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:38.559176 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed10fa0c-73b3-4bf6-862e-d6131333a84f None admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:38.559948 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed10fa0c-73b3-4bf6-862e-d6131333a84f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:38.560250 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed10fa0c-73b3-4bf6-862e-d6131333a84f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:38.562511 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed10fa0c-73b3-4bf6-862e-d6131333a84f None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:38.574314 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c1ccef-05cd-4e21-b0a2-319cd482e3bc None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:38.588693 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 262/537] 10.222.0.49 () {56 vars in 1148 bytes} [Thu Sep 29 01:58:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:38.601876 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed10fa0c-73b3-4bf6-862e-d6131333a84f None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:38.618139 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd6d903-8a95-4c70-8cd3-557fd9fd8d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:38.618708 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd6d903-8a95-4c70-8cd3-557fd9fd8d24 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:38.618989 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd6d903-8a95-4c70-8cd3-557fd9fd8d24 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:38.619263 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd6d903-8a95-4c70-8cd3-557fd9fd8d24 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:38.627893 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd6d903-8a95-4c70-8cd3-557fd9fd8d24 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:38.629535 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd6d903-8a95-4c70-8cd3-557fd9fd8d24 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:38.642188 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-bbd6d903-8a95-4c70-8cd3-557fd9fd8d24 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:58:38.642188 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:38.642188 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:38.642188 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:38.642188 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:38.642188 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:38.642188 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:38.642188 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:38.642188 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:38.642188 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:38.642188 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:38.642188 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:38.642188 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 29 01:58:38.642188 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 29 01:58:38.642188 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 29 01:58:38.643084 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 29 01:58:38.643084 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:38.643084 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:38.643084 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:38.643084 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:38.643084 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:38.643084 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:38.643084 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:38.643084 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:38.643084 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:38.643084 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:38.643084 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:38.643084 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:38.643084 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:38.643084 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:38.643084 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:38.643084 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:38.644143 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 29 01:58:38.644143 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 29 01:58:38.644143 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 29 01:58:38.644143 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 29 01:58:38.644143 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 29 01:58:38.644143 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 29 01:58:38.644143 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:58:38.644143 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:58:38.644143 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 276/538] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Sep 29 01:58:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:38.648932 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd6d903-8a95-4c70-8cd3-557fd9fd8d24 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:38.757616 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:38.769673 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:38.794946 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd6d903-8a95-4c70-8cd3-557fd9fd8d24 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:38.848377 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed10fa0c-73b3-4bf6-862e-d6131333a84f None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:38.857421 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25108e2c-abb0-47b8-8fe2-373e6d3d6611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:38.858253 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25108e2c-abb0-47b8-8fe2-373e6d3d6611 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:38.858706 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25108e2c-abb0-47b8-8fe2-373e6d3d6611 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:38.859148 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25108e2c-abb0-47b8-8fe2-373e6d3d6611 None admin] PATH_INFO: `/v3/projects` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:38.860033 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25108e2c-abb0-47b8-8fe2-373e6d3d6611 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:38.860581 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25108e2c-abb0-47b8-8fe2-373e6d3d6611 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:38.862937 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25108e2c-abb0-47b8-8fe2-373e6d3d6611 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:38.880371 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 277/539] 10.222.0.49 () {56 vars in 1148 bytes} [Thu Sep 29 01:58:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:38.882053 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd4eeb-2998-4c1c-8c08-c2e57366f102 None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:38.882534 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd4eeb-2998-4c1c-8c08-c2e57366f102 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:38.882977 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd4eeb-2998-4c1c-8c08-c2e57366f102 None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:38.884548 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 278/540] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:58:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:58:38.886025 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bd4eeb-2998-4c1c-8c08-c2e57366f102 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:38.907992 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29f8b9b-59bf-4b63-bd9e-312369a65b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:38.907992 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29f8b9b-59bf-4b63-bd9e-312369a65b9d None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:38.907992 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29f8b9b-59bf-4b63-bd9e-312369a65b9d None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:38.907992 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29f8b9b-59bf-4b63-bd9e-312369a65b9d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:38.908642 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29f8b9b-59bf-4b63-bd9e-312369a65b9d None admin] RBAC: Adding query filter params (role.id=393e6032e5cc4678b8351026fe4434f8, scope.project.id=6f1d8fd250c84c5887cb3173053ea2dd, user.id=2053f823bd3c4098a43c299890c1f733) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:38.909032 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29f8b9b-59bf-4b63-bd9e-312369a65b9d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:38.910582 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29f8b9b-59bf-4b63-bd9e-312369a65b9d None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:38.921499 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 263/541] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Sep 29 01:58:38 2022] GET /identity/v3/role_assignments?user.id=2053f823bd3c4098a43c299890c1f733&scope.project.id=6f1d8fd250c84c5887cb3173053ea2dd&role.id=393e6032e5cc4678b8351026fe4434f8 => generated 259 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:38.923286 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13941515-9a01-4d9f-9d8d-95bef6ec2530 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:38.924789 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13941515-9a01-4d9f-9d8d-95bef6ec2530 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:38.925292 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13941515-9a01-4d9f-9d8d-95bef6ec2530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:38.964603 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-13941515-9a01-4d9f-9d8d-95bef6ec2530 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:38.966796 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-13941515-9a01-4d9f-9d8d-95bef6ec2530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:39.089726 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 264/542] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:58:39.095713 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bd4eeb-2998-4c1c-8c08-c2e57366f102 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:39.131216 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a4498d-b21e-42a2-979a-29f2c6a8c705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:39.131753 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a4498d-b21e-42a2-979a-29f2c6a8c705 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:39.132036 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a4498d-b21e-42a2-979a-29f2c6a8c705 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:39.132306 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a4498d-b21e-42a2-979a-29f2c6a8c705 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:39.133024 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a4498d-b21e-42a2-979a-29f2c6a8c705 None admin] RBAC: Adding query filter params (role.id=393e6032e5cc4678b8351026fe4434f8, scope.project.id=6f1d8fd250c84c5887cb3173053ea2dd, user.id=e75135b856134ba4b9ccac337886f682) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:39.133345 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a4498d-b21e-42a2-979a-29f2c6a8c705 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:39.134776 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a4498d-b21e-42a2-979a-29f2c6a8c705 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:39.140649 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 279/543] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Sep 29 01:58:38 2022] GET /identity/v3/role_assignments?user.id=e75135b856134ba4b9ccac337886f682&scope.project.id=6f1d8fd250c84c5887cb3173053ea2dd&role.id=393e6032e5cc4678b8351026fe4434f8 => generated 259 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:39.449556 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13941515-9a01-4d9f-9d8d-95bef6ec2530 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:39.502825 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:39.566117 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13941515-9a01-4d9f-9d8d-95bef6ec2530 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:39.620810 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efb2b0b-d05a-4f92-b567-f11c6acafbe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:39.621490 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb2b0b-d05a-4f92-b567-f11c6acafbe8 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:39.621768 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb2b0b-d05a-4f92-b567-f11c6acafbe8 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:39.622039 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb2b0b-d05a-4f92-b567-f11c6acafbe8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:39.638678 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efb2b0b-d05a-4f92-b567-f11c6acafbe8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:58:39.643768 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-0efb2b0b-d05a-4f92-b567-f11c6acafbe8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 29 01:58:39.643768 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:39.643768 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:39.643768 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:39.643768 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:39.643768 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:39.643768 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:39.643768 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:39.643768 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:39.643768 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:39.643768 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:39.643768 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:39.643768 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:58:39.643768 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:58:39.643768 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:58:39.643768 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:58:39.644610 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:58:39.644610 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:58:39.644610 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:58:39.644610 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:58:39.644610 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:39.644610 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:39.644610 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:39.644610 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:39.644610 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:39.644610 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:39.644610 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:39.644610 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:39.644610 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:39.644610 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:39.644610 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:39.644610 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:39.645403 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:39.645403 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:39.645403 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:39.645403 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:39.645403 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:58:39.645403 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:58:39.645403 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:58:39.645403 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:58:39.645403 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:58:39.645403 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:58:39.645403 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 29 01:58:39.645403 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:58:39.645403 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 265/544] 10.222.0.49 () {56 vars in 1102 bytes} [Thu Sep 29 01:58:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:39.651020 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a4498d-b21e-42a2-979a-29f2c6a8c705 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:39.670833 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:39.787571 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a4498d-b21e-42a2-979a-29f2c6a8c705 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:39.837134 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388fe160-b8dc-43a8-b8d3-ffb11439e06e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:39.837780 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388fe160-b8dc-43a8-b8d3-ffb11439e06e None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:39.838058 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388fe160-b8dc-43a8-b8d3-ffb11439e06e None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:39.838328 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388fe160-b8dc-43a8-b8d3-ffb11439e06e None admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:39.838993 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388fe160-b8dc-43a8-b8d3-ffb11439e06e None admin] RBAC: Adding query filter params (name=service) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:39.839293 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388fe160-b8dc-43a8-b8d3-ffb11439e06e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:39.840659 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388fe160-b8dc-43a8-b8d3-ffb11439e06e None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:39.852789 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 280/545] 10.222.0.49 () {56 vars in 1103 bytes} [Thu Sep 29 01:58:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:39.858515 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efb2b0b-d05a-4f92-b567-f11c6acafbe8 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:40.016047 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efb2b0b-d05a-4f92-b567-f11c6acafbe8 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:40.032913 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:40.067542 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6793c60d-0760-4a5c-af70-83b90578568a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:40.068183 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6793c60d-0760-4a5c-af70-83b90578568a None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:40.068452 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6793c60d-0760-4a5c-af70-83b90578568a None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:40.068722 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6793c60d-0760-4a5c-af70-83b90578568a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:40.085103 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6793c60d-0760-4a5c-af70-83b90578568a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:40.086599 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6793c60d-0760-4a5c-af70-83b90578568a None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:40.100585 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e796532-4160-4ce9-a1fc-9101985edea8 None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:40.101123 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e796532-4160-4ce9-a1fc-9101985edea8 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:40.101123 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e796532-4160-4ce9-a1fc-9101985edea8 None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:40.102663 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 281/546] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:58:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:58:40.108310 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437edf09-6a69-42be-b0d4-7e2e5283c3f3 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:40.108592 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437edf09-6a69-42be-b0d4-7e2e5283c3f3 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:40.108869 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437edf09-6a69-42be-b0d4-7e2e5283c3f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:40.109109 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-6793c60d-0760-4a5c-af70-83b90578568a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:40.109109 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:40.109109 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:40.109109 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:40.109109 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:40.109109 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:40.109109 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:40.109109 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:40.109109 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:40.109109 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:40.109109 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:40.109109 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:40.109109 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:58:40.109109 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:58:40.109109 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:58:40.109109 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:58:40.110302 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:40.110302 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:40.110302 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:40.110302 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:40.110302 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:40.110302 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:40.110302 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:40.110302 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:40.110302 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:40.110302 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:40.110302 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:40.110302 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:40.110302 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:40.110302 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:40.110302 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:40.110302 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:40.110302 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:58:40.111256 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:58:40.111256 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:40.111256 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:58:40.111256 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 266/547] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 01:58:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:40.118053 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6793c60d-0760-4a5c-af70-83b90578568a None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:40.134211 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-437edf09-6a69-42be-b0d4-7e2e5283c3f3 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:40.135500 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-437edf09-6a69-42be-b0d4-7e2e5283c3f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:40.286083 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 282/548] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 29 01:58:40.294641 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc8f1ea-7c9a-43af-ae55-0fdb9ee9575c None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:40.294956 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc8f1ea-7c9a-43af-ae55-0fdb9ee9575c None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:40.295212 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc8f1ea-7c9a-43af-ae55-0fdb9ee9575c None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:40.296633 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 283/549] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:58:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 29 01:58:40.302594 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c215e5-d29e-469f-ac92-d8decdc2bfd4 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:40.302831 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c215e5-d29e-469f-ac92-d8decdc2bfd4 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:40.303094 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c215e5-d29e-469f-ac92-d8decdc2bfd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:40.309628 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:40.324141 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-90c215e5-d29e-469f-ac92-d8decdc2bfd4 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:40.325541 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-90c215e5-d29e-469f-ac92-d8decdc2bfd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:40.333532 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6793c60d-0760-4a5c-af70-83b90578568a None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:40.397409 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1562a511-d733-4e3a-89c4-359276b546cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:40.398011 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1562a511-d733-4e3a-89c4-359276b546cc None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:40.398283 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1562a511-d733-4e3a-89c4-359276b546cc None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:40.398544 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1562a511-d733-4e3a-89c4-359276b546cc None admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:40.399179 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1562a511-d733-4e3a-89c4-359276b546cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:40.399472 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1562a511-d733-4e3a-89c4-359276b546cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:40.403052 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1562a511-d733-4e3a-89c4-359276b546cc None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:40.427199 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 267/550] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Sep 29 01:58:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:58:40.433267 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1562a511-d733-4e3a-89c4-359276b546cc None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:40.456148 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 284/551] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:58:40.464071 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:40.544080 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1562a511-d733-4e3a-89c4-359276b546cc None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:40.579708 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302c40e1-3a89-4215-85d6-b51e69f78c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:40.580556 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c40e1-3a89-4215-85d6-b51e69f78c5c None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:40.580734 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c215e5-d29e-469f-ac92-d8decdc2bfd4 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:40.580832 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c40e1-3a89-4215-85d6-b51e69f78c5c None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:40.581098 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c40e1-3a89-4215-85d6-b51e69f78c5c None admin] PATH_INFO: `/v3/users/swift` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:40.598214 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302c40e1-3a89-4215-85d6-b51e69f78c5c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:40.599648 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302c40e1-3a89-4215-85d6-b51e69f78c5c None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:40.621340 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-302c40e1-3a89-4215-85d6-b51e69f78c5c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 29 01:58:40.621340 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:40.621340 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:40.621340 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:40.621340 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:40.621340 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:40.621340 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:40.621340 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:40.621340 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:40.621340 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:40.621340 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:40.621340 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:40.621340 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 29 01:58:40.621340 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 29 01:58:40.621340 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 29 01:58:40.621340 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 29 01:58:40.622447 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:40.622447 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:40.622447 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 29 01:58:40.622447 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:58:40.622447 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 29 01:58:40.622447 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:58:40.622447 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:40.622447 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:40.622447 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:40.622447 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:40.622447 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:40.622447 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:40.622447 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:40.622447 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:40.622447 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:40.622447 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:40.622447 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:40.622447 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:40.623370 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:40.623370 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:40.623370 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 29 01:58:40.623370 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 29 01:58:40.623370 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 29 01:58:40.623370 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 29 01:58:40.623370 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 29 01:58:40.623370 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 29 01:58:40.623370 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 29 01:58:40.623370 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:58:40.623370 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 268/552] 10.222.0.49 () {56 vars in 1096 bytes} [Thu Sep 29 01:58:40 2022] GET /identity/v3/users/swift => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 01:58:40.629698 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302c40e1-3a89-4215-85d6-b51e69f78c5c None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:40.732852 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:40.755901 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302c40e1-3a89-4215-85d6-b51e69f78c5c None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:40.769301 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c215e5-d29e-469f-ac92-d8decdc2bfd4 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:40.793435 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbb50c8-1f4e-43d2-a772-850626eb41c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:40.794475 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb50c8-1f4e-43d2-a772-850626eb41c1 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:40.794948 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb50c8-1f4e-43d2-a772-850626eb41c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:40.795413 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb50c8-1f4e-43d2-a772-850626eb41c1 None admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:40.796332 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbb50c8-1f4e-43d2-a772-850626eb41c1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:40.796848 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbb50c8-1f4e-43d2-a772-850626eb41c1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:40.799319 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbb50c8-1f4e-43d2-a772-850626eb41c1 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:40.818346 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 269/553] 10.222.0.49 () {56 vars in 1135 bytes} [Thu Sep 29 01:58:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:40.823576 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbb50c8-1f4e-43d2-a772-850626eb41c1 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:40.826398 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:40.835402 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f9a681-c1d5-4f70-a489-a027fbb7d0ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:40.835965 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f9a681-c1d5-4f70-a489-a027fbb7d0ba None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:40.836240 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f9a681-c1d5-4f70-a489-a027fbb7d0ba None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:40.836506 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f9a681-c1d5-4f70-a489-a027fbb7d0ba None admin] PATH_INFO: `/v3/roles/service` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:40.853992 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f9a681-c1d5-4f70-a489-a027fbb7d0ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:58:40.858841 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-36f9a681-c1d5-4f70-a489-a027fbb7d0ba None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 29 01:58:40.858841 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:40.858841 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:40.858841 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:40.858841 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:40.858841 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:40.858841 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:40.858841 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:40.858841 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:40.858841 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:40.858841 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:40.858841 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:40.858841 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:58:40.858841 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:58:40.858841 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:58:40.858841 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:58:40.859848 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:58:40.859848 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:58:40.859848 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:58:40.859848 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:58:40.859848 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:40.859848 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:40.859848 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:40.859848 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:40.859848 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:40.859848 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:40.859848 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:40.859848 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:40.859848 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:40.859848 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:40.859848 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:40.859848 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:40.860756 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:40.860756 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:40.860756 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:40.860756 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:40.860756 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:58:40.860756 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:58:40.860756 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:58:40.860756 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:58:40.860756 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:58:40.860756 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:58:40.860756 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 29 01:58:40.860756 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:58:40.860756 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 285/554] 10.222.0.49 () {56 vars in 1102 bytes} [Thu Sep 29 01:58:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:40.861461 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f9a681-c1d5-4f70-a489-a027fbb7d0ba None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:40.952288 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbb50c8-1f4e-43d2-a772-850626eb41c1 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:40.977323 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f9a681-c1d5-4f70-a489-a027fbb7d0ba None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:40.994747 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89e817d-b64b-41f8-97d2-d8be52061ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:40.995407 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e817d-b64b-41f8-97d2-d8be52061ca0 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:40.995938 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e817d-b64b-41f8-97d2-d8be52061ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:40.996488 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e817d-b64b-41f8-97d2-d8be52061ca0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:41.005446 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:41.020793 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b147f320-472b-4095-b22f-bf17c301b687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:41.021467 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b147f320-472b-4095-b22f-bf17c301b687 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:41.021729 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b147f320-472b-4095-b22f-bf17c301b687 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:41.022035 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b147f320-472b-4095-b22f-bf17c301b687 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:41.033444 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b147f320-472b-4095-b22f-bf17c301b687 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:58:41.038673 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-b147f320-472b-4095-b22f-bf17c301b687 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 29 01:58:41.038673 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:41.038673 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:41.038673 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:41.038673 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:41.038673 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:41.038673 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:41.038673 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:41.038673 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:41.038673 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:41.038673 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:41.038673 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:41.038673 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:58:41.038673 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:58:41.038673 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:58:41.038673 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:58:41.039641 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:58:41.039641 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:58:41.039641 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:58:41.039641 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:58:41.039641 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:41.039641 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:41.039641 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:41.039641 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:41.039641 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:41.039641 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:41.039641 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:41.039641 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:41.039641 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:41.039641 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:41.039641 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:41.039641 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:41.040451 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:41.040451 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:41.040451 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:41.040451 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:41.040451 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:58:41.040451 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:58:41.040451 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:58:41.040451 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:58:41.040451 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:58:41.040451 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:58:41.040451 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 29 01:58:41.040451 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:58:41.044830 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 286/555] 10.222.0.49 () {56 vars in 1102 bytes} [Thu Sep 29 01:58:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:41.045755 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b147f320-472b-4095-b22f-bf17c301b687 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:41.083653 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89e817d-b64b-41f8-97d2-d8be52061ca0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:41.086479 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89e817d-b64b-41f8-97d2-d8be52061ca0 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:41.106696 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:41.155648 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b147f320-472b-4095-b22f-bf17c301b687 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:41.192191 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9f968f-5943-4a50-b0b8-99863d92ae98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:41.192800 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9f968f-5943-4a50-b0b8-99863d92ae98 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:41.193072 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9f968f-5943-4a50-b0b8-99863d92ae98 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:41.193354 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9f968f-5943-4a50-b0b8-99863d92ae98 None admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:41.194016 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9f968f-5943-4a50-b0b8-99863d92ae98 None admin] RBAC: Adding query filter params (name=service) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:41.194359 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9f968f-5943-4a50-b0b8-99863d92ae98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:41.195669 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9f968f-5943-4a50-b0b8-99863d92ae98 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:41.204305 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 287/556] 10.222.0.49 () {56 vars in 1103 bytes} [Thu Sep 29 01:58:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:41.205117 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9f968f-5943-4a50-b0b8-99863d92ae98 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:41.214963 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 270/557] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Sep 29 01:58:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 29 01:58:41.216814 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89e817d-b64b-41f8-97d2-d8be52061ca0 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:41.269972 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:41.312737 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9f968f-5943-4a50-b0b8-99863d92ae98 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:41.328434 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:41.348419 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89e817d-b64b-41f8-97d2-d8be52061ca0 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:41.352054 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20441b6-9099-48b5-969f-1b9aa621039a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:41.352709 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20441b6-9099-48b5-969f-1b9aa621039a None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:41.352942 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20441b6-9099-48b5-969f-1b9aa621039a None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:41.353202 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20441b6-9099-48b5-969f-1b9aa621039a None admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:41.353904 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20441b6-9099-48b5-969f-1b9aa621039a None admin] RBAC: Adding query filter params (name=service) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:41.354203 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20441b6-9099-48b5-969f-1b9aa621039a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:41.355570 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20441b6-9099-48b5-969f-1b9aa621039a None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:41.369270 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 288/558] 10.222.0.49 () {56 vars in 1103 bytes} [Thu Sep 29 01:58:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:41.370016 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20441b6-9099-48b5-969f-1b9aa621039a None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:41.399237 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215c0824-cedd-4e48-acfb-587581a74f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:41.400635 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c0824-cedd-4e48-acfb-587581a74f14 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:41.401406 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c0824-cedd-4e48-acfb-587581a74f14 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:41.401913 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c0824-cedd-4e48-acfb-587581a74f14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:41.417742 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215c0824-cedd-4e48-acfb-587581a74f14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:41.419494 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215c0824-cedd-4e48-acfb-587581a74f14 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:41.435143 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-215c0824-cedd-4e48-acfb-587581a74f14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:41.435143 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:41.435143 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:41.435143 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:41.435143 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:41.435143 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:41.435143 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:41.435143 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:41.435143 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:41.435143 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:41.435143 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:41.435143 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:41.435143 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:58:41.435143 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:58:41.435143 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:58:41.435143 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:58:41.436173 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:41.436173 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:41.436173 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:41.436173 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:41.436173 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:41.436173 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:41.436173 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:41.436173 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:41.436173 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:41.436173 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:41.436173 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:41.436173 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:41.436173 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:41.436173 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:41.436173 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:41.436173 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:41.436173 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:58:41.437058 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:58:41.437058 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:41.437058 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:58:41.437058 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 271/559] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 01:58:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:41.437834 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215c0824-cedd-4e48-acfb-587581a74f14 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:41.503391 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20441b6-9099-48b5-969f-1b9aa621039a None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:41.534333 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:41.546328 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215c0824-cedd-4e48-acfb-587581a74f14 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:41.553878 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e64954-d542-48a1-a50c-748d0916d398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:41.555046 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e64954-d542-48a1-a50c-748d0916d398 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:41.555589 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e64954-d542-48a1-a50c-748d0916d398 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:41.557004 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e64954-d542-48a1-a50c-748d0916d398 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:41.576364 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e64954-d542-48a1-a50c-748d0916d398 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:41.580230 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e64954-d542-48a1-a50c-748d0916d398 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:41.591304 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226e5668-2842-4601-ad2a-7b10f8ee55ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:41.592335 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e5668-2842-4601-ad2a-7b10f8ee55ef None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:41.592335 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e5668-2842-4601-ad2a-7b10f8ee55ef None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:41.592535 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e5668-2842-4601-ad2a-7b10f8ee55ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:41.604464 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-23e64954-d542-48a1-a50c-748d0916d398 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:41.604464 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:41.604464 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:41.604464 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:41.604464 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:41.604464 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:41.604464 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:41.604464 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:41.604464 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:41.604464 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:41.604464 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:41.604464 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:41.604464 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:58:41.604464 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:58:41.604464 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:58:41.604464 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:58:41.605491 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:41.605491 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:41.605491 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:41.605491 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:41.605491 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:41.605491 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:41.605491 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:41.605491 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:41.605491 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:41.605491 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:41.605491 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:41.605491 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:41.605491 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:41.605491 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:41.605491 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:41.605491 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:41.605491 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:58:41.606353 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:58:41.606353 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:41.606353 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:58:41.606526 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226e5668-2842-4601-ad2a-7b10f8ee55ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:41.606526 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226e5668-2842-4601-ad2a-7b10f8ee55ef None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:41.609001 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 289/560] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 01:58:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:41.610096 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e64954-d542-48a1-a50c-748d0916d398 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:41.631725 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-226e5668-2842-4601-ad2a-7b10f8ee55ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:41.631725 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:41.631725 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:41.631725 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:41.631725 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:41.631725 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:41.631725 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:41.631725 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:41.631725 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:41.631725 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:41.631725 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:41.631725 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:41.631725 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:58:41.631725 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:58:41.631725 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:58:41.631725 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:58:41.632704 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:41.632704 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:41.632704 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:41.632704 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:41.632704 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:41.632704 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:41.632704 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:41.632704 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:41.632704 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:41.632704 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:41.632704 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:41.632704 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:41.632704 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:41.632704 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:41.632704 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:41.632704 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:41.632704 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:58:41.633714 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:58:41.633714 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:41.633714 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:58:41.639436 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 272/561] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 01:58:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:41.640047 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226e5668-2842-4601-ad2a-7b10f8ee55ef None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:41.648295 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:41.728787 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e64954-d542-48a1-a50c-748d0916d398 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:41.748004 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226e5668-2842-4601-ad2a-7b10f8ee55ef None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:41.762575 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c67689e-a685-410a-bde6-47b898fb406d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:41.763183 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c67689e-a685-410a-bde6-47b898fb406d None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:41.763464 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c67689e-a685-410a-bde6-47b898fb406d None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:41.763739 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c67689e-a685-410a-bde6-47b898fb406d None admin] PATH_INFO: `/v3/domains` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:41.764375 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c67689e-a685-410a-bde6-47b898fb406d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:41.764677 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c67689e-a685-410a-bde6-47b898fb406d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:41.766090 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c67689e-a685-410a-bde6-47b898fb406d None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:41.778631 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 290/562] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Sep 29 01:58:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:41.779501 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c67689e-a685-410a-bde6-47b898fb406d None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:41.781400 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90577edf-6c5c-489f-ac77-d467ad0d8cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:41.782040 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90577edf-6c5c-489f-ac77-d467ad0d8cd5 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:41.782388 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90577edf-6c5c-489f-ac77-d467ad0d8cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:41.782852 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90577edf-6c5c-489f-ac77-d467ad0d8cd5 None admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:41.783572 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90577edf-6c5c-489f-ac77-d467ad0d8cd5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:41.783873 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90577edf-6c5c-489f-ac77-d467ad0d8cd5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:41.785240 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90577edf-6c5c-489f-ac77-d467ad0d8cd5 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:41.797160 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 273/563] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Sep 29 01:58:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:41.798635 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2798c66f-cd9a-47e1-a15c-74eadf2904cc None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:41.798911 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2798c66f-cd9a-47e1-a15c-74eadf2904cc None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:41.799178 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2798c66f-cd9a-47e1-a15c-74eadf2904cc None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:41.800363 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 274/564] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:58:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:58:41.801451 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217ec2dc-4f32-4be6-8e50-697914fe6683 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:41.801660 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217ec2dc-4f32-4be6-8e50-697914fe6683 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:41.802020 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217ec2dc-4f32-4be6-8e50-697914fe6683 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:41.803150 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 275/565] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:58:41 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:58:41.803863 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217ec2dc-4f32-4be6-8e50-697914fe6683 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:41.806813 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:41.877017 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:41.888598 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c67689e-a685-410a-bde6-47b898fb406d None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:41.908796 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217ec2dc-4f32-4be6-8e50-697914fe6683 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:41.927991 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56973153-425a-4dd2-ac80-0310f8cb800c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:41.928603 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56973153-425a-4dd2-ac80-0310f8cb800c None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:41.928885 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56973153-425a-4dd2-ac80-0310f8cb800c None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:41.929160 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56973153-425a-4dd2-ac80-0310f8cb800c None admin] PATH_INFO: `/v3/domains` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:41.929838 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56973153-425a-4dd2-ac80-0310f8cb800c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:41.930147 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56973153-425a-4dd2-ac80-0310f8cb800c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:41.931518 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56973153-425a-4dd2-ac80-0310f8cb800c None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:41.943547 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccad8f3d-3ef0-4f04-9768-9e47cbf49ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:41.943690 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 291/566] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Sep 29 01:58:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:41.944176 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad8f3d-3ef0-4f04-9768-9e47cbf49ae8 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:41.944399 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56973153-425a-4dd2-ac80-0310f8cb800c None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:41.944496 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad8f3d-3ef0-4f04-9768-9e47cbf49ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:41.944709 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad8f3d-3ef0-4f04-9768-9e47cbf49ae8 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:41.953489 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccad8f3d-3ef0-4f04-9768-9e47cbf49ae8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:41.955521 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccad8f3d-3ef0-4f04-9768-9e47cbf49ae8 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:41.967362 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-ccad8f3d-3ef0-4f04-9768-9e47cbf49ae8 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 29 01:58:41.967362 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:41.967362 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:41.967362 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:41.967362 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:41.967362 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:41.967362 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:41.967362 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:41.967362 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:41.967362 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:41.967362 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:41.967362 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:41.967362 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 29 01:58:41.967362 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 29 01:58:41.967362 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 29 01:58:41.967362 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 29 01:58:41.968411 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:41.968411 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:41.968411 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 29 01:58:41.968411 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:58:41.968411 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 29 01:58:41.968411 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:58:41.968411 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:41.968411 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:41.968411 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:41.968411 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:41.968411 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:41.968411 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:41.968411 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:41.968411 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:41.968411 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:41.968411 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:41.968411 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:41.968411 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:41.974500 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:41.974500 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:41.974500 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 29 01:58:41.974500 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 29 01:58:41.974500 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 29 01:58:41.974500 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 29 01:58:41.974500 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 29 01:58:41.974500 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 29 01:58:41.974500 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 29 01:58:41.974500 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:58:41.974500 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 276/567] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Sep 29 01:58:41 2022] GET /identity/v3/users/glance => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:41.974500 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b34921f-0bb3-4c43-9089-bcb0fc70f843 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:41.974500 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b34921f-0bb3-4c43-9089-bcb0fc70f843 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:41.975198 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b34921f-0bb3-4c43-9089-bcb0fc70f843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:41.988266 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-8b34921f-0bb3-4c43-9089-bcb0fc70f843 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:41.989478 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-8b34921f-0bb3-4c43-9089-bcb0fc70f843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:42.044963 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:42.051324 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56973153-425a-4dd2-ac80-0310f8cb800c None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:42.057627 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 277/568] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:58:42.059263 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8885b4-38f4-4f2c-a823-23dbc5965802 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:42.059546 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8885b4-38f4-4f2c-a823-23dbc5965802 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:42.059818 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8885b4-38f4-4f2c-a823-23dbc5965802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:42.079912 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-ed8885b4-38f4-4f2c-a823-23dbc5965802 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:42.081105 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-ed8885b4-38f4-4f2c-a823-23dbc5965802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:42.087377 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d497444-4544-463d-a775-1d3a8f502ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:42.087998 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d497444-4544-463d-a775-1d3a8f502ff7 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:42.088275 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d497444-4544-463d-a775-1d3a8f502ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:42.088540 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d497444-4544-463d-a775-1d3a8f502ff7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:42.095985 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d497444-4544-463d-a775-1d3a8f502ff7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:42.097447 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d497444-4544-463d-a775-1d3a8f502ff7 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:42.108587 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-8d497444-4544-463d-a775-1d3a8f502ff7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:58:42.108587 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:42.108587 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:42.108587 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:42.108587 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:42.108587 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:42.108587 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:42.108587 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:42.108587 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:42.108587 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:42.108587 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:42.108587 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:42.108587 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 29 01:58:42.108587 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 29 01:58:42.108587 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 29 01:58:42.109932 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 29 01:58:42.109932 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:42.109932 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:42.109932 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:42.109932 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:42.109932 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:42.109932 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:42.109932 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:42.109932 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:42.109932 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:42.109932 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:42.109932 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:42.109932 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:42.109932 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:42.109932 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:42.109932 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:42.109932 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:42.111863 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 29 01:58:42.111863 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 29 01:58:42.111863 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 29 01:58:42.111863 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 29 01:58:42.111863 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 29 01:58:42.111863 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 29 01:58:42.111863 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:58:42.111863 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:58:42.111863 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 292/569] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Sep 29 01:58:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:42.111863 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d497444-4544-463d-a775-1d3a8f502ff7 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:42.122212 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:42.155631 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 278/570] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:58:42.156807 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8885b4-38f4-4f2c-a823-23dbc5965802 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:42.229033 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d497444-4544-463d-a775-1d3a8f502ff7 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:42.267095 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5751902f-e71f-4a11-a1a4-b5995d18c1d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:42.267809 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751902f-e71f-4a11-a1a4-b5995d18c1d0 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:42.268166 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751902f-e71f-4a11-a1a4-b5995d18c1d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:42.268506 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751902f-e71f-4a11-a1a4-b5995d18c1d0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:42.276806 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5751902f-e71f-4a11-a1a4-b5995d18c1d0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:42.278550 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5751902f-e71f-4a11-a1a4-b5995d18c1d0 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:42.281599 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8885b4-38f4-4f2c-a823-23dbc5965802 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:42.291522 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-5751902f-e71f-4a11-a1a4-b5995d18c1d0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 29 01:58:42.291522 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:42.291522 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:42.291522 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:42.291522 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:42.291522 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:42.291522 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:42.291522 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:42.291522 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:42.291522 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:42.291522 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:42.291522 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:42.291522 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 29 01:58:42.291522 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 29 01:58:42.291522 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 29 01:58:42.291522 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 29 01:58:42.292690 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:42.292690 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:42.292690 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 29 01:58:42.292690 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:58:42.292690 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 29 01:58:42.292690 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:58:42.292690 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:42.292690 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:42.292690 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:42.292690 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:42.292690 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:42.292690 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:42.292690 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:42.292690 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:42.292690 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:42.292690 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:42.292690 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:42.292690 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:42.294301 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:42.294301 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:42.294301 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 29 01:58:42.294301 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 29 01:58:42.294301 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 29 01:58:42.294301 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 29 01:58:42.294301 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 29 01:58:42.294301 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 29 01:58:42.294301 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 29 01:58:42.294301 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:58:42.294301 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 293/571] 10.222.0.49 () {56 vars in 1093 bytes} [Thu Sep 29 01:58:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:42.294301 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5751902f-e71f-4a11-a1a4-b5995d18c1d0 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:42.330485 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:42.346281 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6bf478-178f-4909-b58c-2763a0f77cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:42.347187 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6bf478-178f-4909-b58c-2763a0f77cdb None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:42.347471 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6bf478-178f-4909-b58c-2763a0f77cdb None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:42.347745 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6bf478-178f-4909-b58c-2763a0f77cdb None admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:42.348478 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6bf478-178f-4909-b58c-2763a0f77cdb None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:42.348785 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6bf478-178f-4909-b58c-2763a0f77cdb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:42.350295 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6bf478-178f-4909-b58c-2763a0f77cdb None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:42.369632 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 279/572] 10.222.0.49 () {56 vars in 1137 bytes} [Thu Sep 29 01:58:42 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:42.369793 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6bf478-178f-4909-b58c-2763a0f77cdb None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:42.375025 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:42.416317 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5751902f-e71f-4a11-a1a4-b5995d18c1d0 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:42.457421 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6830d74a-0754-4fdd-843b-a81220a81c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:42.458033 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6830d74a-0754-4fdd-843b-a81220a81c5b None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:42.458311 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6830d74a-0754-4fdd-843b-a81220a81c5b None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:42.458588 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6830d74a-0754-4fdd-843b-a81220a81c5b None admin] PATH_INFO: `/v3/projects` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:42.459277 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6830d74a-0754-4fdd-843b-a81220a81c5b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:42.459580 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6830d74a-0754-4fdd-843b-a81220a81c5b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:42.461006 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6830d74a-0754-4fdd-843b-a81220a81c5b None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:42.473451 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 294/573] 10.222.0.49 () {56 vars in 1148 bytes} [Thu Sep 29 01:58:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:42.474246 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6830d74a-0754-4fdd-843b-a81220a81c5b None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:42.481055 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6bf478-178f-4909-b58c-2763a0f77cdb None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:42.514681 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a44b9d8-3463-4816-8cb6-7dc9d2c3ab6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:42.515281 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a44b9d8-3463-4816-8cb6-7dc9d2c3ab6f None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:42.515557 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a44b9d8-3463-4816-8cb6-7dc9d2c3ab6f None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:42.515830 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a44b9d8-3463-4816-8cb6-7dc9d2c3ab6f None admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:42.517158 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a44b9d8-3463-4816-8cb6-7dc9d2c3ab6f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:42.517562 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a44b9d8-3463-4816-8cb6-7dc9d2c3ab6f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:42.518988 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a44b9d8-3463-4816-8cb6-7dc9d2c3ab6f None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:42.539843 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 280/574] 10.222.0.49 () {56 vars in 1133 bytes} [Thu Sep 29 01:58:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:42.539843 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a44b9d8-3463-4816-8cb6-7dc9d2c3ab6f None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:42.574874 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6830d74a-0754-4fdd-843b-a81220a81c5b None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:42.579620 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:42.602165 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:42.610106 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104a0fed-cad4-4b93-b5c6-6677bf5152b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:42.610858 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a0fed-cad4-4b93-b5c6-6677bf5152b8 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:42.611136 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a0fed-cad4-4b93-b5c6-6677bf5152b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:42.611402 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a0fed-cad4-4b93-b5c6-6677bf5152b8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:42.621738 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104a0fed-cad4-4b93-b5c6-6677bf5152b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:58:42.627395 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-104a0fed-cad4-4b93-b5c6-6677bf5152b8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 29 01:58:42.627395 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:42.627395 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:42.627395 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:42.627395 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:42.627395 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:42.627395 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:42.627395 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:42.627395 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:42.627395 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:42.627395 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:42.627395 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:42.627395 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:58:42.627395 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:58:42.627395 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:58:42.627395 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:58:42.628354 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:58:42.628354 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:58:42.628354 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:58:42.628354 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:58:42.628354 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:42.628354 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:42.628354 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:42.628354 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:42.628354 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:42.628354 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:42.628354 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:42.628354 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:42.628354 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:42.628354 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:42.628354 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:42.628354 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:42.629169 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:42.629169 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:42.629169 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:42.629169 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:42.629169 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:58:42.629169 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:58:42.629169 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:58:42.629169 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:58:42.629169 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:58:42.629169 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:58:42.629169 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 29 01:58:42.629169 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:58:42.629169 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 295/575] 10.222.0.49 () {56 vars in 1102 bytes} [Thu Sep 29 01:58:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:42.629916 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104a0fed-cad4-4b93-b5c6-6677bf5152b8 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:42.640048 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a44b9d8-3463-4816-8cb6-7dc9d2c3ab6f None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:42.673646 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0840eb07-11b1-44db-b9b5-76d28499f3c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:42.674186 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0840eb07-11b1-44db-b9b5-76d28499f3c8 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:42.674465 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0840eb07-11b1-44db-b9b5-76d28499f3c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:42.674734 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0840eb07-11b1-44db-b9b5-76d28499f3c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:42.684349 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0840eb07-11b1-44db-b9b5-76d28499f3c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:42.685817 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0840eb07-11b1-44db-b9b5-76d28499f3c8 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:42.700921 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-0840eb07-11b1-44db-b9b5-76d28499f3c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:42.700921 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:42.700921 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:42.700921 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:42.700921 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:42.700921 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:42.700921 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:42.700921 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:42.700921 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:42.700921 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:42.700921 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:42.700921 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:42.700921 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:58:42.700921 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:58:42.700921 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:58:42.700921 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:58:42.701918 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:42.701918 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:42.701918 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:42.701918 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:42.701918 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:42.701918 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:42.701918 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:42.701918 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:42.701918 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:42.701918 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:42.701918 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:42.701918 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:42.701918 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:42.701918 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:42.701918 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:42.701918 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:42.701918 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:58:42.702815 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:58:42.702815 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:42.702815 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:58:42.707543 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 281/576] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 01:58:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:42.708305 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0840eb07-11b1-44db-b9b5-76d28499f3c8 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:42.731571 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104a0fed-cad4-4b93-b5c6-6677bf5152b8 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:42.765016 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b190a394-7d42-46f6-b28e-5dd0512688a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:42.765669 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b190a394-7d42-46f6-b28e-5dd0512688a5 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:42.765944 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b190a394-7d42-46f6-b28e-5dd0512688a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:42.766762 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b190a394-7d42-46f6-b28e-5dd0512688a5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:42.776857 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b190a394-7d42-46f6-b28e-5dd0512688a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:58:42.781687 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-b190a394-7d42-46f6-b28e-5dd0512688a5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 29 01:58:42.781687 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:42.781687 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:42.781687 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:42.781687 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:42.781687 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:42.781687 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:42.781687 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:42.781687 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:42.781687 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:42.781687 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:42.781687 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:42.781687 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:58:42.781687 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:58:42.781687 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:58:42.781687 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:58:42.783853 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:58:42.783853 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:58:42.783853 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:58:42.783853 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:58:42.783853 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:42.783853 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:42.783853 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:42.783853 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:42.783853 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:42.783853 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:42.783853 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:42.783853 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:42.783853 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:42.783853 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:42.783853 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:42.783853 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:42.785025 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:42.785025 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:42.785025 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:42.785025 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:42.785025 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:58:42.785025 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:58:42.785025 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:58:42.785025 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:58:42.785025 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:58:42.785025 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:58:42.785025 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 29 01:58:42.785025 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:58:42.785025 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 296/577] 10.222.0.49 () {56 vars in 1102 bytes} [Thu Sep 29 01:58:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:42.785025 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b190a394-7d42-46f6-b28e-5dd0512688a5 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:42.804762 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:42.815099 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0840eb07-11b1-44db-b9b5-76d28499f3c8 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:42.832853 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:42.848429 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40151f5-df9a-4a1d-afb4-f2727e09e625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:42.849025 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40151f5-df9a-4a1d-afb4-f2727e09e625 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:42.849301 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40151f5-df9a-4a1d-afb4-f2727e09e625 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:42.849598 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40151f5-df9a-4a1d-afb4-f2727e09e625 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:42.850308 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40151f5-df9a-4a1d-afb4-f2727e09e625 None admin] RBAC: Adding query filter params (role.id=393e6032e5cc4678b8351026fe4434f8, scope.project.id=6f1d8fd250c84c5887cb3173053ea2dd, user.id=c88bc0f32600416ca7c6a59f4196e497) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:42.850608 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40151f5-df9a-4a1d-afb4-f2727e09e625 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:42.852021 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40151f5-df9a-4a1d-afb4-f2727e09e625 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:42.857180 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 282/578] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Sep 29 01:58:42 2022] GET /identity/v3/role_assignments?user.id=c88bc0f32600416ca7c6a59f4196e497&scope.project.id=6f1d8fd250c84c5887cb3173053ea2dd&role.id=393e6032e5cc4678b8351026fe4434f8 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:42.857975 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40151f5-df9a-4a1d-afb4-f2727e09e625 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:42.897165 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b190a394-7d42-46f6-b28e-5dd0512688a5 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:42.944334 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc99019-3a72-4760-85e7-1223633ed885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:42.944891 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc99019-3a72-4760-85e7-1223633ed885 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:42.945164 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc99019-3a72-4760-85e7-1223633ed885 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:42.945467 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc99019-3a72-4760-85e7-1223633ed885 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:42.958246 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc99019-3a72-4760-85e7-1223633ed885 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:42.959736 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc99019-3a72-4760-85e7-1223633ed885 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:42.976130 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40151f5-df9a-4a1d-afb4-f2727e09e625 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:42.978947 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-2fc99019-3a72-4760-85e7-1223633ed885 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:42.978947 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:42.978947 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:42.978947 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:42.978947 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:42.978947 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:42.978947 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:42.978947 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:42.978947 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:42.978947 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:42.978947 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:42.978947 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:42.978947 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:58:42.978947 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:58:42.978947 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:58:42.978947 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:58:42.980010 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:42.980010 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:42.980010 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:42.980010 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:42.980010 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:42.980010 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:42.980010 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:42.980010 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:42.980010 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:42.980010 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:42.980010 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:42.980010 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:42.980010 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:42.980010 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:42.980010 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:42.980010 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:42.980010 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:58:42.981078 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:58:42.981078 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:42.981078 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:58:42.981572 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 297/579] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 01:58:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:42.982413 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc99019-3a72-4760-85e7-1223633ed885 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:43.022045 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb44b46-2d37-4cf1-b53d-44bc7576c81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:43.022658 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb44b46-2d37-4cf1-b53d-44bc7576c81f None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:43.022931 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb44b46-2d37-4cf1-b53d-44bc7576c81f None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:43.023197 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb44b46-2d37-4cf1-b53d-44bc7576c81f None admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:43.023862 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb44b46-2d37-4cf1-b53d-44bc7576c81f None admin] RBAC: Adding query filter params (name=service) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:43.024159 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb44b46-2d37-4cf1-b53d-44bc7576c81f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:43.025564 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb44b46-2d37-4cf1-b53d-44bc7576c81f None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:43.034483 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 283/580] 10.222.0.49 () {56 vars in 1103 bytes} [Thu Sep 29 01:58:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:43.035490 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb44b46-2d37-4cf1-b53d-44bc7576c81f None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:43.056502 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:43.095665 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:43.099664 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc99019-3a72-4760-85e7-1223633ed885 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:43.136892 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2768426a-c452-41e5-a732-3a945a114421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:43.137577 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2768426a-c452-41e5-a732-3a945a114421 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:43.137807 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2768426a-c452-41e5-a732-3a945a114421 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:43.138080 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2768426a-c452-41e5-a732-3a945a114421 None admin] PATH_INFO: `/v3/domains` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:43.138718 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2768426a-c452-41e5-a732-3a945a114421 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:43.139019 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2768426a-c452-41e5-a732-3a945a114421 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:43.140387 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2768426a-c452-41e5-a732-3a945a114421 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:43.146722 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb44b46-2d37-4cf1-b53d-44bc7576c81f None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:43.152432 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 298/581] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Sep 29 01:58:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:43.153245 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2768426a-c452-41e5-a732-3a945a114421 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:43.188840 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ab2bb0-593c-43c6-93d7-436396138e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:43.189861 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ab2bb0-593c-43c6-93d7-436396138e33 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:43.190221 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ab2bb0-593c-43c6-93d7-436396138e33 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:43.190572 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ab2bb0-593c-43c6-93d7-436396138e33 None admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:43.191251 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ab2bb0-593c-43c6-93d7-436396138e33 None admin] RBAC: Adding query filter params (name=service) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:43.191555 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ab2bb0-593c-43c6-93d7-436396138e33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:43.192918 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ab2bb0-593c-43c6-93d7-436396138e33 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:43.205923 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 284/582] 10.222.0.49 () {56 vars in 1103 bytes} [Thu Sep 29 01:58:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:43.205923 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ab2bb0-593c-43c6-93d7-436396138e33 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:43.267384 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2768426a-c452-41e5-a732-3a945a114421 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:43.294331 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:43.316236 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8efc840-9656-4776-a55a-0e7b5d458cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:43.316886 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8efc840-9656-4776-a55a-0e7b5d458cab None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:43.317133 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8efc840-9656-4776-a55a-0e7b5d458cab None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:43.317516 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8efc840-9656-4776-a55a-0e7b5d458cab None admin] PATH_INFO: `/v3/domains` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:43.318112 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8efc840-9656-4776-a55a-0e7b5d458cab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:43.318635 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8efc840-9656-4776-a55a-0e7b5d458cab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:43.319832 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ab2bb0-593c-43c6-93d7-436396138e33 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:43.320736 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8efc840-9656-4776-a55a-0e7b5d458cab None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:43.333341 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 299/583] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Sep 29 01:58:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:43.334391 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8efc840-9656-4776-a55a-0e7b5d458cab None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:43.363349 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:43.363612 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0051218-51d0-494c-8d42-c23a3540fa0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:43.364443 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0051218-51d0-494c-8d42-c23a3540fa0c None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:43.364879 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0051218-51d0-494c-8d42-c23a3540fa0c None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:43.365180 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0051218-51d0-494c-8d42-c23a3540fa0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:43.377048 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0051218-51d0-494c-8d42-c23a3540fa0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:43.378842 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0051218-51d0-494c-8d42-c23a3540fa0c None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:43.393565 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-f0051218-51d0-494c-8d42-c23a3540fa0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:43.393565 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:43.393565 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:43.393565 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:43.393565 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:43.393565 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:43.393565 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:43.393565 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:43.393565 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:43.393565 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:43.393565 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:43.393565 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:43.393565 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:58:43.393565 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:58:43.393565 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:58:43.393565 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:58:43.394557 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:43.394557 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:43.394557 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:43.394557 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:43.394557 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:43.394557 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:43.394557 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:43.394557 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:43.394557 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:43.394557 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:43.394557 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:43.394557 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:43.394557 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:43.394557 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:43.394557 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:43.394557 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:43.394557 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:58:43.395438 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:58:43.395438 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:43.395438 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:58:43.395438 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 285/584] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 01:58:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:43.395438 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0051218-51d0-494c-8d42-c23a3540fa0c None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:43.451143 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8efc840-9656-4776-a55a-0e7b5d458cab None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:43.484733 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb3dcf-6244-4c13-ab6e-3179f8980e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:43.485874 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb3dcf-6244-4c13-ab6e-3179f8980e76 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:43.486156 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb3dcf-6244-4c13-ab6e-3179f8980e76 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:43.486419 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb3dcf-6244-4c13-ab6e-3179f8980e76 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:43.494067 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eb3dcf-6244-4c13-ab6e-3179f8980e76 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:43.495512 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eb3dcf-6244-4c13-ab6e-3179f8980e76 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:43.507134 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-f6eb3dcf-6244-4c13-ab6e-3179f8980e76 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:58:43.507134 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:43.507134 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:43.507134 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:43.507134 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:43.507134 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:43.507134 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:43.507134 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:43.507134 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:43.507134 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:43.507134 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:43.507134 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:43.507134 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 29 01:58:43.507134 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 29 01:58:43.507134 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 29 01:58:43.508016 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 29 01:58:43.508016 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:43.508016 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:43.508016 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:43.508016 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:43.508016 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:43.508016 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:43.508016 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:43.508016 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:43.508016 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:43.508016 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:43.508016 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:43.508016 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:43.508016 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:43.508016 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:43.508016 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:43.508016 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:43.513877 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 29 01:58:43.513877 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 29 01:58:43.513877 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 29 01:58:43.513877 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 29 01:58:43.513877 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 29 01:58:43.513877 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 29 01:58:43.513877 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:58:43.513877 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:58:43.514318 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0051218-51d0-494c-8d42-c23a3540fa0c None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:43.514392 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 300/585] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Sep 29 01:58:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:43.514392 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb3dcf-6244-4c13-ab6e-3179f8980e76 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:43.544778 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:43.553124 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce32e13-68cf-49ec-bfa5-09940387d42f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:43.553929 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce32e13-68cf-49ec-bfa5-09940387d42f None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:43.554240 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce32e13-68cf-49ec-bfa5-09940387d42f None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:43.555047 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce32e13-68cf-49ec-bfa5-09940387d42f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:43.568084 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce32e13-68cf-49ec-bfa5-09940387d42f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:43.569557 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce32e13-68cf-49ec-bfa5-09940387d42f None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:43.585105 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-1ce32e13-68cf-49ec-bfa5-09940387d42f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:43.585105 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:43.585105 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:43.585105 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:43.585105 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:43.585105 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:43.585105 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:43.585105 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:43.585105 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:43.585105 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:43.585105 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:43.585105 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:43.585105 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:58:43.585105 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:58:43.585105 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:58:43.585105 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:58:43.586255 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:43.586255 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:43.586255 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:43.586255 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:43.586255 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:43.586255 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:43.586255 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:43.586255 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:43.586255 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:43.586255 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:43.586255 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:43.586255 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:43.586255 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:43.586255 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:43.586255 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:43.586255 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:43.586255 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:58:43.587144 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:58:43.587144 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:43.587144 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:58:43.587144 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 286/586] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 01:58:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:43.587144 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce32e13-68cf-49ec-bfa5-09940387d42f None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:43.604087 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:43.628205 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb3dcf-6244-4c13-ab6e-3179f8980e76 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:43.663930 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8004a4-ce12-4f81-8f9a-15a3538e774a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:43.664563 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8004a4-ce12-4f81-8f9a-15a3538e774a None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:43.664843 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8004a4-ce12-4f81-8f9a-15a3538e774a None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:43.665112 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8004a4-ce12-4f81-8f9a-15a3538e774a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:43.673452 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8004a4-ce12-4f81-8f9a-15a3538e774a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:43.675250 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8004a4-ce12-4f81-8f9a-15a3538e774a None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:43.686679 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-4d8004a4-ce12-4f81-8f9a-15a3538e774a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:58:43.686679 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:43.686679 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:43.686679 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:43.686679 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:43.686679 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:43.686679 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:43.686679 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:43.686679 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:43.686679 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:43.686679 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:43.686679 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:43.686679 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 29 01:58:43.686679 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 29 01:58:43.686679 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 29 01:58:43.687563 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 29 01:58:43.687563 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:43.687563 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:43.687563 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:43.687563 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:43.687563 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:43.687563 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:43.687563 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:43.687563 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:43.687563 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:43.687563 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:43.687563 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:43.687563 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:43.687563 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:43.687563 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:43.687563 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:43.687563 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:43.688534 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 29 01:58:43.688534 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 29 01:58:43.688534 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 29 01:58:43.688534 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 29 01:58:43.688534 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 29 01:58:43.688534 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 29 01:58:43.688534 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:58:43.688534 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:58:43.692590 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 301/587] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Sep 29 01:58:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:43.693463 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8004a4-ce12-4f81-8f9a-15a3538e774a None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:43.699743 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce32e13-68cf-49ec-bfa5-09940387d42f None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:43.736235 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fec6dc8-4a72-4fa1-b57e-51aaabd2e8ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:43.736788 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec6dc8-4a72-4fa1-b57e-51aaabd2e8ac None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:43.737066 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec6dc8-4a72-4fa1-b57e-51aaabd2e8ac None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:43.737364 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec6dc8-4a72-4fa1-b57e-51aaabd2e8ac None admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:43.738034 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fec6dc8-4a72-4fa1-b57e-51aaabd2e8ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:43.738334 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fec6dc8-4a72-4fa1-b57e-51aaabd2e8ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:43.739742 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fec6dc8-4a72-4fa1-b57e-51aaabd2e8ac None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:43.753057 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 287/588] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Sep 29 01:58:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:43.754342 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fec6dc8-4a72-4fa1-b57e-51aaabd2e8ac None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:43.801142 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:43.804756 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8004a4-ce12-4f81-8f9a-15a3538e774a None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:43.838971 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af237f8-6a1c-4c7a-8acc-06a5b9fe4a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:43.839660 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af237f8-6a1c-4c7a-8acc-06a5b9fe4a66 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:43.839938 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af237f8-6a1c-4c7a-8acc-06a5b9fe4a66 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:43.840208 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af237f8-6a1c-4c7a-8acc-06a5b9fe4a66 None admin] PATH_INFO: `/v3/projects` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:43.841091 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af237f8-6a1c-4c7a-8acc-06a5b9fe4a66 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:43.841209 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af237f8-6a1c-4c7a-8acc-06a5b9fe4a66 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:43.842816 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af237f8-6a1c-4c7a-8acc-06a5b9fe4a66 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:43.853210 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:43.857492 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 302/589] 10.222.0.49 () {56 vars in 1148 bytes} [Thu Sep 29 01:58:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:43.863076 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af237f8-6a1c-4c7a-8acc-06a5b9fe4a66 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:43.865549 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fec6dc8-4a72-4fa1-b57e-51aaabd2e8ac None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:43.905236 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54de9a91-6fbc-4519-909b-ba38fd7bbb66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:43.905927 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de9a91-6fbc-4519-909b-ba38fd7bbb66 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:43.906250 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de9a91-6fbc-4519-909b-ba38fd7bbb66 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:43.906519 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de9a91-6fbc-4519-909b-ba38fd7bbb66 None admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:43.908120 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54de9a91-6fbc-4519-909b-ba38fd7bbb66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:43.908424 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54de9a91-6fbc-4519-909b-ba38fd7bbb66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:43.909823 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54de9a91-6fbc-4519-909b-ba38fd7bbb66 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:43.926811 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 288/590] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Sep 29 01:58:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:43.926811 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54de9a91-6fbc-4519-909b-ba38fd7bbb66 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:43.980091 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af237f8-6a1c-4c7a-8acc-06a5b9fe4a66 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:44.018838 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1c0a69-1298-4a80-9064-c34eb2730562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:44.020008 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1c0a69-1298-4a80-9064-c34eb2730562 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:44.020461 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1c0a69-1298-4a80-9064-c34eb2730562 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:44.020881 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1c0a69-1298-4a80-9064-c34eb2730562 None admin] PATH_INFO: `/v3/projects` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:44.021739 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1c0a69-1298-4a80-9064-c34eb2730562 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:44.022202 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1c0a69-1298-4a80-9064-c34eb2730562 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:44.023785 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1c0a69-1298-4a80-9064-c34eb2730562 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:44.036350 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 303/591] 10.222.0.49 () {56 vars in 1148 bytes} [Thu Sep 29 01:58:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:44.037378 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1c0a69-1298-4a80-9064-c34eb2730562 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:44.045295 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54de9a91-6fbc-4519-909b-ba38fd7bbb66 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:44.046914 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:44.086313 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d2c763-7984-45a5-a8ef-ae74bd5868ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:44.086940 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d2c763-7984-45a5-a8ef-ae74bd5868ee None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:44.087222 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d2c763-7984-45a5-a8ef-ae74bd5868ee None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:44.087488 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d2c763-7984-45a5-a8ef-ae74bd5868ee None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:44.095470 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d2c763-7984-45a5-a8ef-ae74bd5868ee None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:44.096890 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d2c763-7984-45a5-a8ef-ae74bd5868ee None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:44.106673 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:44.109744 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-44d2c763-7984-45a5-a8ef-ae74bd5868ee None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 29 01:58:44.109744 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:44.109744 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:44.109744 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:44.109744 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:44.109744 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:44.109744 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:44.109744 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:44.109744 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:44.109744 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:44.109744 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:44.109744 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:44.109744 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 29 01:58:44.109744 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 29 01:58:44.109744 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 29 01:58:44.109744 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 29 01:58:44.111487 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:44.111487 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:44.111487 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 29 01:58:44.111487 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:58:44.111487 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 29 01:58:44.111487 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:58:44.111487 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:44.111487 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:44.111487 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:44.111487 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:44.111487 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:44.111487 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:44.111487 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:44.111487 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:44.111487 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:44.111487 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:44.111487 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:44.111487 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:44.112428 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:44.112428 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:44.112428 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 29 01:58:44.112428 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 29 01:58:44.112428 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 29 01:58:44.112428 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 29 01:58:44.112428 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 29 01:58:44.112428 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 29 01:58:44.112428 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 29 01:58:44.112428 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:58:44.112428 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 289/592] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Sep 29 01:58:43 2022] GET /identity/v3/users/cinder => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:44.112428 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d2c763-7984-45a5-a8ef-ae74bd5868ee None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:44.157720 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1c0a69-1298-4a80-9064-c34eb2730562 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:44.192438 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9cd78f-f29d-4670-ad8b-ba98d958f899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:44.193083 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9cd78f-f29d-4670-ad8b-ba98d958f899 None admin] REQUEST_METHOD: `PUT` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:44.193459 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9cd78f-f29d-4670-ad8b-ba98d958f899 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:44.193740 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9cd78f-f29d-4670-ad8b-ba98d958f899 None admin] PATH_INFO: `/v3/projects/6f1d8fd250c84c5887cb3173053ea2dd/users/5d36669146554031ba8596cb583cd6f9/roles/393e6032e5cc4678b8351026fe4434f8` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:44.208899 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9cd78f-f29d-4670-ad8b-ba98d958f899 None admin] RBAC: Authorizing `identity:create_grant(project_id=6f1d8fd250c84c5887cb3173053ea2dd, user_id=5d36669146554031ba8596cb583cd6f9, role_id=393e6032e5cc4678b8351026fe4434f8)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:44.210389 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9cd78f-f29d-4670-ad8b-ba98d958f899 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:44.223188 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d2c763-7984-45a5-a8ef-ae74bd5868ee None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:44.233342 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 304/593] 10.222.0.49 () {58 vars in 1439 bytes} [Thu Sep 29 01:58:44 2022] PUT /identity/v3/projects/6f1d8fd250c84c5887cb3173053ea2dd/users/5d36669146554031ba8596cb583cd6f9/roles/393e6032e5cc4678b8351026fe4434f8 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 01:58:44.233342 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9cd78f-f29d-4670-ad8b-ba98d958f899 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:44.273330 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b7b753-c7c2-49ab-be03-79a093523495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:44.274091 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b7b753-c7c2-49ab-be03-79a093523495 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:44.274584 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b7b753-c7c2-49ab-be03-79a093523495 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:44.274928 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b7b753-c7c2-49ab-be03-79a093523495 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:44.285422 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b7b753-c7c2-49ab-be03-79a093523495 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:44.287139 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b7b753-c7c2-49ab-be03-79a093523495 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:44.301226 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-f9b7b753-c7c2-49ab-be03-79a093523495 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 29 01:58:44.301226 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:44.301226 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:44.301226 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:44.301226 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:44.301226 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:44.301226 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:44.301226 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:44.301226 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:44.301226 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:44.301226 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:44.301226 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:44.301226 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 29 01:58:44.301226 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 29 01:58:44.301226 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 29 01:58:44.301226 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 29 01:58:44.302730 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:44.302730 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:44.302730 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 29 01:58:44.302730 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:58:44.302730 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 29 01:58:44.302730 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:58:44.302730 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:44.302730 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:44.302730 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:44.302730 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:44.302730 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:44.302730 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:44.302730 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:44.302730 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:44.302730 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:44.302730 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:44.302730 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:44.302730 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:44.303707 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:44.303707 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:44.303707 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 29 01:58:44.303707 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 29 01:58:44.303707 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 29 01:58:44.303707 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 29 01:58:44.303707 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 29 01:58:44.303707 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 29 01:58:44.303707 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 29 01:58:44.303707 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:58:44.303707 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 290/594] 10.222.0.49 () {56 vars in 1102 bytes} [Thu Sep 29 01:58:44 2022] GET /identity/v3/users/neutron => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:44.304290 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b7b753-c7c2-49ab-be03-79a093523495 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:44.334308 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:44.377383 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9cd78f-f29d-4670-ad8b-ba98d958f899 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:44.395042 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:44.429497 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b7b753-c7c2-49ab-be03-79a093523495 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:44.436060 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d496694d-9ddd-452f-9897-478f94f412d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:44.436955 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d496694d-9ddd-452f-9897-478f94f412d9 None admin] REQUEST_METHOD: `PUT` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:44.438787 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d496694d-9ddd-452f-9897-478f94f412d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:44.439411 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d496694d-9ddd-452f-9897-478f94f412d9 None admin] PATH_INFO: `/v3/projects/6f1d8fd250c84c5887cb3173053ea2dd/users/f3325a7111d447f4a9cf00c672d5420f/roles/393e6032e5cc4678b8351026fe4434f8` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:44.460739 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d496694d-9ddd-452f-9897-478f94f412d9 None admin] RBAC: Authorizing `identity:create_grant(project_id=6f1d8fd250c84c5887cb3173053ea2dd, user_id=f3325a7111d447f4a9cf00c672d5420f, role_id=393e6032e5cc4678b8351026fe4434f8)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:44.462453 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d496694d-9ddd-452f-9897-478f94f412d9 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:44.470762 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d2dbb9-8060-4524-afd5-612043bdda5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:44.471477 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d2dbb9-8060-4524-afd5-612043bdda5b None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:44.471764 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d2dbb9-8060-4524-afd5-612043bdda5b None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:44.472030 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d2dbb9-8060-4524-afd5-612043bdda5b None admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:44.473236 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d2dbb9-8060-4524-afd5-612043bdda5b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:44.473654 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d2dbb9-8060-4524-afd5-612043bdda5b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:44.475774 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d2dbb9-8060-4524-afd5-612043bdda5b None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:44.479528 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 305/595] 10.222.0.49 () {58 vars in 1439 bytes} [Thu Sep 29 01:58:44 2022] PUT /identity/v3/projects/6f1d8fd250c84c5887cb3173053ea2dd/users/f3325a7111d447f4a9cf00c672d5420f/roles/393e6032e5cc4678b8351026fe4434f8 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 01:58:44.479528 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d496694d-9ddd-452f-9897-478f94f412d9 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:44.497009 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 291/596] 10.222.0.49 () {56 vars in 1137 bytes} [Thu Sep 29 01:58:44 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:44.505157 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d2dbb9-8060-4524-afd5-612043bdda5b None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:44.691705 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:44.718242 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d496694d-9ddd-452f-9897-478f94f412d9 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:44.722142 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d2dbb9-8060-4524-afd5-612043bdda5b None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:44.764785 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3185af0-ef27-4c11-b690-d57781a51f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:44.765799 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3185af0-ef27-4c11-b690-d57781a51f49 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:44.767556 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3185af0-ef27-4c11-b690-d57781a51f49 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:44.768090 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3185af0-ef27-4c11-b690-d57781a51f49 None admin] PATH_INFO: `/v3/users` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:44.771993 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3185af0-ef27-4c11-b690-d57781a51f49 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:44.774633 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3185af0-ef27-4c11-b690-d57781a51f49 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:44.776214 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3185af0-ef27-4c11-b690-d57781a51f49 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:44.799803 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28e4fbc-2783-4b34-be3d-86b3d0efbb19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:44.800828 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28e4fbc-2783-4b34-be3d-86b3d0efbb19 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:44.801298 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28e4fbc-2783-4b34-be3d-86b3d0efbb19 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:44.801772 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28e4fbc-2783-4b34-be3d-86b3d0efbb19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:44.802233 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 306/597] 10.222.0.49 () {56 vars in 1139 bytes} [Thu Sep 29 01:58:44 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:44.809343 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3185af0-ef27-4c11-b690-d57781a51f49 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:44.825897 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28e4fbc-2783-4b34-be3d-86b3d0efbb19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:44.828478 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28e4fbc-2783-4b34-be3d-86b3d0efbb19 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:44.851135 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:44.880047 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-b28e4fbc-2783-4b34-be3d-86b3d0efbb19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:44.880047 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:44.880047 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:44.880047 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:44.880047 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:44.880047 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:44.880047 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:44.880047 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:44.880047 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:44.880047 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:44.880047 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:44.880047 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:44.880047 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:58:44.880047 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:58:44.880047 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:58:44.880047 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:58:44.881075 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:44.881075 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:44.881075 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:44.881075 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:44.881075 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:44.881075 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:44.881075 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:44.881075 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:44.881075 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:44.881075 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:44.881075 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:44.881075 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:44.881075 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:44.881075 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:44.881075 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:44.881075 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:44.881075 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:58:44.882062 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:58:44.882062 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:44.882062 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:58:44.891774 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 292/598] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 01:58:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 385 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 01:58:44.894895 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28e4fbc-2783-4b34-be3d-86b3d0efbb19 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:44.955354 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3185af0-ef27-4c11-b690-d57781a51f49 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:45.053185 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a42b2b6-7a17-4969-aa0a-e6e58e3aae40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:45.055786 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a42b2b6-7a17-4969-aa0a-e6e58e3aae40 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:45.056618 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a42b2b6-7a17-4969-aa0a-e6e58e3aae40 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:45.057481 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a42b2b6-7a17-4969-aa0a-e6e58e3aae40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:45.072231 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28e4fbc-2783-4b34-be3d-86b3d0efbb19 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:45.093270 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a42b2b6-7a17-4969-aa0a-e6e58e3aae40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:45.095088 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a42b2b6-7a17-4969-aa0a-e6e58e3aae40 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:45.131131 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-7a42b2b6-7a17-4969-aa0a-e6e58e3aae40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:45.131131 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:45.131131 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:45.131131 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:45.131131 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:45.131131 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:45.131131 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:45.131131 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:45.131131 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:45.131131 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:45.131131 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:45.131131 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:45.131131 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:58:45.131131 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:58:45.131131 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:58:45.131131 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:58:45.132179 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:45.132179 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:45.132179 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:45.132179 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:45.132179 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:45.132179 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:45.132179 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:45.132179 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:45.132179 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:45.132179 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:45.132179 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:45.132179 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:45.132179 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:45.132179 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:45.132179 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:45.132179 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:45.132179 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:58:45.133159 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:58:45.133159 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:45.133159 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:58:45.140692 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 307/599] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 01:58:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:45.143689 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a98b25-490a-4c75-a3ff-c4b2cdf36db3 None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:45.143970 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a98b25-490a-4c75-a3ff-c4b2cdf36db3 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:45.144242 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a98b25-490a-4c75-a3ff-c4b2cdf36db3 None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:45.153344 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 308/600] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:58:45 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 29 01:58:45.153344 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a98b25-490a-4c75-a3ff-c4b2cdf36db3 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:45.165743 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:45.176218 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556ab605-4776-45c2-8803-9e2e05434bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:45.177373 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ab605-4776-45c2-8803-9e2e05434bab None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:45.179026 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ab605-4776-45c2-8803-9e2e05434bab None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:45.179026 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ab605-4776-45c2-8803-9e2e05434bab None admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:45.179026 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556ab605-4776-45c2-8803-9e2e05434bab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:45.179541 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556ab605-4776-45c2-8803-9e2e05434bab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:45.181036 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556ab605-4776-45c2-8803-9e2e05434bab None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:45.195342 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 293/601] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Sep 29 01:58:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:45.196602 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c32288-2669-4a73-8ee5-42bb579d6bdc None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:45.196981 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c32288-2669-4a73-8ee5-42bb579d6bdc None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:45.197257 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c32288-2669-4a73-8ee5-42bb579d6bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:45.217663 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-13c32288-2669-4a73-8ee5-42bb579d6bdc None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:45.218896 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-13c32288-2669-4a73-8ee5-42bb579d6bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:45.246374 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:45.280467 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a98b25-490a-4c75-a3ff-c4b2cdf36db3 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:45.301704 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 294/602] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:58:45.303173 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c32288-2669-4a73-8ee5-42bb579d6bdc None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:45.324616 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8488547-5c42-4ea0-9cf9-a10f550ea0b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:45.325233 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8488547-5c42-4ea0-9cf9-a10f550ea0b6 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:45.325534 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8488547-5c42-4ea0-9cf9-a10f550ea0b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:45.325804 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8488547-5c42-4ea0-9cf9-a10f550ea0b6 None admin] PATH_INFO: `/v3/domains` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:45.326442 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8488547-5c42-4ea0-9cf9-a10f550ea0b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:45.326737 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8488547-5c42-4ea0-9cf9-a10f550ea0b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:45.328284 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8488547-5c42-4ea0-9cf9-a10f550ea0b6 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:45.341752 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 309/603] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Sep 29 01:58:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:45.347139 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8488547-5c42-4ea0-9cf9-a10f550ea0b6 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:45.458863 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8488547-5c42-4ea0-9cf9-a10f550ea0b6 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:45.473408 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c32288-2669-4a73-8ee5-42bb579d6bdc None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:45.491003 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:45.503476 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f0db1f-ed18-4428-b1d7-68036e168597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:45.504125 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f0db1f-ed18-4428-b1d7-68036e168597 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:45.504405 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f0db1f-ed18-4428-b1d7-68036e168597 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:45.504676 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f0db1f-ed18-4428-b1d7-68036e168597 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:45.509920 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:45.518533 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f0db1f-ed18-4428-b1d7-68036e168597 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:45.520128 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f0db1f-ed18-4428-b1d7-68036e168597 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:45.525536 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04caf52f-59be-4e04-a266-bbb1a5127c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:45.526173 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04caf52f-59be-4e04-a266-bbb1a5127c93 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:45.526450 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04caf52f-59be-4e04-a266-bbb1a5127c93 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:45.526721 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04caf52f-59be-4e04-a266-bbb1a5127c93 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:45.532849 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-e3f0db1f-ed18-4428-b1d7-68036e168597 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:58:45.532849 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:45.532849 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:45.532849 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:45.532849 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:45.532849 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:45.532849 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:45.532849 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:45.532849 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:45.532849 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:45.532849 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:45.532849 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:45.532849 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 29 01:58:45.532849 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 29 01:58:45.532849 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 29 01:58:45.533920 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 29 01:58:45.533920 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:45.533920 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:45.533920 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:45.533920 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:45.533920 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:45.533920 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:45.533920 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:45.533920 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:45.533920 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:45.533920 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:45.533920 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:45.533920 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:45.533920 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:45.533920 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:45.533920 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:45.533920 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:45.534815 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 29 01:58:45.534815 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 29 01:58:45.534815 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 29 01:58:45.534815 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 29 01:58:45.534815 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 29 01:58:45.534815 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 29 01:58:45.534815 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:58:45.534815 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:58:45.534815 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 310/604] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Sep 29 01:58:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 01:58:45.540019 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f0db1f-ed18-4428-b1d7-68036e168597 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:45.552306 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04caf52f-59be-4e04-a266-bbb1a5127c93 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:45.553820 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04caf52f-59be-4e04-a266-bbb1a5127c93 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:45.586941 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-04caf52f-59be-4e04-a266-bbb1a5127c93 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:58:45.586941 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:45.586941 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:45.586941 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:45.586941 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:45.586941 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:45.586941 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:45.586941 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:45.586941 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:45.586941 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:45.586941 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:45.586941 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:45.586941 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 29 01:58:45.586941 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 29 01:58:45.586941 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 29 01:58:45.587871 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 29 01:58:45.587871 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:45.587871 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:45.587871 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:45.587871 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:45.587871 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:45.587871 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:45.587871 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:45.587871 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:45.587871 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:45.587871 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:45.587871 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:45.587871 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:45.587871 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:45.587871 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:45.587871 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:45.587871 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:45.588811 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 29 01:58:45.588811 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 29 01:58:45.588811 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 29 01:58:45.588811 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 29 01:58:45.588811 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 29 01:58:45.588811 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 29 01:58:45.588811 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:58:45.588811 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:58:45.588811 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 295/605] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Sep 29 01:58:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:45.599337 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04caf52f-59be-4e04-a266-bbb1a5127c93 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:45.650557 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f0db1f-ed18-4428-b1d7-68036e168597 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:45.685624 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319f55e5-934d-4800-9db1-cb5d91361464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:45.686282 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f55e5-934d-4800-9db1-cb5d91361464 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:45.686559 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f55e5-934d-4800-9db1-cb5d91361464 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:45.686828 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f55e5-934d-4800-9db1-cb5d91361464 None admin] PATH_INFO: `/v3/projects` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:45.687508 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319f55e5-934d-4800-9db1-cb5d91361464 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:45.687805 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319f55e5-934d-4800-9db1-cb5d91361464 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:45.689792 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319f55e5-934d-4800-9db1-cb5d91361464 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:45.704370 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 311/606] 10.222.0.49 () {56 vars in 1148 bytes} [Thu Sep 29 01:58:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:58:45.708164 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319f55e5-934d-4800-9db1-cb5d91361464 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:45.763515 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:45.809017 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04caf52f-59be-4e04-a266-bbb1a5127c93 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:45.816638 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319f55e5-934d-4800-9db1-cb5d91361464 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:45.851851 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c48b902-1216-443f-b844-96740559b0b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:45.852462 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c48b902-1216-443f-b844-96740559b0b9 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:45.852741 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c48b902-1216-443f-b844-96740559b0b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:45.853010 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c48b902-1216-443f-b844-96740559b0b9 None admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:45.853178 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3e2098-d8e0-430a-bdd4-f1480b826758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:45.853743 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c48b902-1216-443f-b844-96740559b0b9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:45.853935 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3e2098-d8e0-430a-bdd4-f1480b826758 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:45.854087 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c48b902-1216-443f-b844-96740559b0b9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:45.854233 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3e2098-d8e0-430a-bdd4-f1480b826758 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:45.854377 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3e2098-d8e0-430a-bdd4-f1480b826758 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:45.855453 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c48b902-1216-443f-b844-96740559b0b9 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:45.864876 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3e2098-d8e0-430a-bdd4-f1480b826758 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:58:45.869772 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-8f3e2098-d8e0-430a-bdd4-f1480b826758 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 29 01:58:45.869772 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:45.869772 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:45.869772 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:45.869772 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:45.869772 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:45.869772 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:45.869772 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:45.869772 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:45.869772 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:45.869772 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:45.869772 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:45.869772 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:58:45.869772 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:58:45.869772 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:58:45.869772 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:58:45.871883 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:58:45.871883 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:58:45.871883 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:58:45.871883 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:58:45.871883 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:45.871883 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:45.871883 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:45.871883 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:45.871883 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:45.871883 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:45.871883 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:45.871883 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:45.871883 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:45.871883 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:45.871883 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:45.871883 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:45.874233 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:45.874233 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:45.874233 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:45.874233 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:45.874233 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:58:45.874233 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:58:45.874233 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:58:45.874233 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:58:45.874233 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:58:45.874233 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:58:45.874233 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 29 01:58:45.874233 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:58:45.875532 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 296/608] 10.222.0.49 () {56 vars in 1148 bytes} [Thu Sep 29 01:58:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:45.875532 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c48b902-1216-443f-b844-96740559b0b9 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:45.885333 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 312/608] 10.222.0.49 () {56 vars in 1102 bytes} [Thu Sep 29 01:58:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:45.885333 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3e2098-d8e0-430a-bdd4-f1480b826758 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:45.969767 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:45.988404 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c48b902-1216-443f-b844-96740559b0b9 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:46.015796 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3e2098-d8e0-430a-bdd4-f1480b826758 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:46.027798 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:46.034923 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952cb6cf-ee77-429d-ab48-a4651d3c13ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:46.036028 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952cb6cf-ee77-429d-ab48-a4651d3c13ff None admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:46.036535 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952cb6cf-ee77-429d-ab48-a4651d3c13ff None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:46.036906 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952cb6cf-ee77-429d-ab48-a4651d3c13ff None admin] PATH_INFO: `/v3/projects/6f1d8fd250c84c5887cb3173053ea2dd/users/2053f823bd3c4098a43c299890c1f733/roles/393e6032e5cc4678b8351026fe4434f8` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:46.056543 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952cb6cf-ee77-429d-ab48-a4651d3c13ff None admin] RBAC: Authorizing `identity:create_grant(project_id=6f1d8fd250c84c5887cb3173053ea2dd, user_id=2053f823bd3c4098a43c299890c1f733, role_id=393e6032e5cc4678b8351026fe4434f8)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:46.057467 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6138010b-4959-41a5-9099-3772c0842fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:46.058257 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952cb6cf-ee77-429d-ab48-a4651d3c13ff None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:46.058429 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6138010b-4959-41a5-9099-3772c0842fa9 None admin] REQUEST_METHOD: `PUT` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:46.058858 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6138010b-4959-41a5-9099-3772c0842fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:46.059331 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6138010b-4959-41a5-9099-3772c0842fa9 None admin] PATH_INFO: `/v3/projects/6f1d8fd250c84c5887cb3173053ea2dd/users/e75135b856134ba4b9ccac337886f682/roles/393e6032e5cc4678b8351026fe4434f8` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:46.077395 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 297/609] 10.222.0.49 () {58 vars in 1439 bytes} [Thu Sep 29 01:58:45 2022] PUT /identity/v3/projects/6f1d8fd250c84c5887cb3173053ea2dd/users/2053f823bd3c4098a43c299890c1f733/roles/393e6032e5cc4678b8351026fe4434f8 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 01:58:46.079529 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952cb6cf-ee77-429d-ab48-a4651d3c13ff None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:46.086686 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6138010b-4959-41a5-9099-3772c0842fa9 None admin] RBAC: Authorizing `identity:create_grant(project_id=6f1d8fd250c84c5887cb3173053ea2dd, user_id=e75135b856134ba4b9ccac337886f682, role_id=393e6032e5cc4678b8351026fe4434f8)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:46.088860 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6138010b-4959-41a5-9099-3772c0842fa9 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:46.114267 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 313/610] 10.222.0.49 () {58 vars in 1439 bytes} [Thu Sep 29 01:58:45 2022] PUT /identity/v3/projects/6f1d8fd250c84c5887cb3173053ea2dd/users/e75135b856134ba4b9ccac337886f682/roles/393e6032e5cc4678b8351026fe4434f8 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 01:58:46.233527 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:46.246083 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952cb6cf-ee77-429d-ab48-a4651d3c13ff None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:46.304415 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ac549-62a2-43d7-83d7-07521487958c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:46.305067 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ac549-62a2-43d7-83d7-07521487958c None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:46.305333 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ac549-62a2-43d7-83d7-07521487958c None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:46.305616 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ac549-62a2-43d7-83d7-07521487958c None admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:46.306361 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2ac549-62a2-43d7-83d7-07521487958c None admin] RBAC: Adding query filter params (name=service) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:46.306676 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2ac549-62a2-43d7-83d7-07521487958c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:46.308071 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2ac549-62a2-43d7-83d7-07521487958c None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:46.322244 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 298/611] 10.222.0.49 () {56 vars in 1103 bytes} [Thu Sep 29 01:58:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:46.328103 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6138010b-4959-41a5-9099-3772c0842fa9 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:46.455517 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6138010b-4959-41a5-9099-3772c0842fa9 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:46.492098 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70999d35-3011-4d79-9e76-aceaeff15110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:46.492780 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70999d35-3011-4d79-9e76-aceaeff15110 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:46.493063 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70999d35-3011-4d79-9e76-aceaeff15110 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:46.493351 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70999d35-3011-4d79-9e76-aceaeff15110 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:46.504189 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70999d35-3011-4d79-9e76-aceaeff15110 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:46.505721 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70999d35-3011-4d79-9e76-aceaeff15110 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:46.521472 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-70999d35-3011-4d79-9e76-aceaeff15110 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:46.521472 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:46.521472 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:46.521472 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:46.521472 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:46.521472 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:46.521472 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:46.521472 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:46.521472 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:46.521472 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:46.521472 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:46.521472 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:46.521472 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:58:46.521472 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:58:46.521472 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:58:46.521472 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:58:46.522471 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:46.522471 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:46.522471 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:46.522471 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:46.522471 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:46.522471 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:46.522471 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:46.522471 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:46.522471 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:46.522471 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:46.522471 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:46.522471 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:46.522471 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:46.522471 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:46.522471 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:46.522471 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:46.522471 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:58:46.523367 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:58:46.523367 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:46.523367 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:58:46.523367 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 314/612] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 01:58:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:46.528995 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ac549-62a2-43d7-83d7-07521487958c None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:46.678430 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ac549-62a2-43d7-83d7-07521487958c None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:46.734033 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dc047e-2055-442a-80c6-fe05b0344f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:46.734660 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dc047e-2055-442a-80c6-fe05b0344f06 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:46.735466 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dc047e-2055-442a-80c6-fe05b0344f06 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:46.735983 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dc047e-2055-442a-80c6-fe05b0344f06 None admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:46.736712 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dc047e-2055-442a-80c6-fe05b0344f06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:46.737104 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dc047e-2055-442a-80c6-fe05b0344f06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:46.738659 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dc047e-2055-442a-80c6-fe05b0344f06 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:46.753899 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 299/613] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Sep 29 01:58:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:46.759233 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70999d35-3011-4d79-9e76-aceaeff15110 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:46.787516 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:46.877664 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106124a6-282a-48cd-be18-bde08658a071 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:46.878347 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106124a6-282a-48cd-be18-bde08658a071 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:46.878925 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106124a6-282a-48cd-be18-bde08658a071 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:46.880763 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 300/614] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:58:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:58:46.885943 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a325a-0cdb-46f3-80fe-0d31a773d351 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:46.886497 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a325a-0cdb-46f3-80fe-0d31a773d351 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:46.886993 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a325a-0cdb-46f3-80fe-0d31a773d351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:46.920545 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70999d35-3011-4d79-9e76-aceaeff15110 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:46.926472 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-888a325a-0cdb-46f3-80fe-0d31a773d351 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:46.927705 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-888a325a-0cdb-46f3-80fe-0d31a773d351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:46.947672 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:46.957936 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea5dd92-d72d-4f01-88f0-271b804417f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:46.958573 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea5dd92-d72d-4f01-88f0-271b804417f3 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:46.958852 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea5dd92-d72d-4f01-88f0-271b804417f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:46.959125 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea5dd92-d72d-4f01-88f0-271b804417f3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:46.967165 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea5dd92-d72d-4f01-88f0-271b804417f3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:46.968616 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea5dd92-d72d-4f01-88f0-271b804417f3 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:46.981842 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-bea5dd92-d72d-4f01-88f0-271b804417f3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 29 01:58:46.981842 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:46.981842 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:46.981842 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:46.981842 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:46.981842 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:46.981842 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:46.981842 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:46.981842 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:46.981842 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:46.981842 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:46.981842 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:46.981842 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 29 01:58:46.981842 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 29 01:58:46.981842 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 29 01:58:46.981842 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 29 01:58:46.982859 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:46.982859 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:46.982859 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 29 01:58:46.982859 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:58:46.982859 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 29 01:58:46.982859 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:58:46.982859 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:46.982859 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:46.982859 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:46.982859 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:46.982859 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:46.982859 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:46.982859 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:46.982859 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:46.982859 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:46.982859 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:46.982859 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:46.982859 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:46.983830 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:46.983830 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:46.983830 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 29 01:58:46.983830 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 29 01:58:46.983830 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 29 01:58:46.983830 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 29 01:58:46.983830 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 29 01:58:46.983830 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 29 01:58:46.983830 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 29 01:58:46.983830 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:58:46.983830 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 315/615] 10.222.0.49 () {56 vars in 1096 bytes} [Thu Sep 29 01:58:46 2022] GET /identity/v3/users/swift => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:46.998349 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea5dd92-d72d-4f01-88f0-271b804417f3 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:47.037504 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 301/616] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 29 01:58:47.134400 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:47.178276 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea5dd92-d72d-4f01-88f0-271b804417f3 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:47.228421 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781e2c9f-b7c2-4b29-9f1a-ff7e7943288d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:47.228954 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e2c9f-b7c2-4b29-9f1a-ff7e7943288d None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:47.229238 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e2c9f-b7c2-4b29-9f1a-ff7e7943288d None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:47.229536 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e2c9f-b7c2-4b29-9f1a-ff7e7943288d None admin] PATH_INFO: `/v3/users` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:47.230272 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781e2c9f-b7c2-4b29-9f1a-ff7e7943288d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:47.230577 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781e2c9f-b7c2-4b29-9f1a-ff7e7943288d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:47.231997 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781e2c9f-b7c2-4b29-9f1a-ff7e7943288d None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:47.259761 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 316/617] 10.222.0.49 () {56 vars in 1135 bytes} [Thu Sep 29 01:58:46 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:47.265219 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888a325a-0cdb-46f3-80fe-0d31a773d351 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:47.402303 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c209a5-383d-4f47-936a-6ac39845867f None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:47.402835 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c209a5-383d-4f47-936a-6ac39845867f None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:47.402835 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c209a5-383d-4f47-936a-6ac39845867f None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:47.404561 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 317/618] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:58:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:58:47.409675 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e0861-d54d-4574-afb9-30faa8da19e2 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:47.409956 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e0861-d54d-4574-afb9-30faa8da19e2 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:47.410233 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e0861-d54d-4574-afb9-30faa8da19e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:47.417265 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888a325a-0cdb-46f3-80fe-0d31a773d351 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:47.450489 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-3a3e0861-d54d-4574-afb9-30faa8da19e2 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:47.451753 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-3a3e0861-d54d-4574-afb9-30faa8da19e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:47.455377 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea388f4-2212-4d50-8de1-bfa69e89a128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:47.456022 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea388f4-2212-4d50-8de1-bfa69e89a128 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:47.456297 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea388f4-2212-4d50-8de1-bfa69e89a128 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:47.456566 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea388f4-2212-4d50-8de1-bfa69e89a128 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:47.467737 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea388f4-2212-4d50-8de1-bfa69e89a128 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:47.469283 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea388f4-2212-4d50-8de1-bfa69e89a128 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:47.472097 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:47.487335 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-8ea388f4-2212-4d50-8de1-bfa69e89a128 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:47.487335 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:47.487335 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:47.487335 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:47.487335 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:47.487335 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:47.487335 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:47.487335 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:47.487335 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:47.487335 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:47.487335 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:47.487335 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:47.487335 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:58:47.487335 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:58:47.487335 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:58:47.487335 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:58:47.488298 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:47.488298 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:47.488298 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:47.488298 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:47.488298 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:47.488298 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:47.488298 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:47.488298 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:47.488298 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:47.488298 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:47.488298 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:47.488298 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:47.488298 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:47.488298 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:47.488298 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:47.488298 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:47.488298 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:58:47.489286 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:58:47.489286 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:47.489286 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:58:47.493751 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 302/619] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 01:58:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:47.500064 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea388f4-2212-4d50-8de1-bfa69e89a128 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:47.565401 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 318/620] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:58:47.566679 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3e0861-d54d-4574-afb9-30faa8da19e2 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:47.674383 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea388f4-2212-4d50-8de1-bfa69e89a128 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:47.692744 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:47.724823 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8329d08c-b96a-4708-b935-6bc78852b1df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:47.725889 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8329d08c-b96a-4708-b935-6bc78852b1df None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:47.726421 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8329d08c-b96a-4708-b935-6bc78852b1df None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:47.727057 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8329d08c-b96a-4708-b935-6bc78852b1df None admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:47.727914 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8329d08c-b96a-4708-b935-6bc78852b1df None admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:47.728425 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8329d08c-b96a-4708-b935-6bc78852b1df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:47.730038 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8329d08c-b96a-4708-b935-6bc78852b1df None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:47.749526 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 303/621] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Sep 29 01:58:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:47.756419 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8329d08c-b96a-4708-b935-6bc78852b1df None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:47.784986 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3e0861-d54d-4574-afb9-30faa8da19e2 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:47.855819 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1510afd3-3072-4fc5-b3aa-72e1dd2eb62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:47.856464 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1510afd3-3072-4fc5-b3aa-72e1dd2eb62d None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:47.856743 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1510afd3-3072-4fc5-b3aa-72e1dd2eb62d None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:47.857011 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1510afd3-3072-4fc5-b3aa-72e1dd2eb62d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:47.857654 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:47.873645 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1510afd3-3072-4fc5-b3aa-72e1dd2eb62d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:58:47.879431 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-1510afd3-3072-4fc5-b3aa-72e1dd2eb62d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 29 01:58:47.879431 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:47.879431 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:47.879431 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:47.879431 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:47.879431 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:47.879431 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:47.879431 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:47.879431 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:47.879431 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:47.879431 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:47.879431 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:47.879431 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:58:47.879431 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:58:47.879431 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:58:47.879431 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:58:47.880419 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:58:47.880419 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:58:47.880419 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:58:47.880419 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:58:47.880419 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:47.880419 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:47.880419 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:47.880419 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:47.880419 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:47.880419 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:47.880419 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:47.880419 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:47.880419 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:47.880419 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:47.880419 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:47.880419 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:47.881244 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:47.881244 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:47.881244 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:47.881244 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:47.881244 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:58:47.881244 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:58:47.881244 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:58:47.881244 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:58:47.881244 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:58:47.881244 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:58:47.881244 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 29 01:58:47.881244 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:58:47.881961 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 319/622] 10.222.0.49 () {56 vars in 1102 bytes} [Thu Sep 29 01:58:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:47.887711 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1510afd3-3072-4fc5-b3aa-72e1dd2eb62d None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:47.951978 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8329d08c-b96a-4708-b935-6bc78852b1df None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:48.002827 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fe6474-85d6-4cc6-bcc4-ea12e87fa287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:48.004322 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fe6474-85d6-4cc6-bcc4-ea12e87fa287 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:48.004801 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fe6474-85d6-4cc6-bcc4-ea12e87fa287 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:48.005537 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fe6474-85d6-4cc6-bcc4-ea12e87fa287 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:48.015509 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fe6474-85d6-4cc6-bcc4-ea12e87fa287 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:48.017697 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1510afd3-3072-4fc5-b3aa-72e1dd2eb62d None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:48.017985 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fe6474-85d6-4cc6-bcc4-ea12e87fa287 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:48.035937 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-c9fe6474-85d6-4cc6-bcc4-ea12e87fa287 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:58:48.035937 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:48.035937 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:48.035937 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:48.035937 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:48.035937 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:48.035937 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:48.035937 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:48.035937 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:48.035937 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:48.035937 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:48.035937 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:48.035937 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 29 01:58:48.035937 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 29 01:58:48.035937 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 29 01:58:48.037097 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 29 01:58:48.037097 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:48.037097 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:48.037097 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:48.037097 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:48.037097 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:48.037097 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:48.037097 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:48.037097 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:48.037097 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:48.037097 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:48.037097 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:48.037097 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:48.037097 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:48.037097 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:48.037097 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:48.037097 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:48.038081 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 29 01:58:48.038081 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 29 01:58:48.038081 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 29 01:58:48.038081 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 29 01:58:48.038081 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 29 01:58:48.038081 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 29 01:58:48.038081 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:58:48.038081 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:58:48.040108 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 304/623] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Sep 29 01:58:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:48.040898 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fe6474-85d6-4cc6-bcc4-ea12e87fa287 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:48.046407 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:48.066399 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d87ba8-2509-4333-84ba-d4e189178cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:48.067021 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d87ba8-2509-4333-84ba-d4e189178cfb None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:48.067301 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d87ba8-2509-4333-84ba-d4e189178cfb None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:48.067570 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d87ba8-2509-4333-84ba-d4e189178cfb None admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:48.068516 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d87ba8-2509-4333-84ba-d4e189178cfb None admin] RBAC: Adding query filter params (name=service) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:48.068821 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d87ba8-2509-4333-84ba-d4e189178cfb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:48.070977 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d87ba8-2509-4333-84ba-d4e189178cfb None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:48.085468 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 320/624] 10.222.0.49 () {56 vars in 1103 bytes} [Thu Sep 29 01:58:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:58:48.086620 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d87ba8-2509-4333-84ba-d4e189178cfb None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:48.173061 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fe6474-85d6-4cc6-bcc4-ea12e87fa287 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:48.191334 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:48.204003 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d87ba8-2509-4333-84ba-d4e189178cfb None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:48.211549 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c263c6-3ea0-40cf-b3ae-ed70bec7fe31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:48.212526 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c263c6-3ea0-40cf-b3ae-ed70bec7fe31 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:48.212526 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c263c6-3ea0-40cf-b3ae-ed70bec7fe31 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:48.212815 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c263c6-3ea0-40cf-b3ae-ed70bec7fe31 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:48.224008 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c263c6-3ea0-40cf-b3ae-ed70bec7fe31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:58:48.228985 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-a0c263c6-3ea0-40cf-b3ae-ed70bec7fe31 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 29 01:58:48.228985 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:48.228985 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:48.228985 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:48.228985 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:48.228985 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:48.228985 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:48.228985 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:48.228985 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:48.228985 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:48.228985 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:48.228985 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:48.228985 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:58:48.228985 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:58:48.228985 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:58:48.228985 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:58:48.229903 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:58:48.229903 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:58:48.229903 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:58:48.229903 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:58:48.229903 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:48.229903 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:48.229903 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:48.229903 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:48.229903 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:48.229903 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:48.229903 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:48.229903 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:48.229903 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:48.229903 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:48.229903 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:48.229903 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:48.230737 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:48.230737 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:48.230737 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:48.230737 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:48.230737 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:58:48.230737 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:58:48.230737 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:58:48.230737 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:58:48.230737 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:58:48.230737 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:58:48.230737 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 29 01:58:48.230737 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:58:48.230737 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 305/625] 10.222.0.49 () {56 vars in 1102 bytes} [Thu Sep 29 01:58:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:48.231408 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c263c6-3ea0-40cf-b3ae-ed70bec7fe31 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:48.250367 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f67962f-548c-4793-a891-8481ee642767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:48.251373 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f67962f-548c-4793-a891-8481ee642767 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:48.251907 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f67962f-548c-4793-a891-8481ee642767 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:48.252520 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f67962f-548c-4793-a891-8481ee642767 None admin] PATH_INFO: `/v3/projects` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:48.253593 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f67962f-548c-4793-a891-8481ee642767 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:48.254104 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f67962f-548c-4793-a891-8481ee642767 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:48.255842 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f67962f-548c-4793-a891-8481ee642767 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:48.270342 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 321/626] 10.222.0.49 () {56 vars in 1148 bytes} [Thu Sep 29 01:58:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:48.271432 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f67962f-548c-4793-a891-8481ee642767 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:48.318621 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:48.344967 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c263c6-3ea0-40cf-b3ae-ed70bec7fe31 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:48.382635 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36953561-5621-4753-9ae0-25b7221fa45f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:48.383327 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36953561-5621-4753-9ae0-25b7221fa45f None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:48.383662 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36953561-5621-4753-9ae0-25b7221fa45f None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:48.383873 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36953561-5621-4753-9ae0-25b7221fa45f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:48.386253 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f67962f-548c-4793-a891-8481ee642767 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:48.396157 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36953561-5621-4753-9ae0-25b7221fa45f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:48.397600 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36953561-5621-4753-9ae0-25b7221fa45f None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:48.415912 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-36953561-5621-4753-9ae0-25b7221fa45f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:48.415912 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:48.415912 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:48.415912 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:48.415912 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:48.415912 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:48.415912 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:48.415912 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:48.415912 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:48.415912 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:48.415912 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:48.415912 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:48.415912 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:58:48.415912 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:58:48.415912 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:58:48.415912 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:58:48.417228 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:48.417228 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:48.417228 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:48.417228 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:48.417228 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:48.417228 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:48.417228 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:48.417228 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:48.417228 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:48.417228 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:48.417228 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:48.417228 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:48.417228 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:48.417228 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:48.417228 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:48.417228 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:48.417228 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:58:48.418596 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:58:48.418596 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:48.418596 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:58:48.422358 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 306/627] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 01:58:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:48.423866 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36953561-5621-4753-9ae0-25b7221fa45f None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:48.433805 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9ee37a-1880-469c-ab2b-c25a8cddc35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:48.435073 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9ee37a-1880-469c-ab2b-c25a8cddc35f None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:48.435686 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9ee37a-1880-469c-ab2b-c25a8cddc35f None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:48.436205 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9ee37a-1880-469c-ab2b-c25a8cddc35f None admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:48.437161 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9ee37a-1880-469c-ab2b-c25a8cddc35f None admin] RBAC: Adding query filter params (name=service) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:48.437678 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9ee37a-1880-469c-ab2b-c25a8cddc35f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:48.439828 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9ee37a-1880-469c-ab2b-c25a8cddc35f None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:48.453941 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 322/628] 10.222.0.49 () {56 vars in 1103 bytes} [Thu Sep 29 01:58:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:48.454896 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:48.456028 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9ee37a-1880-469c-ab2b-c25a8cddc35f None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:48.533105 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36953561-5621-4753-9ae0-25b7221fa45f None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:48.568994 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9ee37a-1880-469c-ab2b-c25a8cddc35f None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:48.572116 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:48.573788 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec461323-1c29-4ddc-88fe-4c349bb41c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:48.574732 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec461323-1c29-4ddc-88fe-4c349bb41c1e None admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:48.575160 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec461323-1c29-4ddc-88fe-4c349bb41c1e None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:48.575589 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec461323-1c29-4ddc-88fe-4c349bb41c1e None admin] PATH_INFO: `/v3/projects/6f1d8fd250c84c5887cb3173053ea2dd/users/c88bc0f32600416ca7c6a59f4196e497/roles/393e6032e5cc4678b8351026fe4434f8` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:48.593562 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec461323-1c29-4ddc-88fe-4c349bb41c1e None admin] RBAC: Authorizing `identity:create_grant(project_id=6f1d8fd250c84c5887cb3173053ea2dd, user_id=c88bc0f32600416ca7c6a59f4196e497, role_id=393e6032e5cc4678b8351026fe4434f8)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:48.595872 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec461323-1c29-4ddc-88fe-4c349bb41c1e None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:48.611677 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61131a62-f869-4e38-b57d-38e49f054e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:48.621397 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 307/629] 10.222.0.49 () {58 vars in 1439 bytes} [Thu Sep 29 01:58:48 2022] PUT /identity/v3/projects/6f1d8fd250c84c5887cb3173053ea2dd/users/c88bc0f32600416ca7c6a59f4196e497/roles/393e6032e5cc4678b8351026fe4434f8 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 01:58:48.621631 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61131a62-f869-4e38-b57d-38e49f054e75 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:48.621631 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61131a62-f869-4e38-b57d-38e49f054e75 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:48.621631 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61131a62-f869-4e38-b57d-38e49f054e75 None admin] PATH_INFO: `/v3/domains` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:48.621902 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec461323-1c29-4ddc-88fe-4c349bb41c1e None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:48.621990 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61131a62-f869-4e38-b57d-38e49f054e75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:48.621990 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61131a62-f869-4e38-b57d-38e49f054e75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:48.621990 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61131a62-f869-4e38-b57d-38e49f054e75 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:48.634472 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 323/630] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Sep 29 01:58:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:48.636037 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e5db72-3c05-46ab-88fd-ed798584473a None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:48.636444 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e5db72-3c05-46ab-88fd-ed798584473a None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:48.636813 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e5db72-3c05-46ab-88fd-ed798584473a None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:48.638768 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 324/631] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:58:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:58:48.639769 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e5db72-3c05-46ab-88fd-ed798584473a None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:48.739889 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:48.770941 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec461323-1c29-4ddc-88fe-4c349bb41c1e None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:48.790538 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e5db72-3c05-46ab-88fd-ed798584473a None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:48.817554 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f78210-e96c-4129-92ed-071d52e5749b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:48.818193 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f78210-e96c-4129-92ed-071d52e5749b None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:48.818473 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f78210-e96c-4129-92ed-071d52e5749b None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:48.819330 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f78210-e96c-4129-92ed-071d52e5749b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:48.833595 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f78210-e96c-4129-92ed-071d52e5749b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:48.835119 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f78210-e96c-4129-92ed-071d52e5749b None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:48.837643 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecabe05d-8440-4e81-b9f5-a88e3a77e1f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:48.838280 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecabe05d-8440-4e81-b9f5-a88e3a77e1f7 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:48.838563 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecabe05d-8440-4e81-b9f5-a88e3a77e1f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:48.838839 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecabe05d-8440-4e81-b9f5-a88e3a77e1f7 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:48.846725 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecabe05d-8440-4e81-b9f5-a88e3a77e1f7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:48.848167 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecabe05d-8440-4e81-b9f5-a88e3a77e1f7 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:48.851483 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-43f78210-e96c-4129-92ed-071d52e5749b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:48.851483 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:48.851483 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:48.851483 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:48.851483 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:48.851483 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:48.851483 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:48.851483 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:48.851483 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:48.851483 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:48.851483 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:48.851483 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:48.851483 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:58:48.851483 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:58:48.851483 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:58:48.851483 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:58:48.852405 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:48.852405 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:48.852405 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:48.852405 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:48.852405 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:48.852405 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:48.852405 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:48.852405 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:48.852405 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:48.852405 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:48.852405 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:48.852405 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:48.852405 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:48.852405 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:48.852405 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:48.852405 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:48.852405 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:58:48.853274 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:58:48.853274 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:48.853274 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:58:48.853274 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 308/632] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 01:58:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:48.853940 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38afaadc-c9f6-49e9-acb5-1aa992fd5249 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:48.854050 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38afaadc-c9f6-49e9-acb5-1aa992fd5249 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:48.854298 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38afaadc-c9f6-49e9-acb5-1aa992fd5249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:48.860654 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-ecabe05d-8440-4e81-b9f5-a88e3a77e1f7 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 29 01:58:48.860654 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:48.860654 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:48.860654 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:48.860654 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:48.860654 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:48.860654 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:48.860654 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:48.860654 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:48.860654 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:48.860654 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:48.860654 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:48.860654 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 29 01:58:48.860654 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 29 01:58:48.860654 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 29 01:58:48.860654 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 29 01:58:48.862146 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:48.862146 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:48.862146 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 29 01:58:48.862146 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:58:48.862146 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 29 01:58:48.862146 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:58:48.862146 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:48.862146 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:48.862146 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:48.862146 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:48.862146 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:48.862146 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:48.862146 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:48.862146 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:48.862146 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:48.862146 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:48.862146 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:48.862146 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:48.864383 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:48.864383 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:48.864383 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 29 01:58:48.864383 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 29 01:58:48.864383 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 29 01:58:48.864383 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 29 01:58:48.864383 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 29 01:58:48.864383 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 29 01:58:48.864383 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 29 01:58:48.864383 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:58:48.864383 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 325/633] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Sep 29 01:58:48 2022] GET /identity/v3/users/glance => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:48.864383 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bf82a1-f47e-4a2a-af43-1cd938b8b02d None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:48.864383 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bf82a1-f47e-4a2a-af43-1cd938b8b02d None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:48.870177 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bf82a1-f47e-4a2a-af43-1cd938b8b02d None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:48.870177 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 326/634] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:58:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:58:48.870177 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bf82a1-f47e-4a2a-af43-1cd938b8b02d None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:48.885791 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-38afaadc-c9f6-49e9-acb5-1aa992fd5249 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:48.887016 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-38afaadc-c9f6-49e9-acb5-1aa992fd5249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:48.898464 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:48.960535 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 309/635] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:58:48.961406 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38afaadc-c9f6-49e9-acb5-1aa992fd5249 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:49.000702 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bf82a1-f47e-4a2a-af43-1cd938b8b02d None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:49.025993 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:49.053055 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e93983-ed7a-4518-9e98-2702836d63f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:49.054224 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e93983-ed7a-4518-9e98-2702836d63f9 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:49.055042 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e93983-ed7a-4518-9e98-2702836d63f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:49.055508 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e93983-ed7a-4518-9e98-2702836d63f9 None admin] PATH_INFO: `/v3/domains` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:49.056308 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e93983-ed7a-4518-9e98-2702836d63f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:49.056805 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e93983-ed7a-4518-9e98-2702836d63f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:49.059181 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e93983-ed7a-4518-9e98-2702836d63f9 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:49.069838 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38afaadc-c9f6-49e9-acb5-1aa992fd5249 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:49.081058 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 327/636] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Sep 29 01:58:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:49.083147 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf8435d-f596-4f3d-839a-b872dc4faeb4 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:49.083597 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf8435d-f596-4f3d-839a-b872dc4faeb4 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:49.084435 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf8435d-f596-4f3d-839a-b872dc4faeb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:49.108280 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-aaf8435d-f596-4f3d-839a-b872dc4faeb4 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:49.109820 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-aaf8435d-f596-4f3d-839a-b872dc4faeb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:49.111131 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de97b2c5-6853-4840-b6f8-2f5d4c1b726c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:49.111735 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de97b2c5-6853-4840-b6f8-2f5d4c1b726c None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:49.112009 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de97b2c5-6853-4840-b6f8-2f5d4c1b726c None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:49.112275 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de97b2c5-6853-4840-b6f8-2f5d4c1b726c None admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:49.112991 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de97b2c5-6853-4840-b6f8-2f5d4c1b726c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:49.113288 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de97b2c5-6853-4840-b6f8-2f5d4c1b726c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:49.114737 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de97b2c5-6853-4840-b6f8-2f5d4c1b726c None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:49.133702 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 310/637] 10.222.0.49 () {56 vars in 1137 bytes} [Thu Sep 29 01:58:48 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:49.134678 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de97b2c5-6853-4840-b6f8-2f5d4c1b726c None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:49.200990 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 328/638] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:58:49.202683 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf8435d-f596-4f3d-839a-b872dc4faeb4 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:49.228955 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:49.271993 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de97b2c5-6853-4840-b6f8-2f5d4c1b726c None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:49.291316 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:49.311067 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53600b24-3607-4128-9a8d-38f10fb2be0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:49.311614 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53600b24-3607-4128-9a8d-38f10fb2be0d None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:49.311887 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53600b24-3607-4128-9a8d-38f10fb2be0d None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:49.312151 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53600b24-3607-4128-9a8d-38f10fb2be0d None admin] PATH_INFO: `/v3/users/nova` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:49.327298 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53600b24-3607-4128-9a8d-38f10fb2be0d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:49.329170 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53600b24-3607-4128-9a8d-38f10fb2be0d None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:49.341645 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-53600b24-3607-4128-9a8d-38f10fb2be0d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 29 01:58:49.341645 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:49.341645 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:49.341645 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:49.341645 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:49.341645 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:49.341645 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:49.341645 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:49.341645 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:49.341645 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:49.341645 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:49.341645 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:49.341645 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 29 01:58:49.341645 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 29 01:58:49.341645 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 29 01:58:49.341645 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 29 01:58:49.342594 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:49.342594 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:49.342594 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 29 01:58:49.342594 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:58:49.342594 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 29 01:58:49.342594 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:58:49.342594 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:49.342594 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:49.342594 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:49.342594 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:49.342594 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:49.342594 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:49.342594 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:49.342594 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:49.342594 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:49.342594 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:49.342594 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:49.342594 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:49.343563 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:49.343563 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:49.343563 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 29 01:58:49.343563 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 29 01:58:49.343563 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 29 01:58:49.343563 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 29 01:58:49.343563 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 29 01:58:49.343563 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 29 01:58:49.343563 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 29 01:58:49.343563 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:58:49.343563 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 311/639] 10.222.0.49 () {56 vars in 1093 bytes} [Thu Sep 29 01:58:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:49.345784 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53600b24-3607-4128-9a8d-38f10fb2be0d None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:49.351272 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf8435d-f596-4f3d-839a-b872dc4faeb4 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:49.394454 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34ee568-00c6-4db0-8aee-977120aa568e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:49.395070 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34ee568-00c6-4db0-8aee-977120aa568e None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:49.395351 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34ee568-00c6-4db0-8aee-977120aa568e None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:49.395763 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34ee568-00c6-4db0-8aee-977120aa568e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:49.457001 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53600b24-3607-4128-9a8d-38f10fb2be0d None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:49.497958 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926348b3-47a6-4170-a145-e6026c6273f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:49.498827 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926348b3-47a6-4170-a145-e6026c6273f9 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:49.499247 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926348b3-47a6-4170-a145-e6026c6273f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:49.499685 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926348b3-47a6-4170-a145-e6026c6273f9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:49.508171 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34ee568-00c6-4db0-8aee-977120aa568e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:49.509642 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34ee568-00c6-4db0-8aee-977120aa568e None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:49.511648 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926348b3-47a6-4170-a145-e6026c6273f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:58:49.517215 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-926348b3-47a6-4170-a145-e6026c6273f9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 29 01:58:49.517215 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:49.517215 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:49.517215 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:49.517215 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:49.517215 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:49.517215 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:49.517215 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:49.517215 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:49.517215 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:49.517215 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:49.517215 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:49.517215 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:58:49.517215 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:58:49.517215 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:58:49.517215 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:58:49.518308 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:58:49.518308 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:58:49.518308 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:58:49.518308 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:58:49.518308 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:49.518308 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:49.518308 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:49.518308 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:49.518308 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:49.518308 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:49.518308 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:49.518308 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:49.518308 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:49.518308 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:49.518308 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:49.518308 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:49.519157 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:49.519157 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:49.519157 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:49.519157 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:49.519157 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:58:49.519157 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:58:49.519157 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:58:49.519157 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:58:49.519157 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:58:49.519157 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:58:49.519157 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 29 01:58:49.519157 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:58:49.521663 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 312/640] 10.222.0.49 () {56 vars in 1102 bytes} [Thu Sep 29 01:58:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:49.522657 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926348b3-47a6-4170-a145-e6026c6273f9 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:49.524407 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:49.568722 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:49.629264 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 329/641] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Sep 29 01:58:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 29 01:58:49.630176 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34ee568-00c6-4db0-8aee-977120aa568e None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:49.631455 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926348b3-47a6-4170-a145-e6026c6273f9 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:49.665189 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fdf03d-424c-4614-bb75-6096a628836e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:49.665807 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fdf03d-424c-4614-bb75-6096a628836e None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:49.666080 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fdf03d-424c-4614-bb75-6096a628836e None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:49.666346 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fdf03d-424c-4614-bb75-6096a628836e None admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:49.667311 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fdf03d-424c-4614-bb75-6096a628836e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:49.667604 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fdf03d-424c-4614-bb75-6096a628836e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:49.669042 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fdf03d-424c-4614-bb75-6096a628836e None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:49.687044 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 313/642] 10.222.0.49 () {56 vars in 1133 bytes} [Thu Sep 29 01:58:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:49.687916 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fdf03d-424c-4614-bb75-6096a628836e None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:49.740702 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34ee568-00c6-4db0-8aee-977120aa568e None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:49.762908 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:49.786897 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e3dc24-5c5c-47d3-8ab7-83403bcd3455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:49.787538 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e3dc24-5c5c-47d3-8ab7-83403bcd3455 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:49.787917 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e3dc24-5c5c-47d3-8ab7-83403bcd3455 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:49.788194 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e3dc24-5c5c-47d3-8ab7-83403bcd3455 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:49.793333 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:49.801163 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e3dc24-5c5c-47d3-8ab7-83403bcd3455 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:58:49.802266 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fdf03d-424c-4614-bb75-6096a628836e None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:49.806029 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-a3e3dc24-5c5c-47d3-8ab7-83403bcd3455 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 29 01:58:49.806029 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:49.806029 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:49.806029 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:49.806029 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:49.806029 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:49.806029 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:49.806029 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:49.806029 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:49.806029 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:49.806029 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:49.806029 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:49.806029 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:58:49.806029 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:58:49.806029 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:58:49.806029 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:58:49.807212 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:58:49.807212 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:58:49.807212 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:58:49.807212 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:58:49.807212 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:49.807212 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:49.807212 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:49.807212 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:49.807212 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:49.807212 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:49.807212 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:49.807212 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:49.807212 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:49.807212 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:49.807212 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:49.807212 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:49.808123 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:49.808123 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:49.808123 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:49.808123 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:49.808123 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:58:49.808123 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:58:49.808123 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:58:49.808123 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:58:49.808123 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:58:49.808123 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:58:49.808123 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 29 01:58:49.808123 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:58:49.808123 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 330/643] 10.222.0.49 () {56 vars in 1102 bytes} [Thu Sep 29 01:58:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:49.808816 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e3dc24-5c5c-47d3-8ab7-83403bcd3455 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:49.847673 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1657b3-37bd-498f-bd90-84735d61b4b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:49.848302 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1657b3-37bd-498f-bd90-84735d61b4b3 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:49.848638 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1657b3-37bd-498f-bd90-84735d61b4b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:49.848970 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1657b3-37bd-498f-bd90-84735d61b4b3 None admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:49.849728 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1657b3-37bd-498f-bd90-84735d61b4b3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:49.850092 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1657b3-37bd-498f-bd90-84735d61b4b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:49.851512 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1657b3-37bd-498f-bd90-84735d61b4b3 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:49.860900 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 314/644] 10.222.0.49 () {56 vars in 1103 bytes} [Thu Sep 29 01:58:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:49.861720 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1657b3-37bd-498f-bd90-84735d61b4b3 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:49.937195 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e3dc24-5c5c-47d3-8ab7-83403bcd3455 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:49.967479 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1657b3-37bd-498f-bd90-84735d61b4b3 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:49.978755 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d65a4b-6f7f-4d03-ada9-3d49ed6e8df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:49.979443 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d65a4b-6f7f-4d03-ada9-3d49ed6e8df5 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:49.979713 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d65a4b-6f7f-4d03-ada9-3d49ed6e8df5 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:49.979977 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d65a4b-6f7f-4d03-ada9-3d49ed6e8df5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:49.990690 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d65a4b-6f7f-4d03-ada9-3d49ed6e8df5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:49.992130 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d65a4b-6f7f-4d03-ada9-3d49ed6e8df5 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:50.005906 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a6a03e-c072-4db2-a4cc-ad27dfd44075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:50.006532 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a6a03e-c072-4db2-a4cc-ad27dfd44075 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:50.006804 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a6a03e-c072-4db2-a4cc-ad27dfd44075 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:50.007067 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a6a03e-c072-4db2-a4cc-ad27dfd44075 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:50.009122 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-d4d65a4b-6f7f-4d03-ada9-3d49ed6e8df5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:50.009122 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:50.009122 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:50.009122 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:50.009122 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:50.009122 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:50.009122 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:50.009122 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:50.009122 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:50.009122 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:50.009122 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:50.009122 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:50.009122 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:58:50.009122 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:58:50.009122 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:58:50.009122 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:58:50.010357 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:50.010357 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:50.010357 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:50.010357 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:50.010357 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:50.010357 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:50.010357 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:50.010357 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:50.010357 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:50.010357 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:50.010357 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:50.010357 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:50.010357 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:50.010357 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:50.010357 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:50.010357 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:50.010357 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:58:50.011630 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:58:50.011630 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:50.011630 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:58:50.015033 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 331/645] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 01:58:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:50.015968 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d65a4b-6f7f-4d03-ada9-3d49ed6e8df5 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:50.038483 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:50.050799 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:50.083728 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a6a03e-c072-4db2-a4cc-ad27dfd44075 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:50.085167 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a6a03e-c072-4db2-a4cc-ad27dfd44075 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:50.128869 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d65a4b-6f7f-4d03-ada9-3d49ed6e8df5 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:50.164341 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66719331-1f6d-4db9-9686-ee474b42cd69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:50.165052 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66719331-1f6d-4db9-9686-ee474b42cd69 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:50.165440 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66719331-1f6d-4db9-9686-ee474b42cd69 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:50.165754 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66719331-1f6d-4db9-9686-ee474b42cd69 None admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:50.166471 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66719331-1f6d-4db9-9686-ee474b42cd69 None admin] RBAC: Adding query filter params (name=service) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:50.166838 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66719331-1f6d-4db9-9686-ee474b42cd69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:50.168461 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66719331-1f6d-4db9-9686-ee474b42cd69 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:50.182037 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 332/646] 10.222.0.49 () {56 vars in 1103 bytes} [Thu Sep 29 01:58:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:50.182037 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66719331-1f6d-4db9-9686-ee474b42cd69 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:50.196434 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 315/647] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Sep 29 01:58:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 29 01:58:50.196434 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a6a03e-c072-4db2-a4cc-ad27dfd44075 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:50.258833 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:50.274380 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:50.288241 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66719331-1f6d-4db9-9686-ee474b42cd69 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:50.304323 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a6a03e-c072-4db2-a4cc-ad27dfd44075 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:50.322967 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9efc56-0f62-4cef-bb6f-0628d444329a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:50.323595 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9efc56-0f62-4cef-bb6f-0628d444329a None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:50.323873 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9efc56-0f62-4cef-bb6f-0628d444329a None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:50.324143 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9efc56-0f62-4cef-bb6f-0628d444329a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:50.335642 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9efc56-0f62-4cef-bb6f-0628d444329a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:50.337178 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9efc56-0f62-4cef-bb6f-0628d444329a None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:50.339966 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a02873-a427-448c-a78a-0ebec93eaaf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:50.340566 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a02873-a427-448c-a78a-0ebec93eaaf8 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:50.340839 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a02873-a427-448c-a78a-0ebec93eaaf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:50.341103 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a02873-a427-448c-a78a-0ebec93eaaf8 None admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:50.341764 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a02873-a427-448c-a78a-0ebec93eaaf8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:50.342056 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a02873-a427-448c-a78a-0ebec93eaaf8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:50.343380 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a02873-a427-448c-a78a-0ebec93eaaf8 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:50.351742 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-2c9efc56-0f62-4cef-bb6f-0628d444329a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:50.351742 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:50.351742 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:50.351742 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:50.351742 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:50.351742 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:50.351742 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:50.351742 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:50.351742 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:50.351742 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:50.351742 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:50.351742 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:50.351742 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:58:50.351742 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:58:50.351742 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:58:50.351742 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:58:50.352662 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:50.352662 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:50.352662 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:50.352662 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:50.352662 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:50.352662 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:50.352662 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:50.352662 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:50.352662 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:50.352662 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:50.352662 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:50.352662 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:50.352662 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:50.352662 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:50.352662 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:50.352662 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:50.352662 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:58:50.353600 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:58:50.353600 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:50.353600 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:58:50.353600 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 333/648] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 01:58:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:50.353600 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9efc56-0f62-4cef-bb6f-0628d444329a None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:50.365149 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 316/649] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Sep 29 01:58:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:50.365149 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a02873-a427-448c-a78a-0ebec93eaaf8 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:50.466078 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9efc56-0f62-4cef-bb6f-0628d444329a None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:50.466673 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a02873-a427-448c-a78a-0ebec93eaaf8 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:50.485261 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:50.503650 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fd0eb0-ba18-48db-8355-0c7b1e7e37cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:50.504286 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd0eb0-ba18-48db-8355-0c7b1e7e37cd None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:50.504562 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd0eb0-ba18-48db-8355-0c7b1e7e37cd None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:50.504831 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd0eb0-ba18-48db-8355-0c7b1e7e37cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:50.514066 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf41159-1e31-4caa-828e-9bc86fb67d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:50.514698 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf41159-1e31-4caa-828e-9bc86fb67d15 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:50.514974 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf41159-1e31-4caa-828e-9bc86fb67d15 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:50.515245 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf41159-1e31-4caa-828e-9bc86fb67d15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:50.516488 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fd0eb0-ba18-48db-8355-0c7b1e7e37cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:50.517976 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fd0eb0-ba18-48db-8355-0c7b1e7e37cd None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:50.525304 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:50.528203 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf41159-1e31-4caa-828e-9bc86fb67d15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:50.529690 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf41159-1e31-4caa-828e-9bc86fb67d15 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:50.534304 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-92fd0eb0-ba18-48db-8355-0c7b1e7e37cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:50.534304 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:50.534304 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:50.534304 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:50.534304 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:50.534304 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:50.534304 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:50.534304 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:50.534304 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:50.534304 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:50.534304 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:50.534304 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:50.534304 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:58:50.534304 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:58:50.534304 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:58:50.534304 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:58:50.535197 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:50.535197 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:50.535197 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:50.535197 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:50.535197 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:50.535197 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:50.535197 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:50.535197 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:50.535197 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:50.535197 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:50.535197 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:50.535197 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:50.535197 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:50.535197 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:50.535197 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:50.535197 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:50.535197 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:58:50.536086 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:58:50.536086 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:50.536086 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:58:50.536086 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 317/650] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 01:58:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:50.536709 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fd0eb0-ba18-48db-8355-0c7b1e7e37cd None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:50.550093 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-8cf41159-1e31-4caa-828e-9bc86fb67d15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:50.550093 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:50.550093 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:50.550093 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:50.550093 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:50.550093 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:50.550093 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:50.550093 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:50.550093 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:50.550093 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:50.550093 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:50.550093 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:50.550093 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:58:50.550093 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:58:50.550093 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:58:50.550093 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:58:50.551245 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:50.551245 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:50.551245 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:50.551245 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:50.551245 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:50.551245 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:50.551245 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:50.551245 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:50.551245 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:50.551245 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:50.551245 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:50.551245 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:50.551245 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:50.551245 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:50.551245 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:50.551245 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:50.551245 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:58:50.552356 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:58:50.552356 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:50.552356 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:58:50.553755 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 334/651] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 01:58:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:50.554660 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf41159-1e31-4caa-828e-9bc86fb67d15 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:50.650720 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fd0eb0-ba18-48db-8355-0c7b1e7e37cd None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:50.663447 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf41159-1e31-4caa-828e-9bc86fb67d15 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:50.689638 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9527c39e-f6c9-4aaf-81d3-43c01c050fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:50.690244 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9527c39e-f6c9-4aaf-81d3-43c01c050fd9 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:50.690582 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9527c39e-f6c9-4aaf-81d3-43c01c050fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:50.690859 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9527c39e-f6c9-4aaf-81d3-43c01c050fd9 None admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:50.691494 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9527c39e-f6c9-4aaf-81d3-43c01c050fd9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:50.691795 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9527c39e-f6c9-4aaf-81d3-43c01c050fd9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:50.693168 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9527c39e-f6c9-4aaf-81d3-43c01c050fd9 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:50.701579 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0e3ed3-6d42-4506-9076-8d5c704c8c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:50.702405 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0e3ed3-6d42-4506-9076-8d5c704c8c00 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:50.702678 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0e3ed3-6d42-4506-9076-8d5c704c8c00 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:50.702949 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0e3ed3-6d42-4506-9076-8d5c704c8c00 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:50.706382 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 318/652] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Sep 29 01:58:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:50.707110 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9527c39e-f6c9-4aaf-81d3-43c01c050fd9 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:50.714235 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0e3ed3-6d42-4506-9076-8d5c704c8c00 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:50.715701 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0e3ed3-6d42-4506-9076-8d5c704c8c00 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:50.727788 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-1e0e3ed3-6d42-4506-9076-8d5c704c8c00 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:58:50.727788 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:50.727788 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:50.727788 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:50.727788 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:50.727788 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:50.727788 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:50.727788 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:50.727788 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:50.727788 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:50.727788 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:50.727788 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:50.727788 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 29 01:58:50.727788 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 29 01:58:50.727788 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 29 01:58:50.728957 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 29 01:58:50.728957 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:50.728957 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:50.728957 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:50.728957 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:50.728957 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:50.728957 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:50.728957 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:50.728957 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:50.728957 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:50.728957 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:50.728957 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:50.728957 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:50.728957 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:50.728957 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:50.728957 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:50.728957 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:50.729891 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 29 01:58:50.729891 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 29 01:58:50.729891 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 29 01:58:50.729891 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 29 01:58:50.729891 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 29 01:58:50.729891 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 29 01:58:50.729891 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:58:50.729891 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:58:50.729891 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 335/653] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Sep 29 01:58:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:50.729891 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0e3ed3-6d42-4506-9076-8d5c704c8c00 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:50.746058 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:50.795730 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:50.833419 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9527c39e-f6c9-4aaf-81d3-43c01c050fd9 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:50.864412 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0e3ed3-6d42-4506-9076-8d5c704c8c00 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:50.870281 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48338b5-e013-4483-a311-682f01d9fb7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:50.870883 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48338b5-e013-4483-a311-682f01d9fb7b None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:50.871161 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48338b5-e013-4483-a311-682f01d9fb7b None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:50.871429 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48338b5-e013-4483-a311-682f01d9fb7b None admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:50.872068 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48338b5-e013-4483-a311-682f01d9fb7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:50.872365 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48338b5-e013-4483-a311-682f01d9fb7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:50.873751 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48338b5-e013-4483-a311-682f01d9fb7b None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:50.889633 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 319/654] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Sep 29 01:58:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:50.889633 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48338b5-e013-4483-a311-682f01d9fb7b None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:50.908319 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06913d33-6f91-4652-a78c-606e4095f86d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:50.908939 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06913d33-6f91-4652-a78c-606e4095f86d None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:50.909225 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06913d33-6f91-4652-a78c-606e4095f86d None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:50.909531 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06913d33-6f91-4652-a78c-606e4095f86d None admin] PATH_INFO: `/v3/domains` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:50.910174 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06913d33-6f91-4652-a78c-606e4095f86d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:50.910472 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06913d33-6f91-4652-a78c-606e4095f86d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:50.911854 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06913d33-6f91-4652-a78c-606e4095f86d None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:50.924459 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 336/655] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Sep 29 01:58:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:50.925269 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06913d33-6f91-4652-a78c-606e4095f86d None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:50.980327 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:50.991089 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48338b5-e013-4483-a311-682f01d9fb7b None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:51.024428 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06913d33-6f91-4652-a78c-606e4095f86d None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:51.024850 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0184feb-fa71-4547-bf24-55f5513629b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:51.025508 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0184feb-fa71-4547-bf24-55f5513629b5 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:51.025794 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0184feb-fa71-4547-bf24-55f5513629b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:51.026066 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0184feb-fa71-4547-bf24-55f5513629b5 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:51.034331 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0184feb-fa71-4547-bf24-55f5513629b5 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:51.035768 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0184feb-fa71-4547-bf24-55f5513629b5 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:51.038137 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:51.047626 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-f0184feb-fa71-4547-bf24-55f5513629b5 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 29 01:58:51.047626 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:51.047626 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:51.047626 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:51.047626 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:51.047626 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:51.047626 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:51.047626 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:51.047626 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:51.047626 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:51.047626 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:51.047626 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:51.047626 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 29 01:58:51.047626 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 29 01:58:51.047626 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 29 01:58:51.047626 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 29 01:58:51.048904 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:51.048904 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:51.048904 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 29 01:58:51.048904 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:58:51.048904 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 29 01:58:51.048904 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:58:51.048904 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:51.048904 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:51.048904 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:51.048904 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:51.048904 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:51.048904 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:51.048904 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:51.048904 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:51.048904 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:51.048904 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:51.048904 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:51.048904 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:51.050044 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:51.050044 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:51.050044 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 29 01:58:51.050044 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 29 01:58:51.050044 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 29 01:58:51.050044 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 29 01:58:51.050044 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 29 01:58:51.050044 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 29 01:58:51.050044 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 29 01:58:51.050044 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:58:51.050044 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 320/656] 10.222.0.49 () {56 vars in 1102 bytes} [Thu Sep 29 01:58:50 2022] GET /identity/v3/users/neutron => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:51.050779 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca1438c-ff3b-4d24-bb72-745d67f86f4f None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:51.050779 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca1438c-ff3b-4d24-bb72-745d67f86f4f None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:51.050779 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca1438c-ff3b-4d24-bb72-745d67f86f4f None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:51.052042 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 321/657] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:58:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:58:51.052584 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca1438c-ff3b-4d24-bb72-745d67f86f4f None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:51.065249 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061ac19d-474b-4e8d-89a1-7230cc3ba2f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:51.065964 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ac19d-474b-4e8d-89a1-7230cc3ba2f0 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:51.066318 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ac19d-474b-4e8d-89a1-7230cc3ba2f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:51.066598 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ac19d-474b-4e8d-89a1-7230cc3ba2f0 None admin] PATH_INFO: `/v3/projects` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:51.067295 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061ac19d-474b-4e8d-89a1-7230cc3ba2f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:51.067599 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061ac19d-474b-4e8d-89a1-7230cc3ba2f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:51.069023 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061ac19d-474b-4e8d-89a1-7230cc3ba2f0 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:51.081042 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 337/658] 10.222.0.49 () {56 vars in 1148 bytes} [Thu Sep 29 01:58:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:51.081877 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061ac19d-474b-4e8d-89a1-7230cc3ba2f0 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:51.160178 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca1438c-ff3b-4d24-bb72-745d67f86f4f None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:51.190630 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061ac19d-474b-4e8d-89a1-7230cc3ba2f0 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:51.194017 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658c3a59-c7fb-4e9b-8bad-ba5c1410bd68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:51.194641 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c3a59-c7fb-4e9b-8bad-ba5c1410bd68 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:51.194938 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c3a59-c7fb-4e9b-8bad-ba5c1410bd68 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:51.195189 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c3a59-c7fb-4e9b-8bad-ba5c1410bd68 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:51.201751 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658c3a59-c7fb-4e9b-8bad-ba5c1410bd68 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:51.203167 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658c3a59-c7fb-4e9b-8bad-ba5c1410bd68 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:51.215517 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-658c3a59-c7fb-4e9b-8bad-ba5c1410bd68 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:58:51.215517 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:51.215517 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:51.215517 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:51.215517 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:51.215517 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:51.215517 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:51.215517 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:51.215517 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:51.215517 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:51.215517 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:51.215517 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:51.215517 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 29 01:58:51.215517 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 29 01:58:51.215517 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 29 01:58:51.216602 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 29 01:58:51.216602 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:51.216602 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:51.216602 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:51.216602 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:51.216602 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:51.216602 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:51.216602 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:51.216602 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:51.216602 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:51.216602 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:51.216602 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:51.216602 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:51.216602 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:51.216602 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:51.216602 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:51.216602 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:51.218063 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 29 01:58:51.218063 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 29 01:58:51.218063 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 29 01:58:51.218063 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 29 01:58:51.218063 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 29 01:58:51.218063 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 29 01:58:51.218063 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:58:51.218063 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:58:51.218063 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 322/659] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Sep 29 01:58:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:51.218063 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658c3a59-c7fb-4e9b-8bad-ba5c1410bd68 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:51.226711 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aea19b-6537-4996-9db0-dff9b8f3ac65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:51.227340 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aea19b-6537-4996-9db0-dff9b8f3ac65 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:51.227616 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aea19b-6537-4996-9db0-dff9b8f3ac65 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:51.227884 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aea19b-6537-4996-9db0-dff9b8f3ac65 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:51.233266 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:51.236353 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aea19b-6537-4996-9db0-dff9b8f3ac65 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:51.237876 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aea19b-6537-4996-9db0-dff9b8f3ac65 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:51.248903 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-d0aea19b-6537-4996-9db0-dff9b8f3ac65 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 29 01:58:51.248903 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:51.248903 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:51.248903 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:51.248903 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:51.248903 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:51.248903 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:51.248903 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:51.248903 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:51.248903 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:51.248903 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:51.248903 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:51.248903 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 29 01:58:51.248903 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 29 01:58:51.248903 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 29 01:58:51.248903 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 29 01:58:51.255094 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:51.255094 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:51.255094 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 29 01:58:51.255094 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:58:51.255094 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 29 01:58:51.255094 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:58:51.255094 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:51.255094 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:51.255094 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:51.255094 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:51.255094 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:51.255094 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:51.255094 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:51.255094 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:51.255094 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:51.255094 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:51.255094 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:51.255094 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:51.256280 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:51.256280 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:51.256280 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 29 01:58:51.256280 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 29 01:58:51.256280 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 29 01:58:51.256280 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 29 01:58:51.256280 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 29 01:58:51.256280 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 29 01:58:51.256280 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 29 01:58:51.256280 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:58:51.256280 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 338/660] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Sep 29 01:58:51 2022] GET /identity/v3/users/cinder => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:51.256280 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef3aaf3-4196-43a8-a194-2690fdd58358 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:51.256280 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef3aaf3-4196-43a8-a194-2690fdd58358 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:51.257145 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef3aaf3-4196-43a8-a194-2690fdd58358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:51.271711 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-6ef3aaf3-4196-43a8-a194-2690fdd58358 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:51.272908 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-6ef3aaf3-4196-43a8-a194-2690fdd58358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:51.298285 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:51.322377 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658c3a59-c7fb-4e9b-8bad-ba5c1410bd68 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:51.338089 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 339/661] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:58:51.338915 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef3aaf3-4196-43a8-a194-2690fdd58358 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:51.367410 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e50369-08a5-4088-b24b-837fdac194a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:51.368008 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e50369-08a5-4088-b24b-837fdac194a9 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:51.368303 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e50369-08a5-4088-b24b-837fdac194a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:51.368545 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e50369-08a5-4088-b24b-837fdac194a9 None admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:51.369264 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e50369-08a5-4088-b24b-837fdac194a9 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:51.369592 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e50369-08a5-4088-b24b-837fdac194a9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:51.370985 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e50369-08a5-4088-b24b-837fdac194a9 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:51.395523 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 323/662] 10.222.0.49 () {56 vars in 1139 bytes} [Thu Sep 29 01:58:51 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:51.395523 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e50369-08a5-4088-b24b-837fdac194a9 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:51.443286 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef3aaf3-4196-43a8-a194-2690fdd58358 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:51.464705 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:51.478494 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edf09de-fcdb-4463-aa85-6206ef9e184b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:51.479106 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf09de-fcdb-4463-aa85-6206ef9e184b None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:51.479382 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf09de-fcdb-4463-aa85-6206ef9e184b None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:51.479653 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf09de-fcdb-4463-aa85-6206ef9e184b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:51.480364 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edf09de-fcdb-4463-aa85-6206ef9e184b None admin] RBAC: Adding query filter params (role.id=393e6032e5cc4678b8351026fe4434f8, scope.project.id=6f1d8fd250c84c5887cb3173053ea2dd, user.id=5d36669146554031ba8596cb583cd6f9) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:51.480672 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edf09de-fcdb-4463-aa85-6206ef9e184b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:51.482113 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edf09de-fcdb-4463-aa85-6206ef9e184b None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:51.488714 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 340/663] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Sep 29 01:58:51 2022] GET /identity/v3/role_assignments?user.id=5d36669146554031ba8596cb583cd6f9&scope.project.id=6f1d8fd250c84c5887cb3173053ea2dd&role.id=393e6032e5cc4678b8351026fe4434f8 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:51.489460 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edf09de-fcdb-4463-aa85-6206ef9e184b None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:51.518205 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e50369-08a5-4088-b24b-837fdac194a9 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:51.528897 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:51.562413 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f5989b-29f4-4b70-8946-12e596d38758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:51.563623 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f5989b-29f4-4b70-8946-12e596d38758 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:51.564147 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f5989b-29f4-4b70-8946-12e596d38758 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:51.564488 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f5989b-29f4-4b70-8946-12e596d38758 None admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:51.565472 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f5989b-29f4-4b70-8946-12e596d38758 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:51.565850 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f5989b-29f4-4b70-8946-12e596d38758 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:51.567736 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f5989b-29f4-4b70-8946-12e596d38758 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:51.582460 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 324/664] 10.222.0.49 () {56 vars in 1148 bytes} [Thu Sep 29 01:58:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:51.583718 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f5989b-29f4-4b70-8946-12e596d38758 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:51.638045 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edf09de-fcdb-4463-aa85-6206ef9e184b None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:51.673789 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e50b8d-27c3-4362-9da5-f8cfb1de3171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:51.674412 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e50b8d-27c3-4362-9da5-f8cfb1de3171 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:51.674686 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e50b8d-27c3-4362-9da5-f8cfb1de3171 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:51.674955 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e50b8d-27c3-4362-9da5-f8cfb1de3171 None admin] PATH_INFO: `/v3/users` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:51.675694 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e50b8d-27c3-4362-9da5-f8cfb1de3171 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:51.675995 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e50b8d-27c3-4362-9da5-f8cfb1de3171 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:51.677534 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e50b8d-27c3-4362-9da5-f8cfb1de3171 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:51.698099 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 341/665] 10.222.0.49 () {56 vars in 1137 bytes} [Thu Sep 29 01:58:51 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:51.699271 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e50b8d-27c3-4362-9da5-f8cfb1de3171 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:51.708233 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f5989b-29f4-4b70-8946-12e596d38758 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:51.742117 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:51.753504 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeca45e-a1c4-4ed9-bff3-708b68b7c0c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:51.754199 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeca45e-a1c4-4ed9-bff3-708b68b7c0c6 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:51.754542 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeca45e-a1c4-4ed9-bff3-708b68b7c0c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:51.754915 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeca45e-a1c4-4ed9-bff3-708b68b7c0c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:51.798275 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:51.818376 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e50b8d-27c3-4362-9da5-f8cfb1de3171 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:51.835423 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeca45e-a1c4-4ed9-bff3-708b68b7c0c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:51.836881 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeca45e-a1c4-4ed9-bff3-708b68b7c0c6 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:51.855321 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b605aa-5ca6-4d18-b1dc-b2e97142d776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:51.855920 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b605aa-5ca6-4d18-b1dc-b2e97142d776 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:51.856195 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b605aa-5ca6-4d18-b1dc-b2e97142d776 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:51.856467 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b605aa-5ca6-4d18-b1dc-b2e97142d776 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:51.857175 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b605aa-5ca6-4d18-b1dc-b2e97142d776 None admin] RBAC: Adding query filter params (role.id=393e6032e5cc4678b8351026fe4434f8, scope.project.id=6f1d8fd250c84c5887cb3173053ea2dd, user.id=f3325a7111d447f4a9cf00c672d5420f) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:51.857502 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b605aa-5ca6-4d18-b1dc-b2e97142d776 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:51.858912 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b605aa-5ca6-4d18-b1dc-b2e97142d776 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:51.865761 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 342/666] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Sep 29 01:58:51 2022] GET /identity/v3/role_assignments?user.id=f3325a7111d447f4a9cf00c672d5420f&scope.project.id=6f1d8fd250c84c5887cb3173053ea2dd&role.id=393e6032e5cc4678b8351026fe4434f8 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:51.866652 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b605aa-5ca6-4d18-b1dc-b2e97142d776 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:51.977199 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 325/667] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Sep 29 01:58:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 29 01:58:51.978507 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeca45e-a1c4-4ed9-bff3-708b68b7c0c6 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:51.986677 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b605aa-5ca6-4d18-b1dc-b2e97142d776 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:52.018169 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:52.026367 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed85713-7247-45d5-9e20-6aa7ce5fa030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:52.027028 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed85713-7247-45d5-9e20-6aa7ce5fa030 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:52.027309 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed85713-7247-45d5-9e20-6aa7ce5fa030 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:52.027583 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed85713-7247-45d5-9e20-6aa7ce5fa030 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:52.043418 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed85713-7247-45d5-9e20-6aa7ce5fa030 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:58:52.049712 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-4ed85713-7247-45d5-9e20-6aa7ce5fa030 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 29 01:58:52.049712 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:52.049712 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:52.049712 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:52.049712 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:52.049712 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:52.049712 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:52.049712 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:52.049712 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:52.049712 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:52.049712 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:52.049712 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:52.049712 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:58:52.049712 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:58:52.049712 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:58:52.049712 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:58:52.050867 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:58:52.050867 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:58:52.050867 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:58:52.050867 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:58:52.050867 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:52.050867 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:52.050867 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:52.050867 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:52.050867 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:52.050867 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:52.050867 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:52.050867 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:52.050867 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:52.050867 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:52.050867 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:52.050867 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:52.051900 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:52.051900 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:52.051900 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:52.051900 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:52.051900 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:58:52.051900 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:58:52.051900 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:58:52.051900 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:58:52.051900 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:58:52.051900 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:58:52.051900 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 29 01:58:52.051900 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:58:52.052595 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 343/668] 10.222.0.49 () {56 vars in 1102 bytes} [Thu Sep 29 01:58:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:52.053435 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed85713-7247-45d5-9e20-6aa7ce5fa030 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:52.071111 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:52.122125 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeca45e-a1c4-4ed9-bff3-708b68b7c0c6 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:52.168130 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9681b88-3e3c-4b90-b177-89c3c935def3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:52.168999 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9681b88-3e3c-4b90-b177-89c3c935def3 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:52.169418 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9681b88-3e3c-4b90-b177-89c3c935def3 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:52.169784 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9681b88-3e3c-4b90-b177-89c3c935def3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:52.195976 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed85713-7247-45d5-9e20-6aa7ce5fa030 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:52.240759 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38439e7-efe4-47b7-a131-b483efe0ceb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:52.241624 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38439e7-efe4-47b7-a131-b483efe0ceb3 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:52.242206 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38439e7-efe4-47b7-a131-b483efe0ceb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:52.242551 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38439e7-efe4-47b7-a131-b483efe0ceb3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:52.250001 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9681b88-3e3c-4b90-b177-89c3c935def3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:52.252436 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9681b88-3e3c-4b90-b177-89c3c935def3 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:52.257178 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38439e7-efe4-47b7-a131-b483efe0ceb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:52.258860 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38439e7-efe4-47b7-a131-b483efe0ceb3 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:52.278697 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-c38439e7-efe4-47b7-a131-b483efe0ceb3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:52.278697 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:52.278697 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:52.278697 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:52.278697 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:52.278697 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:52.278697 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:52.278697 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:52.278697 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:52.278697 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:52.278697 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:52.278697 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:52.278697 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:58:52.278697 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:58:52.278697 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:58:52.278697 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:58:52.279684 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:52.279684 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:52.279684 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:52.279684 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:52.279684 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:52.279684 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:52.279684 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:52.279684 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:52.279684 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:52.279684 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:52.279684 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:52.279684 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:52.279684 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:52.279684 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:52.279684 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:52.279684 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:52.279684 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:58:52.280568 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:58:52.280568 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:52.280568 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:58:52.280568 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 344/669] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 01:58:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:52.281856 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38439e7-efe4-47b7-a131-b483efe0ceb3 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:52.292948 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:52.367941 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:52.382394 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 326/670] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Sep 29 01:58:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 29 01:58:52.383465 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9681b88-3e3c-4b90-b177-89c3c935def3 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:52.414390 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38439e7-efe4-47b7-a131-b483efe0ceb3 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:52.453044 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437358a3-ad54-4f5a-8a40-2386bf1b6cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:52.454063 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437358a3-ad54-4f5a-8a40-2386bf1b6cf9 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:52.454482 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437358a3-ad54-4f5a-8a40-2386bf1b6cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:52.454884 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437358a3-ad54-4f5a-8a40-2386bf1b6cf9 None admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:52.455778 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437358a3-ad54-4f5a-8a40-2386bf1b6cf9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:52.456281 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437358a3-ad54-4f5a-8a40-2386bf1b6cf9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:52.457929 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437358a3-ad54-4f5a-8a40-2386bf1b6cf9 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:52.467168 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 345/671] 10.222.0.49 () {56 vars in 1103 bytes} [Thu Sep 29 01:58:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:52.468285 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437358a3-ad54-4f5a-8a40-2386bf1b6cf9 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:52.492283 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9681b88-3e3c-4b90-b177-89c3c935def3 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:52.523004 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:52.532901 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33979bbb-6525-4f2f-bdc4-6ff94f60eae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:52.533558 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33979bbb-6525-4f2f-bdc4-6ff94f60eae7 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:52.533833 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33979bbb-6525-4f2f-bdc4-6ff94f60eae7 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:52.534099 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33979bbb-6525-4f2f-bdc4-6ff94f60eae7 None admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:52.535021 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33979bbb-6525-4f2f-bdc4-6ff94f60eae7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:52.535141 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33979bbb-6525-4f2f-bdc4-6ff94f60eae7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:52.536753 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33979bbb-6525-4f2f-bdc4-6ff94f60eae7 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:52.551011 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 327/672] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Sep 29 01:58:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:52.551272 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33979bbb-6525-4f2f-bdc4-6ff94f60eae7 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:52.583978 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437358a3-ad54-4f5a-8a40-2386bf1b6cf9 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:52.608359 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:52.621487 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9f384f-2c67-471d-ae48-c0b7b7060a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:52.622396 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f384f-2c67-471d-ae48-c0b7b7060a0f None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:52.622907 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f384f-2c67-471d-ae48-c0b7b7060a0f None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:52.623373 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f384f-2c67-471d-ae48-c0b7b7060a0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:52.635496 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9f384f-2c67-471d-ae48-c0b7b7060a0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:52.637453 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9f384f-2c67-471d-ae48-c0b7b7060a0f None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:52.654075 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-dc9f384f-2c67-471d-ae48-c0b7b7060a0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:52.654075 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:52.654075 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:52.654075 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:52.654075 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:52.654075 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:52.654075 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:52.654075 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:52.654075 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:52.654075 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:52.654075 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:52.654075 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:52.654075 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:58:52.654075 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:58:52.654075 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:58:52.654075 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:58:52.655154 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:52.655154 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:52.655154 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:52.655154 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:52.655154 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:52.655154 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:52.655154 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:52.655154 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:52.655154 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:52.655154 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:52.655154 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:52.655154 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:52.655154 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:52.655154 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:52.655154 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:52.655154 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:52.655154 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:58:52.656008 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:58:52.656008 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:52.656008 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:58:52.658481 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 346/673] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 01:58:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:52.659541 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9f384f-2c67-471d-ae48-c0b7b7060a0f None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:52.660151 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33979bbb-6525-4f2f-bdc4-6ff94f60eae7 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:52.696876 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4038b83e-469f-4614-a702-0d6f7563d812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:52.697788 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4038b83e-469f-4614-a702-0d6f7563d812 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:52.698070 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4038b83e-469f-4614-a702-0d6f7563d812 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:52.698340 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4038b83e-469f-4614-a702-0d6f7563d812 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:52.710547 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4038b83e-469f-4614-a702-0d6f7563d812 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:52.712157 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4038b83e-469f-4614-a702-0d6f7563d812 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:52.727706 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-4038b83e-469f-4614-a702-0d6f7563d812 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:52.727706 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:52.727706 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:52.727706 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:52.727706 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:52.727706 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:52.727706 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:52.727706 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:52.727706 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:52.727706 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:52.727706 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:52.727706 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:52.727706 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:58:52.727706 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:58:52.727706 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:58:52.727706 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:58:52.728705 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:52.728705 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:52.728705 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:52.728705 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:52.728705 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:52.728705 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:52.728705 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:52.728705 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:52.728705 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:52.728705 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:52.728705 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:52.728705 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:52.728705 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:52.728705 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:52.728705 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:52.728705 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:52.728705 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:58:52.729616 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:58:52.729616 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:52.729616 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:58:52.729616 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 328/674] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 01:58:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:52.730645 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4038b83e-469f-4614-a702-0d6f7563d812 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:52.782775 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:52.786309 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9f384f-2c67-471d-ae48-c0b7b7060a0f None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:52.822833 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75737cc3-3c23-4767-bf64-e2f435a87e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:52.823916 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75737cc3-3c23-4767-bf64-e2f435a87e21 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:52.824410 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75737cc3-3c23-4767-bf64-e2f435a87e21 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:52.824885 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75737cc3-3c23-4767-bf64-e2f435a87e21 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:52.833629 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75737cc3-3c23-4767-bf64-e2f435a87e21 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:52.835489 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75737cc3-3c23-4767-bf64-e2f435a87e21 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:52.846296 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4038b83e-469f-4614-a702-0d6f7563d812 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:52.848732 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-75737cc3-3c23-4767-bf64-e2f435a87e21 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:58:52.848732 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:52.848732 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:52.848732 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:52.848732 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:52.848732 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:52.848732 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:52.848732 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:52.848732 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:52.848732 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:52.848732 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:52.848732 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:52.848732 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 29 01:58:52.848732 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 29 01:58:52.848732 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 29 01:58:52.849620 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 29 01:58:52.849620 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:52.849620 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:52.849620 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:52.849620 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:52.849620 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:52.849620 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:52.849620 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:52.849620 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:52.849620 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:52.849620 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:52.849620 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:52.849620 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:52.849620 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:52.849620 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:52.849620 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:52.849620 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:52.850493 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 29 01:58:52.850493 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 29 01:58:52.850493 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 29 01:58:52.850493 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 29 01:58:52.850493 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 29 01:58:52.850493 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 29 01:58:52.850493 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:58:52.850493 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:58:52.852792 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 347/675] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Sep 29 01:58:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:52.853922 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75737cc3-3c23-4767-bf64-e2f435a87e21 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:52.882416 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fd8bd9-118c-4b61-b62c-d361392e652c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:52.883025 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd8bd9-118c-4b61-b62c-d361392e652c None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:52.883298 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd8bd9-118c-4b61-b62c-d361392e652c None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:52.883691 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd8bd9-118c-4b61-b62c-d361392e652c None admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:52.884258 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fd8bd9-118c-4b61-b62c-d361392e652c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:52.884559 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fd8bd9-118c-4b61-b62c-d361392e652c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:52.886060 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fd8bd9-118c-4b61-b62c-d361392e652c None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:52.893116 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:52.902182 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 329/676] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Sep 29 01:58:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:52.902893 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fd8bd9-118c-4b61-b62c-d361392e652c None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:52.981175 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75737cc3-3c23-4767-bf64-e2f435a87e21 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:53.008314 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:53.012341 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fd8bd9-118c-4b61-b62c-d361392e652c None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:53.020007 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c378824e-2d30-4db1-81e7-447d62567353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:53.020750 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378824e-2d30-4db1-81e7-447d62567353 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:53.021138 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378824e-2d30-4db1-81e7-447d62567353 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:53.021851 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378824e-2d30-4db1-81e7-447d62567353 None admin] PATH_INFO: `/v3/domains` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:53.022371 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c378824e-2d30-4db1-81e7-447d62567353 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:53.022769 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c378824e-2d30-4db1-81e7-447d62567353 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:53.024334 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c378824e-2d30-4db1-81e7-447d62567353 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:53.038487 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 348/677] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Sep 29 01:58:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:53.039567 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c378824e-2d30-4db1-81e7-447d62567353 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:53.051205 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ad5582-583c-474e-970c-5040dd8f9708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:53.051997 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad5582-583c-474e-970c-5040dd8f9708 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:53.052414 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad5582-583c-474e-970c-5040dd8f9708 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:53.052845 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad5582-583c-474e-970c-5040dd8f9708 None admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:53.053731 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ad5582-583c-474e-970c-5040dd8f9708 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:53.054207 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ad5582-583c-474e-970c-5040dd8f9708 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:53.055854 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ad5582-583c-474e-970c-5040dd8f9708 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:53.068639 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 330/678] 10.222.0.49 () {56 vars in 1148 bytes} [Thu Sep 29 01:58:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:53.069688 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ad5582-583c-474e-970c-5040dd8f9708 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:53.141379 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:53.148769 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c378824e-2d30-4db1-81e7-447d62567353 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:53.172944 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ad5582-583c-474e-970c-5040dd8f9708 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:53.188485 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2510e7fe-469a-458f-8a74-c164e2314896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:53.189155 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2510e7fe-469a-458f-8a74-c164e2314896 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:53.189406 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2510e7fe-469a-458f-8a74-c164e2314896 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:53.189676 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2510e7fe-469a-458f-8a74-c164e2314896 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:53.197047 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2510e7fe-469a-458f-8a74-c164e2314896 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:53.198793 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2510e7fe-469a-458f-8a74-c164e2314896 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:53.209576 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2fc923-1f79-40b9-a620-4736eec48caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:53.210508 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2fc923-1f79-40b9-a620-4736eec48caf None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:53.210979 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2fc923-1f79-40b9-a620-4736eec48caf None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:53.211439 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2fc923-1f79-40b9-a620-4736eec48caf None admin] PATH_INFO: `/v3/users/swift` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:53.214819 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-2510e7fe-469a-458f-8a74-c164e2314896 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:58:53.214819 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:53.214819 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:53.214819 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:53.214819 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:53.214819 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:53.214819 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:53.214819 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:53.214819 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:53.214819 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:53.214819 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:53.214819 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:53.214819 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 29 01:58:53.214819 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 29 01:58:53.214819 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 29 01:58:53.215705 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 29 01:58:53.215705 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:53.215705 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:53.215705 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:53.215705 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:53.215705 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:53.215705 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:53.215705 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:53.215705 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:53.215705 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:53.215705 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:53.215705 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:53.215705 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:53.215705 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:53.215705 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:53.215705 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:53.215705 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:53.216632 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 29 01:58:53.216632 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 29 01:58:53.216632 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 29 01:58:53.216632 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 29 01:58:53.216632 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 29 01:58:53.216632 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 29 01:58:53.216632 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:58:53.216632 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:58:53.216632 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 349/679] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Sep 29 01:58:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:53.217103 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2510e7fe-469a-458f-8a74-c164e2314896 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:53.223282 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2fc923-1f79-40b9-a620-4736eec48caf None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:53.225011 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2fc923-1f79-40b9-a620-4736eec48caf None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:53.237719 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-3b2fc923-1f79-40b9-a620-4736eec48caf None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 29 01:58:53.237719 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:53.237719 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:53.237719 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:53.237719 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:53.237719 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:53.237719 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:53.237719 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:53.237719 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:53.237719 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:53.237719 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:53.237719 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:53.237719 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 29 01:58:53.237719 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 29 01:58:53.237719 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 29 01:58:53.237719 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 29 01:58:53.238683 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:53.238683 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:53.238683 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 29 01:58:53.238683 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:58:53.238683 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 29 01:58:53.238683 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:58:53.238683 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:53.238683 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:53.238683 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:53.238683 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:53.238683 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:53.238683 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:53.238683 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:53.238683 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:53.238683 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:53.238683 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:53.238683 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:53.238683 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:53.239706 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:53.239706 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:53.239706 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 29 01:58:53.239706 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 29 01:58:53.239706 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 29 01:58:53.239706 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 29 01:58:53.239706 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 29 01:58:53.239706 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 29 01:58:53.239706 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 29 01:58:53.239706 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:58:53.242268 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 331/680] 10.222.0.49 () {56 vars in 1096 bytes} [Thu Sep 29 01:58:53 2022] GET /identity/v3/users/swift => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:53.243353 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2fc923-1f79-40b9-a620-4736eec48caf None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:53.267911 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:53.341548 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2510e7fe-469a-458f-8a74-c164e2314896 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:53.372876 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2fc923-1f79-40b9-a620-4736eec48caf None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:53.381227 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ad7bb3-fd91-4673-97bb-96f56ce6f6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:53.381866 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad7bb3-fd91-4673-97bb-96f56ce6f6c9 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:53.382203 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad7bb3-fd91-4673-97bb-96f56ce6f6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:53.382478 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad7bb3-fd91-4673-97bb-96f56ce6f6c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:53.383217 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ad7bb3-fd91-4673-97bb-96f56ce6f6c9 None admin] RBAC: Adding query filter params (role.id=393e6032e5cc4678b8351026fe4434f8, scope.project.id=6f1d8fd250c84c5887cb3173053ea2dd, user.id=2053f823bd3c4098a43c299890c1f733) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:53.383955 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ad7bb3-fd91-4673-97bb-96f56ce6f6c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:53.385806 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ad7bb3-fd91-4673-97bb-96f56ce6f6c9 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:53.394542 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 350/681] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Sep 29 01:58:53 2022] GET /identity/v3/role_assignments?user.id=2053f823bd3c4098a43c299890c1f733&scope.project.id=6f1d8fd250c84c5887cb3173053ea2dd&role.id=393e6032e5cc4678b8351026fe4434f8 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:53.395362 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ad7bb3-fd91-4673-97bb-96f56ce6f6c9 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:53.423987 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:53.430326 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1602b373-2dc0-4e1b-9ba5-765577a1518e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:53.430953 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1602b373-2dc0-4e1b-9ba5-765577a1518e None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:53.431228 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1602b373-2dc0-4e1b-9ba5-765577a1518e None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:53.431495 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1602b373-2dc0-4e1b-9ba5-765577a1518e None admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:53.432198 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1602b373-2dc0-4e1b-9ba5-765577a1518e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:53.432500 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1602b373-2dc0-4e1b-9ba5-765577a1518e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:53.434778 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1602b373-2dc0-4e1b-9ba5-765577a1518e None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:53.461905 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 332/682] 10.222.0.49 () {56 vars in 1148 bytes} [Thu Sep 29 01:58:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:53.463941 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1602b373-2dc0-4e1b-9ba5-765577a1518e None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:53.576700 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ad7bb3-fd91-4673-97bb-96f56ce6f6c9 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:53.628622 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:53.649088 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3410c1b-422d-4269-95a3-60dc3b16d2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:53.649813 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3410c1b-422d-4269-95a3-60dc3b16d2ef None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:53.650000 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3410c1b-422d-4269-95a3-60dc3b16d2ef None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:53.650270 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3410c1b-422d-4269-95a3-60dc3b16d2ef None admin] PATH_INFO: `/v3/users` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:53.651002 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3410c1b-422d-4269-95a3-60dc3b16d2ef None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:53.651303 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3410c1b-422d-4269-95a3-60dc3b16d2ef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:53.653286 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3410c1b-422d-4269-95a3-60dc3b16d2ef None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:53.663621 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1602b373-2dc0-4e1b-9ba5-765577a1518e None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:53.678001 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 351/683] 10.222.0.49 () {56 vars in 1135 bytes} [Thu Sep 29 01:58:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:53.683864 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3410c1b-422d-4269-95a3-60dc3b16d2ef None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:53.717724 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7add11c-999b-4675-9529-cf10e8de52c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:53.719743 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7add11c-999b-4675-9529-cf10e8de52c9 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:53.720290 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7add11c-999b-4675-9529-cf10e8de52c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:53.720779 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7add11c-999b-4675-9529-cf10e8de52c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:53.721803 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7add11c-999b-4675-9529-cf10e8de52c9 None admin] RBAC: Adding query filter params (role.id=393e6032e5cc4678b8351026fe4434f8, scope.project.id=6f1d8fd250c84c5887cb3173053ea2dd, user.id=e75135b856134ba4b9ccac337886f682) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:53.722325 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7add11c-999b-4675-9529-cf10e8de52c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:53.724766 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7add11c-999b-4675-9529-cf10e8de52c9 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:53.733579 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 333/684] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Sep 29 01:58:53 2022] GET /identity/v3/role_assignments?user.id=e75135b856134ba4b9ccac337886f682&scope.project.id=6f1d8fd250c84c5887cb3173053ea2dd&role.id=393e6032e5cc4678b8351026fe4434f8 => generated 608 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:53.819879 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:53.857762 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3410c1b-422d-4269-95a3-60dc3b16d2ef None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:53.903056 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac0181f-7d25-4544-b5e2-e3eb098b99e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:53.903592 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac0181f-7d25-4544-b5e2-e3eb098b99e8 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:53.903868 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac0181f-7d25-4544-b5e2-e3eb098b99e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:53.904144 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac0181f-7d25-4544-b5e2-e3eb098b99e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:53.918210 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb7f419-bac9-428e-8227-1253a016988e None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:53.918826 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb7f419-bac9-428e-8227-1253a016988e None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:53.919438 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb7f419-bac9-428e-8227-1253a016988e None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:53.921339 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 334/685] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:58:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:58:53.927510 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba03010-8910-418b-898a-205fb23bc904 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:53.928078 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba03010-8910-418b-898a-205fb23bc904 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:53.928544 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba03010-8910-418b-898a-205fb23bc904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:53.965406 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-5ba03010-8910-418b-898a-205fb23bc904 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:53.967014 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-5ba03010-8910-418b-898a-205fb23bc904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:54.042271 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac0181f-7d25-4544-b5e2-e3eb098b99e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:54.042467 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac0181f-7d25-4544-b5e2-e3eb098b99e8 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:54.054802 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 335/686] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:58:54.128506 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:54.156838 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 352/687] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Sep 29 01:58:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 29 01:58:54.162445 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba03010-8910-418b-898a-205fb23bc904 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:54.267447 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:54.283184 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d865cce-35a3-4d92-b304-bbc5e152129c None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:54.283784 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d865cce-35a3-4d92-b304-bbc5e152129c None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:54.284269 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d865cce-35a3-4d92-b304-bbc5e152129c None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:54.286234 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 353/688] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:58:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:58:54.299694 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ba41c2-6945-4699-9596-3a967b4d4588 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:54.300250 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ba41c2-6945-4699-9596-3a967b4d4588 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:54.300734 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ba41c2-6945-4699-9596-3a967b4d4588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:54.301602 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba03010-8910-418b-898a-205fb23bc904 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:54.336787 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-b4ba41c2-6945-4699-9596-3a967b4d4588 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:54.338025 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-b4ba41c2-6945-4699-9596-3a967b4d4588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:54.360866 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1364230-adb4-442e-90aa-8854082c9cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:54.361531 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1364230-adb4-442e-90aa-8854082c9cfd None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:54.361806 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1364230-adb4-442e-90aa-8854082c9cfd None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:54.362072 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1364230-adb4-442e-90aa-8854082c9cfd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:54.380467 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1364230-adb4-442e-90aa-8854082c9cfd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:54.381953 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1364230-adb4-442e-90aa-8854082c9cfd None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:54.408093 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-a1364230-adb4-442e-90aa-8854082c9cfd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:54.408093 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:54.408093 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:54.408093 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:54.408093 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:54.408093 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:54.408093 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:54.408093 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:54.408093 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:54.408093 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:54.408093 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:54.408093 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:54.408093 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:58:54.408093 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:58:54.408093 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:58:54.408093 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:58:54.409063 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:54.409063 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:54.409063 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:54.409063 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:54.409063 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:54.409063 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:54.409063 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:54.409063 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:54.409063 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:54.409063 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:54.409063 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:54.409063 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:54.409063 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:54.409063 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:54.409063 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:54.409063 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:54.409063 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:58:54.410020 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:58:54.410020 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:54.410020 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:58:54.410020 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 336/689] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 01:58:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:54.415537 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1364230-adb4-442e-90aa-8854082c9cfd None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:54.472481 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 354/690] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:58:54.473488 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ba41c2-6945-4699-9596-3a967b4d4588 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:54.580675 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1364230-adb4-442e-90aa-8854082c9cfd None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:54.630325 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:54.655324 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec265d35-61eb-4d3d-aa2d-ddf01ae03d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:54.655934 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec265d35-61eb-4d3d-aa2d-ddf01ae03d0d None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:54.656043 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ba41c2-6945-4699-9596-3a967b4d4588 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:54.657003 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec265d35-61eb-4d3d-aa2d-ddf01ae03d0d None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:54.657270 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec265d35-61eb-4d3d-aa2d-ddf01ae03d0d None admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:54.657965 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec265d35-61eb-4d3d-aa2d-ddf01ae03d0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:54.658320 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec265d35-61eb-4d3d-aa2d-ddf01ae03d0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:54.659634 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec265d35-61eb-4d3d-aa2d-ddf01ae03d0d None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:54.665979 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:54.678988 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 337/691] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Sep 29 01:58:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:54.684362 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec265d35-61eb-4d3d-aa2d-ddf01ae03d0d None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:54.720669 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e0939c-b20d-458e-89d6-5f4325427542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:54.721764 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e0939c-b20d-458e-89d6-5f4325427542 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:54.722241 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e0939c-b20d-458e-89d6-5f4325427542 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:54.722727 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e0939c-b20d-458e-89d6-5f4325427542 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:54.743372 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e0939c-b20d-458e-89d6-5f4325427542 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:54.745285 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e0939c-b20d-458e-89d6-5f4325427542 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:54.761830 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-20e0939c-b20d-458e-89d6-5f4325427542 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:54.761830 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:54.761830 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:54.761830 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:54.761830 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:54.761830 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:54.761830 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:54.761830 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:54.761830 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:54.761830 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:54.761830 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:54.761830 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:54.761830 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:58:54.761830 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:58:54.761830 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:58:54.761830 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:58:54.762830 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:54.762830 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:54.762830 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:54.762830 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:54.762830 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:54.762830 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:54.762830 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:54.762830 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:54.762830 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:54.762830 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:54.762830 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:54.762830 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:54.762830 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:54.762830 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:54.762830 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:54.762830 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:54.762830 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:58:54.763693 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:58:54.763693 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:54.763693 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:58:54.766491 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 355/692] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 01:58:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:54.773369 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e0939c-b20d-458e-89d6-5f4325427542 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:54.809360 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec265d35-61eb-4d3d-aa2d-ddf01ae03d0d None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:54.850585 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f261cc7-83a1-4b51-a6e4-67f3c5d8c575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:54.851220 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f261cc7-83a1-4b51-a6e4-67f3c5d8c575 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:54.851502 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f261cc7-83a1-4b51-a6e4-67f3c5d8c575 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:54.852137 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f261cc7-83a1-4b51-a6e4-67f3c5d8c575 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:54.860039 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f261cc7-83a1-4b51-a6e4-67f3c5d8c575 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:54.862661 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f261cc7-83a1-4b51-a6e4-67f3c5d8c575 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:54.875229 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-5f261cc7-83a1-4b51-a6e4-67f3c5d8c575 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:58:54.875229 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:54.875229 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:54.875229 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:54.875229 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:54.875229 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:54.875229 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:54.875229 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:54.875229 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:54.875229 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:54.875229 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:54.875229 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:54.875229 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 29 01:58:54.875229 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 29 01:58:54.875229 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 29 01:58:54.876204 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 29 01:58:54.876204 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:54.876204 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:54.876204 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:54.876204 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:54.876204 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:54.876204 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:54.876204 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:54.876204 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:54.876204 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:54.876204 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:54.876204 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:54.876204 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:54.876204 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:54.876204 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:54.876204 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:54.876204 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:54.877086 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 29 01:58:54.877086 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 29 01:58:54.877086 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 29 01:58:54.877086 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 29 01:58:54.877086 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 29 01:58:54.877086 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 29 01:58:54.877086 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:58:54.877086 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:58:54.878670 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 338/693] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Sep 29 01:58:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:54.884305 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f261cc7-83a1-4b51-a6e4-67f3c5d8c575 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:54.928065 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e0939c-b20d-458e-89d6-5f4325427542 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:54.939939 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:54.970571 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0dcf4a-2842-4922-9a34-ba74c95faa4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:54.971570 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0dcf4a-2842-4922-9a34-ba74c95faa4a None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:54.972075 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0dcf4a-2842-4922-9a34-ba74c95faa4a None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:54.972542 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0dcf4a-2842-4922-9a34-ba74c95faa4a None admin] PATH_INFO: `/v3/domains` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:54.973422 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0dcf4a-2842-4922-9a34-ba74c95faa4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:54.974030 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0dcf4a-2842-4922-9a34-ba74c95faa4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:54.975594 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0dcf4a-2842-4922-9a34-ba74c95faa4a None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:54.994214 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 356/694] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Sep 29 01:58:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:54.995335 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0dcf4a-2842-4922-9a34-ba74c95faa4a None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:55.007405 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f261cc7-83a1-4b51-a6e4-67f3c5d8c575 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:55.014576 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:55.063748 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e54d9b-bbf3-4ffc-a431-10ec88e349d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:55.064915 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e54d9b-bbf3-4ffc-a431-10ec88e349d1 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:55.065426 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e54d9b-bbf3-4ffc-a431-10ec88e349d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:55.065911 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e54d9b-bbf3-4ffc-a431-10ec88e349d1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:55.084730 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e54d9b-bbf3-4ffc-a431-10ec88e349d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:58:55.097544 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-12e54d9b-bbf3-4ffc-a431-10ec88e349d1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 01:58:55.097544 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:55.097544 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:55.097544 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:55.097544 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:55.097544 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:55.097544 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:55.097544 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:55.097544 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:55.097544 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:55.097544 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:55.097544 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:55.097544 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:58:55.097544 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:58:55.097544 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:58:55.097544 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:58:55.098471 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:58:55.098471 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:58:55.098471 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:58:55.098471 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:58:55.098471 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:55.098471 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:55.098471 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:55.098471 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:55.098471 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:55.098471 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:55.098471 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:55.098471 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:55.098471 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:55.098471 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:55.098471 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:55.098471 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:55.099281 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:55.099281 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:55.099281 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:55.099281 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:55.099281 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:58:55.099281 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:58:55.099281 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:58:55.099281 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:58:55.099281 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:58:55.099281 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:58:55.099281 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 01:58:55.099281 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:58:55.105754 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 339/695] 10.222.0.49 () {56 vars in 1096 bytes} [Thu Sep 29 01:58:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:55.107230 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e54d9b-bbf3-4ffc-a431-10ec88e349d1 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:55.131356 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0dcf4a-2842-4922-9a34-ba74c95faa4a None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:55.167565 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcae0dd-4c0e-4119-9cc6-e5b98cb9dfb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:55.168109 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcae0dd-4c0e-4119-9cc6-e5b98cb9dfb9 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:55.168386 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcae0dd-4c0e-4119-9cc6-e5b98cb9dfb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:55.168656 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcae0dd-4c0e-4119-9cc6-e5b98cb9dfb9 None admin] PATH_INFO: `/v3/projects` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:55.169363 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcae0dd-4c0e-4119-9cc6-e5b98cb9dfb9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:55.169724 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcae0dd-4c0e-4119-9cc6-e5b98cb9dfb9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:55.171354 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcae0dd-4c0e-4119-9cc6-e5b98cb9dfb9 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:55.184411 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 357/696] 10.222.0.49 () {56 vars in 1148 bytes} [Thu Sep 29 01:58:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:55.185227 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcae0dd-4c0e-4119-9cc6-e5b98cb9dfb9 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:55.230037 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e54d9b-bbf3-4ffc-a431-10ec88e349d1 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:55.238039 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:55.268623 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eecc3c-17da-40a1-bdbe-bb8ca162554c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:55.269237 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eecc3c-17da-40a1-bdbe-bb8ca162554c None admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:55.269558 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eecc3c-17da-40a1-bdbe-bb8ca162554c None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:55.269829 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eecc3c-17da-40a1-bdbe-bb8ca162554c None admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:55.270504 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eecc3c-17da-40a1-bdbe-bb8ca162554c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:55.271903 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eecc3c-17da-40a1-bdbe-bb8ca162554c None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:55.274613 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:55.300060 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcae0dd-4c0e-4119-9cc6-e5b98cb9dfb9 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:55.301757 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 340/697] 10.222.0.49 () {60 vars in 1132 bytes} [Thu Sep 29 01:58:55 2022] POST /identity/v3/users => generated 254 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 01:58:55.302827 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eecc3c-17da-40a1-bdbe-bb8ca162554c None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:55.340018 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60eb7cc-097a-4e3e-bdb3-b7ad50bcbfc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:55.340923 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60eb7cc-097a-4e3e-bdb3-b7ad50bcbfc1 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:55.341486 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60eb7cc-097a-4e3e-bdb3-b7ad50bcbfc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:55.341927 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60eb7cc-097a-4e3e-bdb3-b7ad50bcbfc1 None admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:55.342806 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60eb7cc-097a-4e3e-bdb3-b7ad50bcbfc1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:55.343271 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60eb7cc-097a-4e3e-bdb3-b7ad50bcbfc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:55.345736 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60eb7cc-097a-4e3e-bdb3-b7ad50bcbfc1 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:55.355816 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 358/698] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Sep 29 01:58:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:55.362279 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60eb7cc-097a-4e3e-bdb3-b7ad50bcbfc1 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:55.471580 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eecc3c-17da-40a1-bdbe-bb8ca162554c None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:55.476335 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60eb7cc-097a-4e3e-bdb3-b7ad50bcbfc1 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:55.510022 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6064d6-12e0-4225-a8d6-a9acf289aecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:55.510628 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6064d6-12e0-4225-a8d6-a9acf289aecf None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:55.510909 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6064d6-12e0-4225-a8d6-a9acf289aecf None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:55.511179 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6064d6-12e0-4225-a8d6-a9acf289aecf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:55.511919 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6064d6-12e0-4225-a8d6-a9acf289aecf None admin] RBAC: Adding query filter params (role.id=393e6032e5cc4678b8351026fe4434f8, scope.project.id=6f1d8fd250c84c5887cb3173053ea2dd, user.id=c88bc0f32600416ca7c6a59f4196e497) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:55.512223 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6064d6-12e0-4225-a8d6-a9acf289aecf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:55.513682 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6064d6-12e0-4225-a8d6-a9acf289aecf None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:55.516269 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c306c8a-aa44-4421-94e3-4fc3a36c1d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:55.517154 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c306c8a-aa44-4421-94e3-4fc3a36c1d70 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:55.517755 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c306c8a-aa44-4421-94e3-4fc3a36c1d70 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:55.518221 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c306c8a-aa44-4421-94e3-4fc3a36c1d70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:55.521523 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 341/699] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Sep 29 01:58:55 2022] GET /identity/v3/role_assignments?user.id=c88bc0f32600416ca7c6a59f4196e497&scope.project.id=6f1d8fd250c84c5887cb3173053ea2dd&role.id=393e6032e5cc4678b8351026fe4434f8 => generated 608 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:55.529243 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:55.532448 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c306c8a-aa44-4421-94e3-4fc3a36c1d70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:55.534292 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c306c8a-aa44-4421-94e3-4fc3a36c1d70 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:55.552016 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-2c306c8a-aa44-4421-94e3-4fc3a36c1d70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:55.552016 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:55.552016 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:55.552016 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:55.552016 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:55.552016 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:55.552016 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:55.552016 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:55.552016 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:55.552016 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:55.552016 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:55.552016 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:55.552016 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:58:55.552016 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:58:55.552016 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:58:55.552016 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:58:55.553052 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:55.553052 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:55.553052 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:55.553052 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:55.553052 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:55.553052 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:55.553052 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:55.553052 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:55.553052 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:55.553052 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:55.553052 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:55.553052 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:55.553052 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:55.553052 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:55.553052 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:55.553052 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:55.553052 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:58:55.554021 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:58:55.554021 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:55.554021 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:58:55.558480 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 359/700] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 01:58:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 01:58:55.560478 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6064d6-12e0-4225-a8d6-a9acf289aecf None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:55.605677 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:55.696364 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6064d6-12e0-4225-a8d6-a9acf289aecf None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:55.735519 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6953385-879d-4779-8d9f-548d555da616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:55.736111 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6953385-879d-4779-8d9f-548d555da616 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:55.736392 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6953385-879d-4779-8d9f-548d555da616 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:55.736657 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6953385-879d-4779-8d9f-548d555da616 None admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:55.737303 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6953385-879d-4779-8d9f-548d555da616 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:55.737620 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6953385-879d-4779-8d9f-548d555da616 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:55.738988 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6953385-879d-4779-8d9f-548d555da616 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:55.754252 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 342/701] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Sep 29 01:58:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:55.759528 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c306c8a-aa44-4421-94e3-4fc3a36c1d70 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:55.886790 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c306c8a-aa44-4421-94e3-4fc3a36c1d70 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:55.898947 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f7a29a-b329-4508-81bc-0d629ce8bf19 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:55.899229 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f7a29a-b329-4508-81bc-0d629ce8bf19 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:55.899503 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f7a29a-b329-4508-81bc-0d629ce8bf19 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:55.900977 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 343/702] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:58:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 29 01:58:55.908007 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4d859c-72be-4ac4-9535-e7d812da705f None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:55.908277 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4d859c-72be-4ac4-9535-e7d812da705f None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:55.908547 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4d859c-72be-4ac4-9535-e7d812da705f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:55.933079 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-2e4d859c-72be-4ac4-9535-e7d812da705f None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:55.934336 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-2e4d859c-72be-4ac4-9535-e7d812da705f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:55.937177 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a877ea-faa8-4d4f-b185-7d9dd09ad61c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:55.939549 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a877ea-faa8-4d4f-b185-7d9dd09ad61c None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:55.939841 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a877ea-faa8-4d4f-b185-7d9dd09ad61c None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:55.940117 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a877ea-faa8-4d4f-b185-7d9dd09ad61c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:55.951205 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a877ea-faa8-4d4f-b185-7d9dd09ad61c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:55.953289 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a877ea-faa8-4d4f-b185-7d9dd09ad61c None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:55.969198 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-37a877ea-faa8-4d4f-b185-7d9dd09ad61c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 29 01:58:55.969198 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:55.969198 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:55.969198 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:55.969198 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:55.969198 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:55.969198 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:55.969198 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:55.969198 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:55.969198 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:55.969198 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:55.969198 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:55.969198 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 29 01:58:55.969198 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 29 01:58:55.969198 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 29 01:58:55.969198 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 29 01:58:55.970286 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:55.970286 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:55.970286 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 29 01:58:55.970286 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:58:55.970286 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 29 01:58:55.970286 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:58:55.970286 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:55.970286 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:55.970286 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:55.970286 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:55.970286 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:55.970286 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:55.970286 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:55.970286 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:55.970286 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:55.970286 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:55.970286 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:55.970286 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:55.971222 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:55.971222 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:55.971222 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 29 01:58:55.971222 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 29 01:58:55.971222 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 29 01:58:55.971222 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 29 01:58:55.971222 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 29 01:58:55.971222 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 29 01:58:55.971222 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 29 01:58:55.971222 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:58:55.971222 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 360/703] 10.222.0.49 () {56 vars in 1093 bytes} [Thu Sep 29 01:58:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:55.976773 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a877ea-faa8-4d4f-b185-7d9dd09ad61c None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:56.042768 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:56.042938 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 344/704] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:58:56.096584 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a877ea-faa8-4d4f-b185-7d9dd09ad61c None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:56.140162 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae92ebe4-f6dd-4328-aa6b-46eda86241a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:56.141480 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae92ebe4-f6dd-4328-aa6b-46eda86241a0 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:56.141764 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae92ebe4-f6dd-4328-aa6b-46eda86241a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:56.142048 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae92ebe4-f6dd-4328-aa6b-46eda86241a0 None admin] PATH_INFO: `/v3/users` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:56.142848 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae92ebe4-f6dd-4328-aa6b-46eda86241a0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:56.143154 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae92ebe4-f6dd-4328-aa6b-46eda86241a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:56.144689 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae92ebe4-f6dd-4328-aa6b-46eda86241a0 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:56.168989 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 361/705] 10.222.0.49 () {56 vars in 1133 bytes} [Thu Sep 29 01:58:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:58:56.174904 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4d859c-72be-4ac4-9535-e7d812da705f None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:56.207224 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:56.307927 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4d859c-72be-4ac4-9535-e7d812da705f None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:56.345798 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14762ad2-7014-4dc7-bd4b-4b44d3b1dd51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:56.346434 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14762ad2-7014-4dc7-bd4b-4b44d3b1dd51 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:56.346718 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14762ad2-7014-4dc7-bd4b-4b44d3b1dd51 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:56.346992 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14762ad2-7014-4dc7-bd4b-4b44d3b1dd51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:56.399234 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae92ebe4-f6dd-4328-aa6b-46eda86241a0 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:56.427663 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14762ad2-7014-4dc7-bd4b-4b44d3b1dd51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:56.429111 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14762ad2-7014-4dc7-bd4b-4b44d3b1dd51 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:56.447379 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:56.538775 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 345/706] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Sep 29 01:58:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 29 01:58:56.545536 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14762ad2-7014-4dc7-bd4b-4b44d3b1dd51 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:56.565546 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae92ebe4-f6dd-4328-aa6b-46eda86241a0 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:56.581440 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:56.618430 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23e3abd-07c4-4501-9061-6b3daf071b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:56.619070 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23e3abd-07c4-4501-9061-6b3daf071b65 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:56.619350 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23e3abd-07c4-4501-9061-6b3daf071b65 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:56.619618 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23e3abd-07c4-4501-9061-6b3daf071b65 None admin] PATH_INFO: `/v3/services/network` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:56.620192 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23e3abd-07c4-4501-9061-6b3daf071b65 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:56.621584 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23e3abd-07c4-4501-9061-6b3daf071b65 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:56.633350 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-a23e3abd-07c4-4501-9061-6b3daf071b65 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 29 01:58:56.633350 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:56.633350 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 29 01:58:56.633350 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 29 01:58:56.633350 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 29 01:58:56.633350 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 29 01:58:56.633350 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 29 01:58:56.633350 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 29 01:58:56.633350 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 29 01:58:56.633350 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:58:56.633350 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 29 01:58:56.633350 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:58:56.633350 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:56.633350 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:56.633350 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:56.633350 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:56.633350 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:56.634469 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:56.634469 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:56.634469 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:56.634469 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:56.634469 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:56.634469 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:56.634469 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 29 01:58:56.634469 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 29 01:58:56.634469 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 29 01:58:56.634469 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 29 01:58:56.634469 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:56.634469 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:56.634469 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:56.634469 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:56.634469 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:56.634469 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:56.635765 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:56.635765 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:56.635765 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:56.635765 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:56.635765 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:56.635765 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:56.635765 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:56.635765 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:56.635765 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:56.635765 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:56.635765 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 29 01:58:56.635765 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 29 01:58:56.635765 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 29 01:58:56.635765 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:58:56.635765 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 362/707] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Sep 29 01:58:56 2022] GET /identity/v3/services/network => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:56.636584 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa31a7c6-3cfc-409f-8508-22f33e727ff8 None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:56.636584 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa31a7c6-3cfc-409f-8508-22f33e727ff8 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:56.636584 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa31a7c6-3cfc-409f-8508-22f33e727ff8 None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:56.642994 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 363/708] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:58:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:58:56.643851 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa31a7c6-3cfc-409f-8508-22f33e727ff8 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:56.685456 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14762ad2-7014-4dc7-bd4b-4b44d3b1dd51 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:56.708896 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:56.732343 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d67e297-cd0b-45d2-9b40-9afc6684b2ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:56.733795 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d67e297-cd0b-45d2-9b40-9afc6684b2ce None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:56.734390 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d67e297-cd0b-45d2-9b40-9afc6684b2ce None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:56.734953 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d67e297-cd0b-45d2-9b40-9afc6684b2ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:56.747578 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d67e297-cd0b-45d2-9b40-9afc6684b2ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:56.750633 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d67e297-cd0b-45d2-9b40-9afc6684b2ce None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:56.763178 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa31a7c6-3cfc-409f-8508-22f33e727ff8 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:56.769560 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-4d67e297-cd0b-45d2-9b40-9afc6684b2ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:56.769560 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:56.769560 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:56.769560 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:56.769560 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:56.769560 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:56.769560 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:56.769560 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:56.769560 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:56.769560 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:56.769560 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:56.769560 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:56.769560 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:58:56.769560 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:58:56.769560 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:58:56.769560 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:58:56.770488 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:56.770488 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:56.770488 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:56.770488 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:56.770488 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:56.770488 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:56.770488 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:56.770488 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:56.770488 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:56.770488 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:56.770488 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:56.770488 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:56.770488 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:56.770488 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:56.770488 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:56.770488 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:56.770488 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:58:56.771365 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:58:56.771365 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:56.771365 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:58:56.773509 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 346/709] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 01:58:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 01:58:56.774942 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542bb5a1-ed8b-432a-9ae3-5b1617df20e5 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:56.775356 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542bb5a1-ed8b-432a-9ae3-5b1617df20e5 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:56.775756 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542bb5a1-ed8b-432a-9ae3-5b1617df20e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:56.797013 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-542bb5a1-ed8b-432a-9ae3-5b1617df20e5 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:56.798497 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-542bb5a1-ed8b-432a-9ae3-5b1617df20e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:56.809001 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f3abd9-bba3-4f10-99f5-06947d8f3dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:56.809860 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f3abd9-bba3-4f10-99f5-06947d8f3dff None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:56.810705 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f3abd9-bba3-4f10-99f5-06947d8f3dff None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:56.811091 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f3abd9-bba3-4f10-99f5-06947d8f3dff None admin] PATH_INFO: `/v3/services` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:56.811860 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f3abd9-bba3-4f10-99f5-06947d8f3dff None admin] RBAC: Adding query filter params (name=network) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:56.812265 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f3abd9-bba3-4f10-99f5-06947d8f3dff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:56.815530 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f3abd9-bba3-4f10-99f5-06947d8f3dff None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:56.825474 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 364/710] 10.222.0.49 () {56 vars in 1112 bytes} [Thu Sep 29 01:58:56 2022] GET /identity/v3/services?name=network => generated 124 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:56.826786 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f3abd9-bba3-4f10-99f5-06947d8f3dff None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:56.882259 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:56.887688 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 347/711] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:58:56.889052 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542bb5a1-ed8b-432a-9ae3-5b1617df20e5 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:56.957431 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f3abd9-bba3-4f10-99f5-06947d8f3dff None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:56.992879 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771ecfc0-8bcc-4b46-a96a-cc941cff2057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:56.993812 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ecfc0-8bcc-4b46-a96a-cc941cff2057 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:56.994244 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ecfc0-8bcc-4b46-a96a-cc941cff2057 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:56.994993 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ecfc0-8bcc-4b46-a96a-cc941cff2057 None admin] PATH_INFO: `/v3/domains` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:56.996487 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771ecfc0-8bcc-4b46-a96a-cc941cff2057 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:56.997366 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771ecfc0-8bcc-4b46-a96a-cc941cff2057 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:57.000304 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771ecfc0-8bcc-4b46-a96a-cc941cff2057 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:57.003734 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:57.009332 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542bb5a1-ed8b-432a-9ae3-5b1617df20e5 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:57.016874 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 365/712] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Sep 29 01:58:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:57.028157 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771ecfc0-8bcc-4b46-a96a-cc941cff2057 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:57.063060 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c19281-30f4-4d1d-85a1-46fb93ba628e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:57.063849 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c19281-30f4-4d1d-85a1-46fb93ba628e None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:57.065200 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c19281-30f4-4d1d-85a1-46fb93ba628e None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:57.065496 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c19281-30f4-4d1d-85a1-46fb93ba628e None admin] PATH_INFO: `/v3/services` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:57.066124 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c19281-30f4-4d1d-85a1-46fb93ba628e None admin] RBAC: Adding query filter params (type=network) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:57.066421 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c19281-30f4-4d1d-85a1-46fb93ba628e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:57.070319 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c19281-30f4-4d1d-85a1-46fb93ba628e None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:57.082605 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 348/713] 10.222.0.49 () {56 vars in 1112 bytes} [Thu Sep 29 01:58:56 2022] GET /identity/v3/services?type=network => generated 124 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:57.195729 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:57.200384 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771ecfc0-8bcc-4b46-a96a-cc941cff2057 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:57.251995 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bdf050-ed92-4cfc-9e42-1f32dc614363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:57.252656 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bdf050-ed92-4cfc-9e42-1f32dc614363 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:57.252938 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bdf050-ed92-4cfc-9e42-1f32dc614363 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:57.253210 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bdf050-ed92-4cfc-9e42-1f32dc614363 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:57.263110 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bdf050-ed92-4cfc-9e42-1f32dc614363 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:57.264591 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bdf050-ed92-4cfc-9e42-1f32dc614363 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:57.270423 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c19281-30f4-4d1d-85a1-46fb93ba628e None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:57.286369 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-71bdf050-ed92-4cfc-9e42-1f32dc614363 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:58:57.286369 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:57.286369 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:57.286369 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:57.286369 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:57.286369 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:57.286369 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:57.286369 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:57.286369 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:57.286369 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:57.286369 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:57.286369 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:57.286369 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 29 01:58:57.286369 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 29 01:58:57.286369 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 29 01:58:57.287402 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 29 01:58:57.287402 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:57.287402 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:57.287402 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:57.287402 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:57.287402 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:57.287402 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:57.287402 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:57.287402 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:57.287402 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:57.287402 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:57.287402 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:57.287402 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:57.287402 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:57.287402 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:57.287402 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:57.287402 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:57.288271 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 29 01:58:57.288271 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 29 01:58:57.288271 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 29 01:58:57.288271 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 29 01:58:57.288271 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 29 01:58:57.288271 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 29 01:58:57.288271 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:58:57.288271 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:58:57.290843 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 366/714] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Sep 29 01:58:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:57.303528 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bdf050-ed92-4cfc-9e42-1f32dc614363 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:57.422177 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c19281-30f4-4d1d-85a1-46fb93ba628e None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:57.434769 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bdf050-ed92-4cfc-9e42-1f32dc614363 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:57.461911 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0984489f-3375-4e4a-9971-af30644ef376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:57.462868 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0984489f-3375-4e4a-9971-af30644ef376 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:57.463351 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0984489f-3375-4e4a-9971-af30644ef376 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:57.463862 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0984489f-3375-4e4a-9971-af30644ef376 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:57.464639 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0984489f-3375-4e4a-9971-af30644ef376 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:57.466703 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0984489f-3375-4e4a-9971-af30644ef376 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:57.471608 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf582f5-d0d3-461e-b3ed-d2edd7696b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:57.472432 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf582f5-d0d3-461e-b3ed-d2edd7696b49 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:57.472545 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf582f5-d0d3-461e-b3ed-d2edd7696b49 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:57.472911 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf582f5-d0d3-461e-b3ed-d2edd7696b49 None admin] PATH_INFO: `/v3/projects` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:57.473716 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf582f5-d0d3-461e-b3ed-d2edd7696b49 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:57.474053 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf582f5-d0d3-461e-b3ed-d2edd7696b49 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:57.475654 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf582f5-d0d3-461e-b3ed-d2edd7696b49 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:57.481865 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-0984489f-3375-4e4a-9971-af30644ef376 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 29 01:58:57.481865 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:57.481865 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 29 01:58:57.481865 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 29 01:58:57.481865 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 29 01:58:57.481865 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 29 01:58:57.481865 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 29 01:58:57.481865 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 29 01:58:57.481865 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 29 01:58:57.481865 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:58:57.481865 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 29 01:58:57.481865 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:58:57.481865 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:57.481865 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:57.481865 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:57.481865 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:57.481865 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:57.482849 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:57.482849 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:57.482849 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:57.482849 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:57.482849 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:57.482849 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:57.482849 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 29 01:58:57.482849 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 29 01:58:57.482849 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 29 01:58:57.482849 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 29 01:58:57.482849 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:57.482849 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:57.482849 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:57.482849 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:57.482849 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:57.482849 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:57.483707 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:57.483707 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:57.483707 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:57.483707 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:57.483707 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:57.483707 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:57.483707 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:57.483707 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:57.483707 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:57.483707 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:57.483707 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 29 01:58:57.483707 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 29 01:58:57.483707 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 29 01:58:57.483707 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:58:57.490639 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 367/716] 10.222.0.49 () {56 vars in 1148 bytes} [Thu Sep 29 01:58:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:58:57.490856 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 349/716] 10.222.0.49 () {56 vars in 1129 bytes} [Thu Sep 29 01:58:57 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 01:58:57.494253 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf582f5-d0d3-461e-b3ed-d2edd7696b49 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:57.497538 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0984489f-3375-4e4a-9971-af30644ef376 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:57.524913 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:57.550405 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:57.619800 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf582f5-d0d3-461e-b3ed-d2edd7696b49 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:57.664624 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af19a32e-a3ba-49d3-87d9-1448465868d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:57.665249 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af19a32e-a3ba-49d3-87d9-1448465868d2 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:57.665560 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af19a32e-a3ba-49d3-87d9-1448465868d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:57.665836 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af19a32e-a3ba-49d3-87d9-1448465868d2 None admin] PATH_INFO: `/v3/services` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:57.666469 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af19a32e-a3ba-49d3-87d9-1448465868d2 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:57.667025 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af19a32e-a3ba-49d3-87d9-1448465868d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:57.668418 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af19a32e-a3ba-49d3-87d9-1448465868d2 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:57.679897 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0984489f-3375-4e4a-9971-af30644ef376 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:57.689428 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 368/717] 10.222.0.49 () {56 vars in 1124 bytes} [Thu Sep 29 01:58:57 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:57.694926 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af19a32e-a3ba-49d3-87d9-1448465868d2 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:57.750755 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3021974-e7a3-441a-9044-419c5236404d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:57.751422 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3021974-e7a3-441a-9044-419c5236404d None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:57.751629 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3021974-e7a3-441a-9044-419c5236404d None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:57.751905 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3021974-e7a3-441a-9044-419c5236404d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:57.752636 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3021974-e7a3-441a-9044-419c5236404d None admin] RBAC: Adding query filter params (role.id=fe9bbc67742f4f5893f39b18eb31d59a, scope.project.id=6f1d8fd250c84c5887cb3173053ea2dd, user.id=f3325a7111d447f4a9cf00c672d5420f) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:57.752943 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3021974-e7a3-441a-9044-419c5236404d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:57.754406 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3021974-e7a3-441a-9044-419c5236404d None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:57.771237 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 350/718] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Sep 29 01:58:57 2022] GET /identity/v3/role_assignments?user.id=f3325a7111d447f4a9cf00c672d5420f&scope.project.id=6f1d8fd250c84c5887cb3173053ea2dd&role.id=fe9bbc67742f4f5893f39b18eb31d59a => generated 259 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:58:57.856495 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:57.883183 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af19a32e-a3ba-49d3-87d9-1448465868d2 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:57.926208 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3354887e-1667-4806-8909-88da545596b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:57.926831 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3354887e-1667-4806-8909-88da545596b0 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:57.927122 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3354887e-1667-4806-8909-88da545596b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:57.927540 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3354887e-1667-4806-8909-88da545596b0 None admin] PATH_INFO: `/v3/services` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:57.928243 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3354887e-1667-4806-8909-88da545596b0 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:57.928549 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3354887e-1667-4806-8909-88da545596b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:57.930050 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3354887e-1667-4806-8909-88da545596b0 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:57.936592 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 369/719] 10.222.0.49 () {56 vars in 1124 bytes} [Thu Sep 29 01:58:57 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:58:58.279788 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8adfb7e-efd2-4c76-8300-b79c5188705f None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:58.280476 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8adfb7e-efd2-4c76-8300-b79c5188705f None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:58.280961 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8adfb7e-efd2-4c76-8300-b79c5188705f None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:58.283714 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 351/720] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:58:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:58:58.289007 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec07df65-ad2a-436d-8f15-ec77f0d42742 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:58.289632 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec07df65-ad2a-436d-8f15-ec77f0d42742 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:58.290160 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec07df65-ad2a-436d-8f15-ec77f0d42742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:58.309882 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f6d1d5-eba6-40a0-ba99-f741850c0665 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:58.310193 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f6d1d5-eba6-40a0-ba99-f741850c0665 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:58.310439 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f6d1d5-eba6-40a0-ba99-f741850c0665 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:58.312303 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 352/721] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:58:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:58:58.316362 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-ec07df65-ad2a-436d-8f15-ec77f0d42742 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:58.317781 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad9292a-4ce2-4932-865a-810ff41b9a5f None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:58.318063 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad9292a-4ce2-4932-865a-810ff41b9a5f None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:58.318298 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-ec07df65-ad2a-436d-8f15-ec77f0d42742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:58.318404 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad9292a-4ce2-4932-865a-810ff41b9a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:58.346824 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-fad9292a-4ce2-4932-865a-810ff41b9a5f None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:58:58.348042 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-fad9292a-4ce2-4932-865a-810ff41b9a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:58:58.433468 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 353/722] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 29 01:58:58.474947 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 370/723] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:58:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:58:58.781065 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad9292a-4ce2-4932-865a-810ff41b9a5f None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:58.803798 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:58.884764 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad9292a-4ce2-4932-865a-810ff41b9a5f None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:58.910788 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec07df65-ad2a-436d-8f15-ec77f0d42742 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:58.920401 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8407f3f0-a7ef-49da-bd5f-51758d4fd355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:58.921044 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8407f3f0-a7ef-49da-bd5f-51758d4fd355 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:58.921335 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8407f3f0-a7ef-49da-bd5f-51758d4fd355 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:58.921648 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8407f3f0-a7ef-49da-bd5f-51758d4fd355 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:58.933175 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8407f3f0-a7ef-49da-bd5f-51758d4fd355 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:58:58.939210 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-8407f3f0-a7ef-49da-bd5f-51758d4fd355 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 01:58:58.939210 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:58.939210 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:58.939210 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:58.939210 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:58.939210 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:58.939210 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:58.939210 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:58.939210 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:58.939210 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:58.939210 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:58.939210 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:58.939210 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:58:58.939210 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:58:58.939210 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:58:58.939210 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:58:58.940179 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:58:58.940179 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:58:58.940179 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:58:58.940179 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:58:58.940179 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:58.940179 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:58.940179 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:58.940179 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:58.940179 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:58.940179 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:58.940179 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:58.940179 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:58.940179 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:58.940179 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:58.940179 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:58.940179 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:58.941016 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:58.941016 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:58.941016 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:58.941016 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:58.941016 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:58:58.941016 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:58:58.941016 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:58:58.941016 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:58:58.941016 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:58:58.941016 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:58:58.941016 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 01:58:58.941016 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:58:58.945803 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 354/724] 10.222.0.49 () {56 vars in 1096 bytes} [Thu Sep 29 01:58:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:58.947157 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8407f3f0-a7ef-49da-bd5f-51758d4fd355 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:59.069665 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:59.102398 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8407f3f0-a7ef-49da-bd5f-51758d4fd355 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:59.117649 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:59.159008 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec07df65-ad2a-436d-8f15-ec77f0d42742 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:59.175062 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f17a7a-89b5-4513-ae2f-6ca54f01193d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:59.175689 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f17a7a-89b5-4513-ae2f-6ca54f01193d None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:59.175970 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f17a7a-89b5-4513-ae2f-6ca54f01193d None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:59.176242 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f17a7a-89b5-4513-ae2f-6ca54f01193d None admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:59.176915 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f17a7a-89b5-4513-ae2f-6ca54f01193d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:59.177217 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f17a7a-89b5-4513-ae2f-6ca54f01193d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:59.178637 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f17a7a-89b5-4513-ae2f-6ca54f01193d None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:59.192842 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 355/725] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Sep 29 01:58:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:58:59.194127 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f17a7a-89b5-4513-ae2f-6ca54f01193d None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:59.241249 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325d7f79-feed-46ed-83fc-70f480bfd9fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:59.242382 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d7f79-feed-46ed-83fc-70f480bfd9fb None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:59.242868 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d7f79-feed-46ed-83fc-70f480bfd9fb None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:59.243341 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d7f79-feed-46ed-83fc-70f480bfd9fb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:59.274383 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325d7f79-feed-46ed-83fc-70f480bfd9fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:58:59.279974 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-325d7f79-feed-46ed-83fc-70f480bfd9fb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 29 01:58:59.279974 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:59.279974 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:59.279974 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:59.279974 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:59.279974 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:59.279974 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:59.279974 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:59.279974 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:59.279974 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:59.279974 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:59.279974 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:59.279974 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:58:59.279974 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:58:59.279974 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:58:59.279974 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:58:59.280883 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:58:59.280883 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:58:59.280883 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:58:59.280883 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:58:59.280883 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:59.280883 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:59.280883 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:59.280883 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:59.280883 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:59.280883 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:59.280883 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:59.280883 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:59.280883 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:59.280883 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:59.280883 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:59.280883 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:59.286381 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:59.286381 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:59.286381 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:59.286381 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:59.286381 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:58:59.286381 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:58:59.286381 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:58:59.286381 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:58:59.286381 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:58:59.286381 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:58:59.286381 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 29 01:58:59.286381 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:58:59.288983 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 371/726] 10.222.0.49 () {56 vars in 1102 bytes} [Thu Sep 29 01:58:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 379 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:59.294652 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325d7f79-feed-46ed-83fc-70f480bfd9fb None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:59.302778 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f17a7a-89b5-4513-ae2f-6ca54f01193d None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:59.338694 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf15384-d3b6-4e72-9572-077b9b8c728b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:59.339247 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf15384-d3b6-4e72-9572-077b9b8c728b None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:59.339530 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf15384-d3b6-4e72-9572-077b9b8c728b None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:59.339802 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf15384-d3b6-4e72-9572-077b9b8c728b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:59.352894 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf15384-d3b6-4e72-9572-077b9b8c728b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:59.354518 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf15384-d3b6-4e72-9572-077b9b8c728b None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:59.357658 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:59.371322 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-3cf15384-d3b6-4e72-9572-077b9b8c728b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:59.371322 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:59.371322 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:59.371322 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:59.371322 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:59.371322 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:59.371322 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:59.371322 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:59.371322 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:59.371322 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:59.371322 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:59.371322 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:59.371322 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:58:59.371322 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:58:59.371322 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:58:59.371322 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:58:59.372336 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:59.372336 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:59.372336 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:59.372336 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:59.372336 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:59.372336 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:59.372336 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:59.372336 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:59.372336 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:59.372336 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:59.372336 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:59.372336 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:59.372336 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:59.372336 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:59.372336 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:59.372336 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:59.372336 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:58:59.373229 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:58:59.373229 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:59.373229 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:58:59.377587 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 356/727] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 01:58:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:58:59.378811 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf15384-d3b6-4e72-9572-077b9b8c728b None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:59.507625 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf15384-d3b6-4e72-9572-077b9b8c728b None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:59.516790 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325d7f79-feed-46ed-83fc-70f480bfd9fb None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:59.577292 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2546d14-65e7-4cbe-bc6b-9714c2e0021a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:59.578490 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2546d14-65e7-4cbe-bc6b-9714c2e0021a None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:59.578777 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2546d14-65e7-4cbe-bc6b-9714c2e0021a None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:59.579056 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2546d14-65e7-4cbe-bc6b-9714c2e0021a None admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:59.579886 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2546d14-65e7-4cbe-bc6b-9714c2e0021a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:59.580193 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2546d14-65e7-4cbe-bc6b-9714c2e0021a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:59.581589 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2546d14-65e7-4cbe-bc6b-9714c2e0021a None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:59.583676 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd0b943-9742-4cb7-ac10-843c92be0832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:59.584288 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0b943-9742-4cb7-ac10-843c92be0832 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:59.584562 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0b943-9742-4cb7-ac10-843c92be0832 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:59.584828 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0b943-9742-4cb7-ac10-843c92be0832 None admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:59.585517 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd0b943-9742-4cb7-ac10-843c92be0832 None admin] RBAC: Adding query filter params (name=service) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:59.585816 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd0b943-9742-4cb7-ac10-843c92be0832 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:59.587171 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd0b943-9742-4cb7-ac10-843c92be0832 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:59.590783 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:59.606278 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 357/728] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Sep 29 01:58:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:58:59.607483 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2546d14-65e7-4cbe-bc6b-9714c2e0021a None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:59.608246 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 372/729] 10.222.0.49 () {56 vars in 1103 bytes} [Thu Sep 29 01:58:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:59.613388 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd0b943-9742-4cb7-ac10-843c92be0832 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:59.667672 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:59.714096 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2546d14-65e7-4cbe-bc6b-9714c2e0021a None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:59.751061 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a231eca-fac8-48e2-8773-71b5be850b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:59.751809 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a231eca-fac8-48e2-8773-71b5be850b42 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:59.752156 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a231eca-fac8-48e2-8773-71b5be850b42 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:59.752500 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a231eca-fac8-48e2-8773-71b5be850b42 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:59.760130 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a231eca-fac8-48e2-8773-71b5be850b42 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:59.761737 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a231eca-fac8-48e2-8773-71b5be850b42 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:59.774347 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-5a231eca-fac8-48e2-8773-71b5be850b42 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 29 01:58:59.774347 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:59.774347 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:59.774347 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:59.774347 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:59.774347 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:59.774347 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:59.774347 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:59.774347 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:59.774347 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:59.774347 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:59.774347 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:59.774347 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 29 01:58:59.774347 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 29 01:58:59.774347 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 29 01:58:59.774347 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 29 01:58:59.775337 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:59.775337 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:59.775337 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 29 01:58:59.775337 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:58:59.775337 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 29 01:58:59.775337 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:58:59.775337 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:59.775337 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:59.775337 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:59.775337 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:59.775337 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:59.775337 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:59.775337 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:59.775337 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:59.775337 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:59.775337 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:59.775337 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:59.775337 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:59.776306 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:59.776306 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:59.776306 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 29 01:58:59.776306 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 29 01:58:59.776306 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 29 01:58:59.776306 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 29 01:58:59.776306 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 29 01:58:59.776306 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 29 01:58:59.776306 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 29 01:58:59.776306 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:58:59.780142 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 358/730] 10.222.0.49 () {56 vars in 1096 bytes} [Thu Sep 29 01:58:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 01:58:59.782216 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a231eca-fac8-48e2-8773-71b5be850b42 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:59.843184 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd0b943-9742-4cb7-ac10-843c92be0832 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:59.888950 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a231eca-fac8-48e2-8773-71b5be850b42 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:58:59.917035 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:58:59.930069 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0274195c-b4b9-4cc7-bef6-805ba4e8c455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:59.930729 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0274195c-b4b9-4cc7-bef6-805ba4e8c455 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:59.930993 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0274195c-b4b9-4cc7-bef6-805ba4e8c455 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:59.931122 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2613240-a725-40d9-97d2-7abf07238657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:58:59.931304 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0274195c-b4b9-4cc7-bef6-805ba4e8c455 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:59.931607 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2613240-a725-40d9-97d2-7abf07238657 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:58:59.931987 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2613240-a725-40d9-97d2-7abf07238657 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:58:59.932266 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2613240-a725-40d9-97d2-7abf07238657 None admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:58:59.933079 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2613240-a725-40d9-97d2-7abf07238657 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:58:59.933342 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2613240-a725-40d9-97d2-7abf07238657 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:59.934867 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2613240-a725-40d9-97d2-7abf07238657 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:59.948988 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0274195c-b4b9-4cc7-bef6-805ba4e8c455 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:58:59.950511 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0274195c-b4b9-4cc7-bef6-805ba4e8c455 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:58:59.955267 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 359/731] 10.222.0.49 () {56 vars in 1135 bytes} [Thu Sep 29 01:58:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:58:59.964133 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2613240-a725-40d9-97d2-7abf07238657 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:58:59.970382 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-0274195c-b4b9-4cc7-bef6-805ba4e8c455 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:59.970382 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:58:59.970382 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:58:59.970382 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:58:59.970382 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:58:59.970382 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:58:59.970382 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:58:59.970382 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:58:59.970382 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:58:59.970382 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:58:59.970382 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:58:59.970382 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:58:59.970382 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:58:59.970382 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:58:59.970382 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:58:59.970382 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:58:59.971322 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:58:59.971322 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:58:59.971322 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:58:59.971322 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:58:59.971322 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:58:59.971322 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:58:59.971322 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:58:59.971322 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:58:59.971322 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:58:59.971322 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:58:59.971322 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:58:59.971322 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:58:59.971322 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:58:59.971322 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:58:59.971322 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:58:59.971322 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:58:59.971322 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:58:59.972198 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:58:59.972198 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:58:59.972198 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:58:59.972198 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 373/732] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 01:58:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 01:58:59.982279 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0274195c-b4b9-4cc7-bef6-805ba4e8c455 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:00.061658 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:00.082540 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2613240-a725-40d9-97d2-7abf07238657 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:00.115040 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0274195c-b4b9-4cc7-bef6-805ba4e8c455 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:00.121439 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51adf0c-e324-4022-b49f-44c70b6c06d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:00.122438 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51adf0c-e324-4022-b49f-44c70b6c06d3 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:00.122917 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51adf0c-e324-4022-b49f-44c70b6c06d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:00.123387 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51adf0c-e324-4022-b49f-44c70b6c06d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:00.155401 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633dedfe-05b0-4eb2-af8f-28c267d6beba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:00.156242 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633dedfe-05b0-4eb2-af8f-28c267d6beba None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:00.156638 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633dedfe-05b0-4eb2-af8f-28c267d6beba None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:00.157001 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633dedfe-05b0-4eb2-af8f-28c267d6beba None admin] PATH_INFO: `/v3/domains` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:00.157779 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633dedfe-05b0-4eb2-af8f-28c267d6beba None admin] RBAC: Adding query filter params (name=Default) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:00.158176 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633dedfe-05b0-4eb2-af8f-28c267d6beba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:00.159638 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633dedfe-05b0-4eb2-af8f-28c267d6beba None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:00.171475 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:00.177273 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 374/733] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Sep 29 01:58:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:00.178743 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e0ef70-addf-45ca-b89d-2ff5689461fc None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:00.179136 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e0ef70-addf-45ca-b89d-2ff5689461fc None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:00.179515 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e0ef70-addf-45ca-b89d-2ff5689461fc None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:00.181169 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 375/734] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:59:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:59:00.182005 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e0ef70-addf-45ca-b89d-2ff5689461fc None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:00.204114 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51adf0c-e324-4022-b49f-44c70b6c06d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:00.205923 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51adf0c-e324-4022-b49f-44c70b6c06d3 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:00.287289 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e0ef70-addf-45ca-b89d-2ff5689461fc None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:00.299495 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:00.320656 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 360/735] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Sep 29 01:58:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 29 01:59:00.322170 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f7c0c-cf03-4fac-aca3-e50af3c3946f None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:00.322459 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f7c0c-cf03-4fac-aca3-e50af3c3946f None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:00.322736 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f7c0c-cf03-4fac-aca3-e50af3c3946f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:00.329991 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d14f0b-e621-4bf4-8295-dc6b3e8c3641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:00.330645 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d14f0b-e621-4bf4-8295-dc6b3e8c3641 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:00.330925 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d14f0b-e621-4bf4-8295-dc6b3e8c3641 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:00.331196 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d14f0b-e621-4bf4-8295-dc6b3e8c3641 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:00.339666 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d14f0b-e621-4bf4-8295-dc6b3e8c3641 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:00.341148 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d14f0b-e621-4bf4-8295-dc6b3e8c3641 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:00.344184 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-2c1f7c0c-cf03-4fac-aca3-e50af3c3946f None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:59:00.345700 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-2c1f7c0c-cf03-4fac-aca3-e50af3c3946f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:59:00.354648 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-c5d14f0b-e621-4bf4-8295-dc6b3e8c3641 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 29 01:59:00.354648 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:00.354648 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:00.354648 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:00.354648 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:00.354648 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:00.354648 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:00.354648 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:00.354648 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:00.354648 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:00.354648 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:00.354648 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:00.354648 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 29 01:59:00.354648 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 29 01:59:00.354648 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 29 01:59:00.354648 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 29 01:59:00.356855 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:00.356855 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:00.356855 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 29 01:59:00.356855 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:59:00.356855 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 29 01:59:00.356855 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:59:00.356855 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:00.356855 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:00.356855 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:00.356855 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:00.356855 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:00.356855 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:00.356855 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:00.356855 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:00.356855 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:00.356855 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:00.356855 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:00.356855 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:00.359161 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:00.359161 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:00.359161 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 29 01:59:00.359161 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 29 01:59:00.359161 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 29 01:59:00.359161 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 29 01:59:00.359161 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 29 01:59:00.359161 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 29 01:59:00.359161 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 29 01:59:00.359161 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:59:00.360861 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 376/736] 10.222.0.49 () {56 vars in 1117 bytes} [Thu Sep 29 01:59:00 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:00.369425 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d14f0b-e621-4bf4-8295-dc6b3e8c3641 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:00.422521 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 361/737] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:59:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:59:00.423421 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1f7c0c-cf03-4fac-aca3-e50af3c3946f None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:00.426109 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:00.468208 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d14f0b-e621-4bf4-8295-dc6b3e8c3641 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:00.504436 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca6069d-ad3d-481f-9351-4cf541e56169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:00.504993 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca6069d-ad3d-481f-9351-4cf541e56169 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:00.505273 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca6069d-ad3d-481f-9351-4cf541e56169 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:00.505640 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca6069d-ad3d-481f-9351-4cf541e56169 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:00.516664 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca6069d-ad3d-481f-9351-4cf541e56169 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:00.518145 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca6069d-ad3d-481f-9351-4cf541e56169 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:00.533304 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-aca6069d-ad3d-481f-9351-4cf541e56169 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:00.533304 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:00.533304 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:00.533304 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:00.533304 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:00.533304 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:00.533304 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:00.533304 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:00.533304 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:00.533304 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:00.533304 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:00.533304 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:00.533304 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:59:00.533304 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:59:00.533304 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:59:00.533304 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:59:00.535486 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:00.535486 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:00.535486 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:00.535486 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:00.535486 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:00.535486 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:00.535486 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:00.535486 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:00.535486 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:00.535486 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:00.535486 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:00.535486 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:00.535486 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:00.535486 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:00.535486 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:00.535486 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:00.535486 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:59:00.537679 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:59:00.537679 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:00.537679 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:59:00.537679 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 377/738] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 01:59:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:00.537679 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b43d7-b2cb-4ced-a83a-4d6896243ced None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:00.537679 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b43d7-b2cb-4ced-a83a-4d6896243ced None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:00.537679 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b43d7-b2cb-4ced-a83a-4d6896243ced None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:00.543403 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 378/739] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:59:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:59:00.543619 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1f7c0c-cf03-4fac-aca3-e50af3c3946f None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:00.543785 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291b43d7-b2cb-4ced-a83a-4d6896243ced None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:00.569996 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:00.582146 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d9cd4a-4bbb-4af8-938b-07b92946532e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:00.582764 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d9cd4a-4bbb-4af8-938b-07b92946532e None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:00.583044 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d9cd4a-4bbb-4af8-938b-07b92946532e None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:00.583318 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d9cd4a-4bbb-4af8-938b-07b92946532e None admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:00.584045 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d9cd4a-4bbb-4af8-938b-07b92946532e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:00.584351 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d9cd4a-4bbb-4af8-938b-07b92946532e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:00.585828 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d9cd4a-4bbb-4af8-938b-07b92946532e None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:00.607819 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 362/740] 10.222.0.49 () {56 vars in 1149 bytes} [Thu Sep 29 01:59:00 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:00.607819 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b5e177-3e63-472f-bbf8-f026673e3285 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:00.607819 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b5e177-3e63-472f-bbf8-f026673e3285 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:00.607819 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b5e177-3e63-472f-bbf8-f026673e3285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:00.623805 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-b9b5e177-3e63-472f-bbf8-f026673e3285 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:59:00.624988 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-b9b5e177-3e63-472f-bbf8-f026673e3285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:59:00.661964 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291b43d7-b2cb-4ced-a83a-4d6896243ced None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:00.682330 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:00.694023 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 363/741] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:59:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:59:00.695058 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad29dc9e-5406-4af1-bf20-6a69ba4f1304 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:00.695339 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad29dc9e-5406-4af1-bf20-6a69ba4f1304 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:00.695612 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad29dc9e-5406-4af1-bf20-6a69ba4f1304 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:00.696956 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 364/742] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:59:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:59:00.697512 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad29dc9e-5406-4af1-bf20-6a69ba4f1304 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:00.712087 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec24d83-45dc-409e-905e-c59898ca80a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:00.713006 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec24d83-45dc-409e-905e-c59898ca80a4 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:00.713358 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec24d83-45dc-409e-905e-c59898ca80a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:00.713636 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec24d83-45dc-409e-905e-c59898ca80a4 None admin] PATH_INFO: `/v3/domains` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:00.714584 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec24d83-45dc-409e-905e-c59898ca80a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:00.714891 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec24d83-45dc-409e-905e-c59898ca80a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:00.716556 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec24d83-45dc-409e-905e-c59898ca80a4 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:00.732617 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 379/743] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Sep 29 01:59:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:00.734281 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf1b75-c97e-45b5-b866-8f94caf2df83 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:00.734615 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf1b75-c97e-45b5-b866-8f94caf2df83 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:00.735250 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf1b75-c97e-45b5-b866-8f94caf2df83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:00.758132 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-2bbf1b75-c97e-45b5-b866-8f94caf2df83 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:59:00.759330 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-2bbf1b75-c97e-45b5-b866-8f94caf2df83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:59:00.811180 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad29dc9e-5406-4af1-bf20-6a69ba4f1304 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:00.835727 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 380/744] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:59:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 29 01:59:00.836560 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbf1b75-c97e-45b5-b866-8f94caf2df83 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:00.852052 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faa8090-3d10-490f-befa-d95fdc262992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:00.852652 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faa8090-3d10-490f-befa-d95fdc262992 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:00.852926 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faa8090-3d10-490f-befa-d95fdc262992 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:00.853192 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faa8090-3d10-490f-befa-d95fdc262992 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:00.863108 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:00.919750 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:00.932835 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faa8090-3d10-490f-befa-d95fdc262992 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:00.934486 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faa8090-3d10-490f-befa-d95fdc262992 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:00.974874 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbf1b75-c97e-45b5-b866-8f94caf2df83 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:01.012430 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f66a5a-fea5-4b13-ace2-e9b8f64da596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:01.013063 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f66a5a-fea5-4b13-ace2-e9b8f64da596 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:01.013371 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f66a5a-fea5-4b13-ace2-e9b8f64da596 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:01.013646 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f66a5a-fea5-4b13-ace2-e9b8f64da596 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:01.021364 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f66a5a-fea5-4b13-ace2-e9b8f64da596 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:01.022821 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f66a5a-fea5-4b13-ace2-e9b8f64da596 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:01.034549 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-44f66a5a-fea5-4b13-ace2-e9b8f64da596 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:59:01.034549 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:01.034549 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:01.034549 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:01.034549 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:01.034549 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:01.034549 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:01.034549 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:01.034549 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:01.034549 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:01.034549 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:01.034549 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:01.034549 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 29 01:59:01.034549 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 29 01:59:01.034549 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 29 01:59:01.035661 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 29 01:59:01.035661 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:01.035661 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:01.035661 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:01.035661 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:01.035661 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:01.035661 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:01.035661 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:01.035661 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:01.035661 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:01.035661 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:01.035661 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:01.035661 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:01.035661 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:01.035661 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:01.035661 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:01.035661 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:01.036751 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 29 01:59:01.036751 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 29 01:59:01.036751 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 29 01:59:01.036751 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 29 01:59:01.036751 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 29 01:59:01.036751 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 29 01:59:01.036751 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:59:01.036751 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:59:01.036751 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 381/745] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Sep 29 01:59:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:01.036751 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f66a5a-fea5-4b13-ace2-e9b8f64da596 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:01.052058 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 365/746] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Sep 29 01:59:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 29 01:59:01.053410 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faa8090-3d10-490f-befa-d95fdc262992 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:01.110204 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:01.143986 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f66a5a-fea5-4b13-ace2-e9b8f64da596 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:01.147404 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:01.157394 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faa8090-3d10-490f-befa-d95fdc262992 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:01.177570 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2481f9da-38a4-408d-8a39-ac02d6fdce3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:01.178178 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2481f9da-38a4-408d-8a39-ac02d6fdce3d None admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:01.178463 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2481f9da-38a4-408d-8a39-ac02d6fdce3d None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:01.178733 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2481f9da-38a4-408d-8a39-ac02d6fdce3d None admin] PATH_INFO: `/v3/services` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:01.179377 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2481f9da-38a4-408d-8a39-ac02d6fdce3d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:01.180738 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2481f9da-38a4-408d-8a39-ac02d6fdce3d None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:01.192026 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5a16ce-b585-4a72-97a2-c6ec309f1223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:01.192650 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a16ce-b585-4a72-97a2-c6ec309f1223 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:01.192928 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a16ce-b585-4a72-97a2-c6ec309f1223 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:01.193197 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a16ce-b585-4a72-97a2-c6ec309f1223 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:01.196577 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 382/747] 10.222.0.49 () {60 vars in 1141 bytes} [Thu Sep 29 01:59:01 2022] POST /identity/v3/services => generated 240 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 01:59:01.197420 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2481f9da-38a4-408d-8a39-ac02d6fdce3d None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:01.210303 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5a16ce-b585-4a72-97a2-c6ec309f1223 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:59:01.216488 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-cc5a16ce-b585-4a72-97a2-c6ec309f1223 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 01:59:01.216488 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:01.216488 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:01.216488 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:01.216488 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:01.216488 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:01.216488 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:01.216488 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:01.216488 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:01.216488 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:01.216488 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:01.216488 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:01.216488 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:59:01.216488 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:59:01.216488 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:59:01.216488 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:59:01.217566 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:59:01.217566 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:59:01.217566 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:59:01.217566 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:59:01.217566 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:01.217566 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:01.217566 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:01.217566 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:01.217566 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:01.217566 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:01.217566 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:01.217566 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:01.217566 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:01.217566 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:01.217566 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:01.217566 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:01.219393 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:01.219393 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:01.219393 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:01.219393 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:01.219393 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:59:01.219393 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:59:01.219393 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:59:01.219393 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:59:01.219393 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:59:01.219393 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:59:01.219393 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 01:59:01.219393 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:59:01.219393 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 366/748] 10.222.0.49 () {56 vars in 1096 bytes} [Thu Sep 29 01:59:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:01.219393 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5a16ce-b585-4a72-97a2-c6ec309f1223 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:01.322737 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2481f9da-38a4-408d-8a39-ac02d6fdce3d None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:01.342118 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5a16ce-b585-4a72-97a2-c6ec309f1223 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:01.353987 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:01.364488 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c32ea87-6a8f-4e85-ab32-ae41ea1b9b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:01.365550 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c32ea87-6a8f-4e85-ab32-ae41ea1b9b56 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:01.365832 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c32ea87-6a8f-4e85-ab32-ae41ea1b9b56 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:01.366106 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c32ea87-6a8f-4e85-ab32-ae41ea1b9b56 None admin] PATH_INFO: `/v3/projects` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:01.366810 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c32ea87-6a8f-4e85-ab32-ae41ea1b9b56 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:01.367117 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c32ea87-6a8f-4e85-ab32-ae41ea1b9b56 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:01.368648 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c32ea87-6a8f-4e85-ab32-ae41ea1b9b56 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:01.381641 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 383/749] 10.222.0.49 () {56 vars in 1148 bytes} [Thu Sep 29 01:59:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:01.382450 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c32ea87-6a8f-4e85-ab32-ae41ea1b9b56 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:01.387152 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1086e6da-cbd7-43f5-924b-a1e8ce88c4d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:01.388087 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1086e6da-cbd7-43f5-924b-a1e8ce88c4d7 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:01.388674 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1086e6da-cbd7-43f5-924b-a1e8ce88c4d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:01.388941 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1086e6da-cbd7-43f5-924b-a1e8ce88c4d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:01.402078 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1086e6da-cbd7-43f5-924b-a1e8ce88c4d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:01.403531 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1086e6da-cbd7-43f5-924b-a1e8ce88c4d7 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:01.419726 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-1086e6da-cbd7-43f5-924b-a1e8ce88c4d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:01.419726 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:01.419726 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:01.419726 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:01.419726 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:01.419726 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:01.419726 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:01.419726 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:01.419726 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:01.419726 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:01.419726 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:01.419726 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:01.419726 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:59:01.419726 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:59:01.419726 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:59:01.419726 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:59:01.420878 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:01.420878 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:01.420878 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:01.420878 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:01.420878 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:01.420878 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:01.420878 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:01.420878 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:01.420878 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:01.420878 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:01.420878 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:01.420878 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:01.420878 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:01.420878 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:01.420878 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:01.420878 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:01.420878 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:59:01.421966 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:59:01.421966 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:01.421966 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:59:01.421966 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 367/750] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 01:59:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:01.422186 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1086e6da-cbd7-43f5-924b-a1e8ce88c4d7 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:01.425645 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:01.501816 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c32ea87-6a8f-4e85-ab32-ae41ea1b9b56 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:01.524078 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1086e6da-cbd7-43f5-924b-a1e8ce88c4d7 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:01.538526 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddcec1a-ecec-4d22-87be-7fec4131457a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:01.539134 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddcec1a-ecec-4d22-87be-7fec4131457a None admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:01.539408 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddcec1a-ecec-4d22-87be-7fec4131457a None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:01.539675 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddcec1a-ecec-4d22-87be-7fec4131457a None admin] PATH_INFO: `/v3/services` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:01.540437 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddcec1a-ecec-4d22-87be-7fec4131457a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:01.542215 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddcec1a-ecec-4d22-87be-7fec4131457a None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:01.558665 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 384/751] 10.222.0.49 () {60 vars in 1141 bytes} [Thu Sep 29 01:59:01 2022] POST /identity/v3/services => generated 251 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 01:59:01.559497 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddcec1a-ecec-4d22-87be-7fec4131457a None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:01.584014 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9337b2da-e982-46ed-92c5-ec1396630784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:01.585000 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9337b2da-e982-46ed-92c5-ec1396630784 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:01.585543 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9337b2da-e982-46ed-92c5-ec1396630784 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:01.586725 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9337b2da-e982-46ed-92c5-ec1396630784 None admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:01.587950 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9337b2da-e982-46ed-92c5-ec1396630784 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:01.588471 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9337b2da-e982-46ed-92c5-ec1396630784 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:01.591130 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9337b2da-e982-46ed-92c5-ec1396630784 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:01.605356 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 368/752] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Sep 29 01:59:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:01.606533 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9337b2da-e982-46ed-92c5-ec1396630784 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:01.622986 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:01.690483 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:01.692112 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddcec1a-ecec-4d22-87be-7fec4131457a None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:01.736643 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061902a5-b68e-41c1-b58a-fdfed235031c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:01.737871 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061902a5-b68e-41c1-b58a-fdfed235031c None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:01.738328 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061902a5-b68e-41c1-b58a-fdfed235031c None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:01.738775 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061902a5-b68e-41c1-b58a-fdfed235031c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:01.739748 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061902a5-b68e-41c1-b58a-fdfed235031c None admin] RBAC: Adding query filter params (role.id=fe9bbc67742f4f5893f39b18eb31d59a, scope.project.id=6f1d8fd250c84c5887cb3173053ea2dd, user.id=c88bc0f32600416ca7c6a59f4196e497) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:01.740043 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9337b2da-e982-46ed-92c5-ec1396630784 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:01.740422 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061902a5-b68e-41c1-b58a-fdfed235031c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:01.742290 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061902a5-b68e-41c1-b58a-fdfed235031c None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:01.749211 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 385/753] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Sep 29 01:59:01 2022] GET /identity/v3/role_assignments?user.id=c88bc0f32600416ca7c6a59f4196e497&scope.project.id=6f1d8fd250c84c5887cb3173053ea2dd&role.id=fe9bbc67742f4f5893f39b18eb31d59a => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:01.750614 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061902a5-b68e-41c1-b58a-fdfed235031c None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:01.791124 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cdb901-0438-40ac-9bb3-7df083ceafe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:01.792724 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cdb901-0438-40ac-9bb3-7df083ceafe0 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:01.793009 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cdb901-0438-40ac-9bb3-7df083ceafe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:01.793286 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cdb901-0438-40ac-9bb3-7df083ceafe0 None admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:01.794335 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cdb901-0438-40ac-9bb3-7df083ceafe0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:01.794781 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cdb901-0438-40ac-9bb3-7df083ceafe0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:01.796346 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cdb901-0438-40ac-9bb3-7df083ceafe0 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:01.820392 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 369/754] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Sep 29 01:59:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:01.822404 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cdb901-0438-40ac-9bb3-7df083ceafe0 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:01.912516 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061902a5-b68e-41c1-b58a-fdfed235031c None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:01.931502 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:01.954693 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cdb901-0438-40ac-9bb3-7df083ceafe0 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:01.962088 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51473d3-a4cd-46ab-a1d2-10cafb9fe865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:01.962991 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51473d3-a4cd-46ab-a1d2-10cafb9fe865 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:01.963455 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51473d3-a4cd-46ab-a1d2-10cafb9fe865 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:01.963894 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51473d3-a4cd-46ab-a1d2-10cafb9fe865 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:01.978547 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:01.982468 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51473d3-a4cd-46ab-a1d2-10cafb9fe865 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:01.993352 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51473d3-a4cd-46ab-a1d2-10cafb9fe865 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:02.003571 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf244be-875e-46c6-9348-bd1df7db167f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:02.004219 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf244be-875e-46c6-9348-bd1df7db167f None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:02.004502 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf244be-875e-46c6-9348-bd1df7db167f None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:02.004771 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf244be-875e-46c6-9348-bd1df7db167f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:02.013013 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-f51473d3-a4cd-46ab-a1d2-10cafb9fe865 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:02.013013 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:02.013013 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:02.013013 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:02.013013 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:02.013013 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:02.013013 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:02.013013 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:02.013013 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:02.013013 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:02.013013 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:02.013013 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:02.013013 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:59:02.013013 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:59:02.013013 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:59:02.013013 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:59:02.014028 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:02.014028 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:02.014028 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:02.014028 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:02.014028 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:02.014028 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:02.014028 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:02.014028 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:02.014028 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:02.014028 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:02.014028 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:02.014028 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:02.014028 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:02.014028 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:02.014028 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:02.014028 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:02.014028 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:59:02.014932 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:59:02.014932 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:02.014932 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:59:02.014932 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 386/755] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 01:59:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:02.020247 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51473d3-a4cd-46ab-a1d2-10cafb9fe865 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:02.026207 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf244be-875e-46c6-9348-bd1df7db167f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:02.032580 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf244be-875e-46c6-9348-bd1df7db167f None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:02.049951 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-dcf244be-875e-46c6-9348-bd1df7db167f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:59:02.049951 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:02.049951 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:02.049951 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:02.049951 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:02.049951 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:02.049951 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:02.049951 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:02.049951 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:02.049951 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:02.049951 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:02.049951 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:02.049951 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 29 01:59:02.049951 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 29 01:59:02.049951 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 29 01:59:02.050882 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 29 01:59:02.050882 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:02.050882 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:02.050882 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:02.050882 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:02.050882 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:02.050882 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:02.050882 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:02.050882 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:02.050882 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:02.050882 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:02.050882 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:02.050882 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:02.050882 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:02.050882 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:02.050882 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:02.050882 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:02.051850 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 29 01:59:02.051850 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 29 01:59:02.051850 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 29 01:59:02.051850 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 29 01:59:02.051850 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 29 01:59:02.051850 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 29 01:59:02.051850 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:59:02.051850 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:59:02.051850 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 370/756] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Sep 29 01:59:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:02.066462 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf244be-875e-46c6-9348-bd1df7db167f None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:02.186918 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51473d3-a4cd-46ab-a1d2-10cafb9fe865 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:02.255583 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e5e435-4b79-4d2b-ab5a-d3820db8fa7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:02.256114 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e5e435-4b79-4d2b-ab5a-d3820db8fa7c None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:02.256397 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e5e435-4b79-4d2b-ab5a-d3820db8fa7c None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:02.256669 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e5e435-4b79-4d2b-ab5a-d3820db8fa7c None admin] PATH_INFO: `/v3/domains` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:02.257330 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e5e435-4b79-4d2b-ab5a-d3820db8fa7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:02.257633 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e5e435-4b79-4d2b-ab5a-d3820db8fa7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:02.260130 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf244be-875e-46c6-9348-bd1df7db167f None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:02.262410 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e5e435-4b79-4d2b-ab5a-d3820db8fa7c None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:02.288437 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 387/757] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Sep 29 01:59:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:02.294040 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e5e435-4b79-4d2b-ab5a-d3820db8fa7c None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:02.324736 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f399b84-b80d-4f28-840d-0f7bdb3db893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:02.325752 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f399b84-b80d-4f28-840d-0f7bdb3db893 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:02.326227 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f399b84-b80d-4f28-840d-0f7bdb3db893 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:02.326690 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f399b84-b80d-4f28-840d-0f7bdb3db893 None admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:02.328189 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f399b84-b80d-4f28-840d-0f7bdb3db893 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:02.328795 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f399b84-b80d-4f28-840d-0f7bdb3db893 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:02.330453 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f399b84-b80d-4f28-840d-0f7bdb3db893 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:02.341582 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:02.357374 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 371/758] 10.222.0.49 () {56 vars in 1148 bytes} [Thu Sep 29 01:59:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:02.368782 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f399b84-b80d-4f28-840d-0f7bdb3db893 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:02.442675 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:02.488419 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e5e435-4b79-4d2b-ab5a-d3820db8fa7c None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:02.552105 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f399b84-b80d-4f28-840d-0f7bdb3db893 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:02.553054 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a28904-11e7-453c-bd17-82981554feef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:02.553935 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a28904-11e7-453c-bd17-82981554feef None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:02.554407 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a28904-11e7-453c-bd17-82981554feef None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:02.554885 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a28904-11e7-453c-bd17-82981554feef None admin] PATH_INFO: `/v3/users/nova` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:02.570678 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a28904-11e7-453c-bd17-82981554feef None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:02.573000 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a28904-11e7-453c-bd17-82981554feef None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:02.590178 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-e1a28904-11e7-453c-bd17-82981554feef None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 29 01:59:02.590178 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:02.590178 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:02.590178 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:02.590178 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:02.590178 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:02.590178 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:02.590178 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:02.590178 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:02.590178 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:02.590178 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:02.590178 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:02.590178 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 29 01:59:02.590178 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 29 01:59:02.590178 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 29 01:59:02.590178 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 29 01:59:02.591165 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:02.591165 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:02.591165 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 29 01:59:02.591165 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:59:02.591165 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 29 01:59:02.591165 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:59:02.591165 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:02.591165 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:02.591165 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:02.591165 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:02.591165 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:02.591165 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:02.591165 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:02.591165 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:02.591165 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:02.591165 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:02.591165 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:02.591165 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:02.592091 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:02.592091 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:02.592091 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 29 01:59:02.592091 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 29 01:59:02.592091 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 29 01:59:02.592091 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 29 01:59:02.592091 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 29 01:59:02.592091 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 29 01:59:02.592091 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 29 01:59:02.592091 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:59:02.594758 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 388/759] 10.222.0.49 () {56 vars in 1093 bytes} [Thu Sep 29 01:59:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 01:59:02.599794 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a28904-11e7-453c-bd17-82981554feef None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:02.636122 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec37828a-222b-47ad-bd8a-41b83fb83f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:02.637095 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec37828a-222b-47ad-bd8a-41b83fb83f8a None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:02.637647 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec37828a-222b-47ad-bd8a-41b83fb83f8a None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:02.639086 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec37828a-222b-47ad-bd8a-41b83fb83f8a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:02.640049 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec37828a-222b-47ad-bd8a-41b83fb83f8a None admin] RBAC: Adding query filter params (role.id=393e6032e5cc4678b8351026fe4434f8, scope.project.id=6f1d8fd250c84c5887cb3173053ea2dd, user.id=0f8f13f302de4701a7f4e0562bca08cf) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:02.640999 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec37828a-222b-47ad-bd8a-41b83fb83f8a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:02.643660 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec37828a-222b-47ad-bd8a-41b83fb83f8a None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:02.654635 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 372/760] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Sep 29 01:59:02 2022] GET /identity/v3/role_assignments?user.id=0f8f13f302de4701a7f4e0562bca08cf&scope.project.id=6f1d8fd250c84c5887cb3173053ea2dd&role.id=393e6032e5cc4678b8351026fe4434f8 => generated 259 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:02.717168 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:02.736500 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a28904-11e7-453c-bd17-82981554feef None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:02.894731 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e565f61-284f-4567-b389-9255fe057c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:02.895687 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e565f61-284f-4567-b389-9255fe057c13 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:02.896183 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e565f61-284f-4567-b389-9255fe057c13 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:02.896659 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e565f61-284f-4567-b389-9255fe057c13 None admin] PATH_INFO: `/v3/users` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:02.897620 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e565f61-284f-4567-b389-9255fe057c13 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:02.898117 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e565f61-284f-4567-b389-9255fe057c13 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:02.899719 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e565f61-284f-4567-b389-9255fe057c13 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:02.935356 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 389/761] 10.222.0.49 () {56 vars in 1133 bytes} [Thu Sep 29 01:59:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:02.941372 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec37828a-222b-47ad-bd8a-41b83fb83f8a None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:03.086709 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec37828a-222b-47ad-bd8a-41b83fb83f8a None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:03.089639 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:03.128733 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b62ca9-c780-4cbc-9ea4-35546da1c858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:03.129382 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b62ca9-c780-4cbc-9ea4-35546da1c858 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:03.129659 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b62ca9-c780-4cbc-9ea4-35546da1c858 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:03.129929 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b62ca9-c780-4cbc-9ea4-35546da1c858 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:03.142063 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b62ca9-c780-4cbc-9ea4-35546da1c858 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:03.143495 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b62ca9-c780-4cbc-9ea4-35546da1c858 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:03.167901 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-b1b62ca9-c780-4cbc-9ea4-35546da1c858 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:03.167901 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:03.167901 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:03.167901 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:03.167901 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:03.167901 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:03.167901 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:03.167901 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:03.167901 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:03.167901 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:03.167901 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:03.167901 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:03.167901 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:59:03.167901 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:59:03.167901 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:59:03.167901 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:59:03.168868 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:03.168868 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:03.168868 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:03.168868 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:03.168868 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:03.168868 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:03.168868 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:03.168868 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:03.168868 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:03.168868 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:03.168868 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:03.168868 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:03.168868 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:03.168868 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:03.168868 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:03.168868 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:03.168868 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:59:03.169781 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:59:03.169781 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:03.169781 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:59:03.172457 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 373/762] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 01:59:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:03.177796 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e565f61-284f-4567-b389-9255fe057c13 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:03.323082 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e565f61-284f-4567-b389-9255fe057c13 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:03.376472 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9346b219-979c-4b7a-a53f-9244014bc754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:03.377502 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9346b219-979c-4b7a-a53f-9244014bc754 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:03.378005 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9346b219-979c-4b7a-a53f-9244014bc754 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:03.378476 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9346b219-979c-4b7a-a53f-9244014bc754 None admin] PATH_INFO: `/v3/domains` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:03.379330 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9346b219-979c-4b7a-a53f-9244014bc754 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:03.379846 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9346b219-979c-4b7a-a53f-9244014bc754 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:03.381443 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9346b219-979c-4b7a-a53f-9244014bc754 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:03.395791 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 390/763] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Sep 29 01:59:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:03.401211 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b62ca9-c780-4cbc-9ea4-35546da1c858 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:03.542084 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b62ca9-c780-4cbc-9ea4-35546da1c858 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:03.594128 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7064015c-3e9f-4ee7-bd72-d3278163ea24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:03.594838 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7064015c-3e9f-4ee7-bd72-d3278163ea24 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:03.595117 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7064015c-3e9f-4ee7-bd72-d3278163ea24 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:03.595386 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7064015c-3e9f-4ee7-bd72-d3278163ea24 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:03.600554 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d876d8-7b2c-41d5-8307-3a96ee9dde48 None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:03.600838 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d876d8-7b2c-41d5-8307-3a96ee9dde48 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:03.601111 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d876d8-7b2c-41d5-8307-3a96ee9dde48 None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:03.602436 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7064015c-3e9f-4ee7-bd72-d3278163ea24 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:03.602695 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 391/764] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:59:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 29 01:59:03.603911 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7064015c-3e9f-4ee7-bd72-d3278163ea24 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:03.607564 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b741100-d6b2-4255-b1bb-6b7ff4358246 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:03.607848 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b741100-d6b2-4255-b1bb-6b7ff4358246 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:03.608118 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b741100-d6b2-4255-b1bb-6b7ff4358246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:03.614607 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:03.623337 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-7064015c-3e9f-4ee7-bd72-d3278163ea24 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:59:03.623337 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:03.623337 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:03.623337 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:03.623337 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:03.623337 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:03.623337 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:03.623337 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:03.623337 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:03.623337 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:03.623337 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:03.623337 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:03.623337 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 29 01:59:03.623337 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 29 01:59:03.623337 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 29 01:59:03.624259 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 29 01:59:03.624259 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:03.624259 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:03.624259 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:03.624259 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:03.624259 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:03.624259 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:03.624259 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:03.624259 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:03.624259 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:03.624259 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:03.624259 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:03.624259 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:03.624259 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:03.624259 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:03.624259 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:03.624259 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:03.625828 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 29 01:59:03.625828 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 29 01:59:03.625828 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 29 01:59:03.625828 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 29 01:59:03.625828 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 29 01:59:03.625828 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 29 01:59:03.625828 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:59:03.625828 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:59:03.625828 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 374/765] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Sep 29 01:59:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:03.634212 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7064015c-3e9f-4ee7-bd72-d3278163ea24 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:03.644896 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-8b741100-d6b2-4255-b1bb-6b7ff4358246 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:59:03.646245 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-8b741100-d6b2-4255-b1bb-6b7ff4358246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:59:03.665742 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:03.791844 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 392/766] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:59:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 29 01:59:03.803464 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7064015c-3e9f-4ee7-bd72-d3278163ea24 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:03.845676 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b58e8b-0811-46ae-8975-d65e187b9691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:03.846611 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b58e8b-0811-46ae-8975-d65e187b9691 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:03.847065 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b58e8b-0811-46ae-8975-d65e187b9691 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:03.847508 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b58e8b-0811-46ae-8975-d65e187b9691 None admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:03.848365 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b58e8b-0811-46ae-8975-d65e187b9691 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:03.848839 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b58e8b-0811-46ae-8975-d65e187b9691 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:03.850473 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b58e8b-0811-46ae-8975-d65e187b9691 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:03.868660 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 375/767] 10.222.0.49 () {56 vars in 1148 bytes} [Thu Sep 29 01:59:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:03.874963 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b741100-d6b2-4255-b1bb-6b7ff4358246 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:04.025069 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b741100-d6b2-4255-b1bb-6b7ff4358246 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:04.055804 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:04.061191 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06724c9-a165-41ae-a6c4-99afd4c256a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:04.066134 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06724c9-a165-41ae-a6c4-99afd4c256a0 None admin] REQUEST_METHOD: `PUT` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:04.066421 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06724c9-a165-41ae-a6c4-99afd4c256a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:04.066692 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06724c9-a165-41ae-a6c4-99afd4c256a0 None admin] PATH_INFO: `/v3/projects/6f1d8fd250c84c5887cb3173053ea2dd/users/f3325a7111d447f4a9cf00c672d5420f/roles/fe9bbc67742f4f5893f39b18eb31d59a` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:04.068655 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06724c9-a165-41ae-a6c4-99afd4c256a0 None admin] RBAC: Authorizing `identity:create_grant(project_id=6f1d8fd250c84c5887cb3173053ea2dd, user_id=f3325a7111d447f4a9cf00c672d5420f, role_id=fe9bbc67742f4f5893f39b18eb31d59a)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:04.070108 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06724c9-a165-41ae-a6c4-99afd4c256a0 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:04.092303 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 393/768] 10.222.0.49 () {58 vars in 1439 bytes} [Thu Sep 29 01:59:03 2022] PUT /identity/v3/projects/6f1d8fd250c84c5887cb3173053ea2dd/users/f3325a7111d447f4a9cf00c672d5420f/roles/fe9bbc67742f4f5893f39b18eb31d59a => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 01:59:04.129026 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b58e8b-0811-46ae-8975-d65e187b9691 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:04.231003 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:04.248445 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b58e8b-0811-46ae-8975-d65e187b9691 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:04.287640 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c4b401-0305-4c00-a539-54aca2f385bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:04.288272 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c4b401-0305-4c00-a539-54aca2f385bb None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:04.288543 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c4b401-0305-4c00-a539-54aca2f385bb None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:04.288812 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c4b401-0305-4c00-a539-54aca2f385bb None admin] PATH_INFO: `/v3/services/network` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:04.289419 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c4b401-0305-4c00-a539-54aca2f385bb None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:04.290824 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c4b401-0305-4c00-a539-54aca2f385bb None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:04.300157 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-03c4b401-0305-4c00-a539-54aca2f385bb None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 29 01:59:04.300157 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:04.300157 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 29 01:59:04.300157 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 29 01:59:04.300157 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 29 01:59:04.300157 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 29 01:59:04.300157 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 29 01:59:04.300157 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 29 01:59:04.300157 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 29 01:59:04.300157 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:59:04.300157 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 29 01:59:04.300157 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:59:04.300157 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:04.300157 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:04.300157 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:04.300157 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:04.300157 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:04.301167 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:04.301167 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:04.301167 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:04.301167 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:04.301167 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:04.301167 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:04.301167 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 29 01:59:04.301167 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 29 01:59:04.301167 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 29 01:59:04.301167 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 29 01:59:04.301167 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:04.301167 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:04.301167 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:04.301167 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:04.301167 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:04.301167 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:04.303218 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:04.303218 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:04.303218 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:04.303218 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:04.303218 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:04.303218 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:04.303218 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:04.303218 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:04.303218 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:04.303218 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:04.303218 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 29 01:59:04.303218 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 29 01:59:04.303218 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 29 01:59:04.303218 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:59:04.303218 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 376/769] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Sep 29 01:59:04 2022] GET /identity/v3/services/network => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:04.307522 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06724c9-a165-41ae-a6c4-99afd4c256a0 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:04.414373 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06724c9-a165-41ae-a6c4-99afd4c256a0 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:04.452948 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e659c26-30b6-4c6c-a373-703ce500e960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:04.453585 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e659c26-30b6-4c6c-a373-703ce500e960 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:04.453860 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e659c26-30b6-4c6c-a373-703ce500e960 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:04.454125 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e659c26-30b6-4c6c-a373-703ce500e960 None admin] PATH_INFO: `/v3/services` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:04.454751 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e659c26-30b6-4c6c-a373-703ce500e960 None admin] RBAC: Adding query filter params (name=network) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:04.455045 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e659c26-30b6-4c6c-a373-703ce500e960 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:04.456398 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e659c26-30b6-4c6c-a373-703ce500e960 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:04.461159 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 394/770] 10.222.0.49 () {56 vars in 1112 bytes} [Thu Sep 29 01:59:04 2022] GET /identity/v3/services?name=network => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:04.466803 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c4b401-0305-4c00-a539-54aca2f385bb None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:04.535368 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aceccc-dff9-4c35-a981-8bd561a1cd59 None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:04.535685 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aceccc-dff9-4c35-a981-8bd561a1cd59 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:04.535897 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aceccc-dff9-4c35-a981-8bd561a1cd59 None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:04.537349 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 395/771] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:59:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:59:04.546065 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95feddf8-a777-493c-991f-f7e8d84588f5 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:04.546898 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95feddf8-a777-493c-991f-f7e8d84588f5 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:04.547102 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95feddf8-a777-493c-991f-f7e8d84588f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:04.584586 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c4b401-0305-4c00-a539-54aca2f385bb None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:04.586311 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-95feddf8-a777-493c-991f-f7e8d84588f5 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:59:04.587509 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-95feddf8-a777-493c-991f-f7e8d84588f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:59:04.621859 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf62a9b4-b8bd-4260-a340-de1259d82ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:04.622899 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf62a9b4-b8bd-4260-a340-de1259d82ecc None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:04.623182 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf62a9b4-b8bd-4260-a340-de1259d82ecc None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:04.623596 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf62a9b4-b8bd-4260-a340-de1259d82ecc None admin] PATH_INFO: `/v3/services` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:04.624241 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf62a9b4-b8bd-4260-a340-de1259d82ecc None admin] RBAC: Adding query filter params (type=network) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:04.624733 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf62a9b4-b8bd-4260-a340-de1259d82ecc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:04.626310 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf62a9b4-b8bd-4260-a340-de1259d82ecc None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:04.631902 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 377/772] 10.222.0.49 () {56 vars in 1112 bytes} [Thu Sep 29 01:59:04 2022] GET /identity/v3/services?type=network => generated 350 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:59:04.637543 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf62a9b4-b8bd-4260-a340-de1259d82ecc None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:04.642711 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:04.679904 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:04.698936 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 396/773] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:59:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 29 01:59:04.700472 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1f1863-4495-4234-bb6a-8c5c8f90a9e0 None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:04.700811 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1f1863-4495-4234-bb6a-8c5c8f90a9e0 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:04.701084 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1f1863-4495-4234-bb6a-8c5c8f90a9e0 None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:04.703340 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 397/774] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:59:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:59:04.708714 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d515b03-92b2-49dd-98c8-5c46633a57b2 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:04.709095 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d515b03-92b2-49dd-98c8-5c46633a57b2 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:04.709453 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d515b03-92b2-49dd-98c8-5c46633a57b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:04.734932 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-4d515b03-92b2-49dd-98c8-5c46633a57b2 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:59:04.736145 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-4d515b03-92b2-49dd-98c8-5c46633a57b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:59:04.779286 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf62a9b4-b8bd-4260-a340-de1259d82ecc None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:04.847322 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e59514b-f202-49e5-923d-86f2b0a30906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:04.847852 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e59514b-f202-49e5-923d-86f2b0a30906 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:04.848123 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e59514b-f202-49e5-923d-86f2b0a30906 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:04.848389 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e59514b-f202-49e5-923d-86f2b0a30906 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:04.849089 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e59514b-f202-49e5-923d-86f2b0a30906 None admin] RBAC: Adding query filter params (interface=public, service_id=2786c8e1417e458f92421e18a78c4757, region_id=RegionOne) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:04.849479 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e59514b-f202-49e5-923d-86f2b0a30906 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:04.850832 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e59514b-f202-49e5-923d-86f2b0a30906 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:04.868936 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 378/775] 10.222.0.49 () {56 vars in 1251 bytes} [Thu Sep 29 01:59:04 2022] GET /identity/v3/endpoints?service_id=2786c8e1417e458f92421e18a78c4757&interface=public®ion_id=RegionOne => generated 194 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:59:04.869215 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 398/776] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:59:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 29 01:59:04.875081 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e59514b-f202-49e5-923d-86f2b0a30906 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:04.944851 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:04.980640 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e59514b-f202-49e5-923d-86f2b0a30906 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:05.020891 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0485aea7-b8a2-427b-a833-f16d4d4fb039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:05.021519 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0485aea7-b8a2-427b-a833-f16d4d4fb039 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:05.021797 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0485aea7-b8a2-427b-a833-f16d4d4fb039 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:05.022062 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0485aea7-b8a2-427b-a833-f16d4d4fb039 None admin] PATH_INFO: `/v3/services` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:05.022663 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0485aea7-b8a2-427b-a833-f16d4d4fb039 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:05.024020 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0485aea7-b8a2-427b-a833-f16d4d4fb039 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:05.033689 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 379/777] 10.222.0.49 () {56 vars in 1087 bytes} [Thu Sep 29 01:59:04 2022] GET /identity/v3/services => generated 772 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:05.040452 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d515b03-92b2-49dd-98c8-5c46633a57b2 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:05.153598 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d515b03-92b2-49dd-98c8-5c46633a57b2 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:05.182076 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:05.202386 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0485aea7-b8a2-427b-a833-f16d4d4fb039 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:05.211862 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7297fe8e-ae63-4ccb-aacc-de4572c642bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:05.211862 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7297fe8e-ae63-4ccb-aacc-de4572c642bc None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:05.211862 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7297fe8e-ae63-4ccb-aacc-de4572c642bc None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:05.211862 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7297fe8e-ae63-4ccb-aacc-de4572c642bc None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:05.212599 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7297fe8e-ae63-4ccb-aacc-de4572c642bc None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:05.212599 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7297fe8e-ae63-4ccb-aacc-de4572c642bc None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:05.229171 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-7297fe8e-ae63-4ccb-aacc-de4572c642bc None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 29 01:59:05.229171 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:05.229171 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 29 01:59:05.229171 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 29 01:59:05.229171 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 29 01:59:05.229171 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 29 01:59:05.229171 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 29 01:59:05.229171 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 29 01:59:05.229171 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 29 01:59:05.229171 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:59:05.229171 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 29 01:59:05.229171 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:59:05.229171 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:05.229171 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:05.229171 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:05.229171 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:05.229171 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:05.230262 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:05.230262 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:05.230262 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:05.230262 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:05.230262 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:05.230262 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:05.230262 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 29 01:59:05.230262 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 29 01:59:05.230262 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 29 01:59:05.230262 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 29 01:59:05.230262 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:05.230262 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:05.230262 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:05.230262 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:05.230262 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:05.230262 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:05.231086 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:05.231086 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:05.231086 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:05.231086 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:05.231086 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:05.231086 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:05.231086 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:05.231086 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:05.231086 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:05.231086 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:05.231086 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 29 01:59:05.231086 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 29 01:59:05.231086 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 29 01:59:05.231086 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:59:05.233808 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 399/778] 10.222.0.49 () {56 vars in 1129 bytes} [Thu Sep 29 01:59:05 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:05.240760 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7297fe8e-ae63-4ccb-aacc-de4572c642bc None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:05.322047 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0485aea7-b8a2-427b-a833-f16d4d4fb039 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:05.357998 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:05.363629 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d8fd22-31ee-4261-a3c5-16e710aaf4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:05.364264 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d8fd22-31ee-4261-a3c5-16e710aaf4a4 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:05.364537 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d8fd22-31ee-4261-a3c5-16e710aaf4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:05.364804 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d8fd22-31ee-4261-a3c5-16e710aaf4a4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:05.377045 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d8fd22-31ee-4261-a3c5-16e710aaf4a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:59:05.383286 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-25d8fd22-31ee-4261-a3c5-16e710aaf4a4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 01:59:05.383286 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:05.383286 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:05.383286 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:05.383286 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:05.383286 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:05.383286 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:05.383286 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:05.383286 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:05.383286 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:05.383286 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:05.383286 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:05.383286 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:59:05.383286 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:59:05.383286 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:59:05.383286 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:59:05.384319 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:59:05.384319 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:59:05.384319 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:59:05.384319 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:59:05.384319 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:05.384319 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:05.384319 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:05.384319 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:05.384319 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:05.384319 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:05.384319 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:05.384319 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:05.384319 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:05.384319 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:05.384319 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:05.384319 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:05.385176 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:05.385176 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:05.385176 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:05.385176 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:05.385176 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:59:05.385176 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:59:05.385176 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:59:05.385176 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:59:05.385176 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:59:05.385176 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:59:05.385176 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 01:59:05.385176 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:59:05.389714 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 380/779] 10.222.0.49 () {56 vars in 1096 bytes} [Thu Sep 29 01:59:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:05.389714 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bfa23e-4a33-4405-9481-3dd0eaac0dcf None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:05.389714 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bfa23e-4a33-4405-9481-3dd0eaac0dcf None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:05.389714 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bfa23e-4a33-4405-9481-3dd0eaac0dcf None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:05.389714 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 381/780] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:59:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:59:05.393816 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bfa23e-4a33-4405-9481-3dd0eaac0dcf None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:05.398504 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7297fe8e-ae63-4ccb-aacc-de4572c642bc None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:05.447442 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b806b534-bea5-406e-8fe9-312b7c4444a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:05.448082 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b806b534-bea5-406e-8fe9-312b7c4444a9 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:05.448425 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b806b534-bea5-406e-8fe9-312b7c4444a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:05.448769 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b806b534-bea5-406e-8fe9-312b7c4444a9 None admin] PATH_INFO: `/v3/services` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:05.449526 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b806b534-bea5-406e-8fe9-312b7c4444a9 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:05.449900 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b806b534-bea5-406e-8fe9-312b7c4444a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:05.451362 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b806b534-bea5-406e-8fe9-312b7c4444a9 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:05.458184 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 400/781] 10.222.0.49 () {56 vars in 1124 bytes} [Thu Sep 29 01:59:05 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:05.464008 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff1042-906a-48d9-a5c6-54754d841fd5 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:05.464299 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff1042-906a-48d9-a5c6-54754d841fd5 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:05.464616 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff1042-906a-48d9-a5c6-54754d841fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:05.493412 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-6dff1042-906a-48d9-a5c6-54754d841fd5 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:59:05.495771 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-6dff1042-906a-48d9-a5c6-54754d841fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:59:05.529167 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bfa23e-4a33-4405-9481-3dd0eaac0dcf None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:05.548453 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:05.566815 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecab7b9-c47b-40fe-a2bd-093f4bdbdde7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:05.567388 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecab7b9-c47b-40fe-a2bd-093f4bdbdde7 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:05.567666 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecab7b9-c47b-40fe-a2bd-093f4bdbdde7 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:05.567937 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecab7b9-c47b-40fe-a2bd-093f4bdbdde7 None admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:05.568677 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecab7b9-c47b-40fe-a2bd-093f4bdbdde7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:05.568978 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecab7b9-c47b-40fe-a2bd-093f4bdbdde7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:05.570523 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecab7b9-c47b-40fe-a2bd-093f4bdbdde7 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:05.581394 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 382/782] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Sep 29 01:59:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:05.582528 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecab7b9-c47b-40fe-a2bd-093f4bdbdde7 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:05.588154 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 401/783] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:59:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 29 01:59:05.589922 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dff1042-906a-48d9-a5c6-54754d841fd5 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:05.691073 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:05.767863 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dff1042-906a-48d9-a5c6-54754d841fd5 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:05.785117 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecab7b9-c47b-40fe-a2bd-093f4bdbdde7 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:05.830918 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf453cc3-52cf-4ff5-a65b-936484890e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:05.832114 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf453cc3-52cf-4ff5-a65b-936484890e45 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:05.833640 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf453cc3-52cf-4ff5-a65b-936484890e45 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:05.834117 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf453cc3-52cf-4ff5-a65b-936484890e45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:05.849958 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf453cc3-52cf-4ff5-a65b-936484890e45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:05.851670 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf453cc3-52cf-4ff5-a65b-936484890e45 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:05.866948 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baccdb43-8aba-4b48-8bd3-fee4cf93f90a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:05.867562 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baccdb43-8aba-4b48-8bd3-fee4cf93f90a None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:05.867839 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baccdb43-8aba-4b48-8bd3-fee4cf93f90a None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:05.868110 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baccdb43-8aba-4b48-8bd3-fee4cf93f90a None admin] PATH_INFO: `/v3/services` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:05.868742 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baccdb43-8aba-4b48-8bd3-fee4cf93f90a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:05.869039 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baccdb43-8aba-4b48-8bd3-fee4cf93f90a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:05.870380 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-bf453cc3-52cf-4ff5-a65b-936484890e45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:05.870380 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:05.870380 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:05.870380 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:05.870380 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:05.870380 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:05.870380 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:05.870380 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:05.870380 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:05.870380 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:05.870380 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:05.870380 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:05.870380 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:59:05.870380 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:59:05.870380 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:59:05.870380 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:59:05.871294 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:05.871294 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:05.871294 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:05.871294 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:05.871294 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:05.871294 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:05.871294 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:05.871294 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:05.871294 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:05.871294 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:05.871294 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:05.871294 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:05.871294 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:05.871294 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:05.871294 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:05.871294 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:05.871294 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:59:05.872166 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:59:05.872166 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:05.872166 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:59:05.872345 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baccdb43-8aba-4b48-8bd3-fee4cf93f90a None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:05.880210 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 402/784] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 01:59:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:05.881705 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf453cc3-52cf-4ff5-a65b-936484890e45 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:05.891850 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 383/785] 10.222.0.49 () {56 vars in 1124 bytes} [Thu Sep 29 01:59:05 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:05.902564 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baccdb43-8aba-4b48-8bd3-fee4cf93f90a None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:05.927771 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:06.035884 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf453cc3-52cf-4ff5-a65b-936484890e45 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:06.049186 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baccdb43-8aba-4b48-8bd3-fee4cf93f90a None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:06.069229 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:06.078182 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c40e00e-e936-40ab-8690-2b82f783b551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:06.079159 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c40e00e-e936-40ab-8690-2b82f783b551 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:06.079445 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c40e00e-e936-40ab-8690-2b82f783b551 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:06.079795 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c40e00e-e936-40ab-8690-2b82f783b551 None admin] PATH_INFO: `/v3/domains` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:06.080367 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c40e00e-e936-40ab-8690-2b82f783b551 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:06.080671 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c40e00e-e936-40ab-8690-2b82f783b551 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:06.082198 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c40e00e-e936-40ab-8690-2b82f783b551 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:06.090135 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafe4aa4-589f-4034-98b3-bee0fe15c7e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:06.091005 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe4aa4-589f-4034-98b3-bee0fe15c7e7 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:06.091482 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe4aa4-589f-4034-98b3-bee0fe15c7e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:06.091966 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe4aa4-589f-4034-98b3-bee0fe15c7e7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:06.092858 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafe4aa4-589f-4034-98b3-bee0fe15c7e7 None admin] RBAC: Adding query filter params (interface=public, service_id=558cfb899e974d16a2cd9ed226aeab88, region_id=RegionOne) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:06.093957 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafe4aa4-589f-4034-98b3-bee0fe15c7e7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:06.095505 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafe4aa4-589f-4034-98b3-bee0fe15c7e7 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:06.100413 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 403/786] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Sep 29 01:59:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:59:06.100413 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c40e00e-e936-40ab-8690-2b82f783b551 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:06.106501 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 384/787] 10.222.0.49 () {56 vars in 1251 bytes} [Thu Sep 29 01:59:05 2022] GET /identity/v3/endpoints?service_id=558cfb899e974d16a2cd9ed226aeab88&interface=public®ion_id=RegionOne => generated 194 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:06.112448 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafe4aa4-589f-4034-98b3-bee0fe15c7e7 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:06.212482 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:06.231982 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c40e00e-e936-40ab-8690-2b82f783b551 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:06.274261 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d95b47c-515d-4597-bb7f-cca527e995e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:06.274902 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d95b47c-515d-4597-bb7f-cca527e995e4 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:06.275183 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d95b47c-515d-4597-bb7f-cca527e995e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:06.275457 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d95b47c-515d-4597-bb7f-cca527e995e4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:06.288137 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d95b47c-515d-4597-bb7f-cca527e995e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:59:06.293921 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-9d95b47c-515d-4597-bb7f-cca527e995e4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 29 01:59:06.293921 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:06.293921 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:06.293921 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:06.293921 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:06.293921 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:06.293921 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:06.293921 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:06.293921 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:06.293921 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:06.293921 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:06.293921 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:06.293921 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:59:06.293921 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:59:06.293921 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:59:06.293921 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:59:06.294853 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:59:06.294853 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:59:06.294853 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:59:06.294853 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:59:06.294853 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:06.294853 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:06.294853 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:06.294853 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:06.294853 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:06.294853 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:06.294853 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:06.294853 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:06.294853 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:06.294853 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:06.294853 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:06.294853 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:06.295703 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:06.295703 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:06.295703 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:06.295703 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:06.295703 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:59:06.295703 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:59:06.295703 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:59:06.295703 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:59:06.295703 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:59:06.295703 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:59:06.295703 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 29 01:59:06.295703 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:59:06.300337 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 404/788] 10.222.0.49 () {56 vars in 1102 bytes} [Thu Sep 29 01:59:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:06.301598 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d95b47c-515d-4597-bb7f-cca527e995e4 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:06.347660 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafe4aa4-589f-4034-98b3-bee0fe15c7e7 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:06.383570 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ae5b7f-2634-41b4-857e-dbae4def4d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:06.384593 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ae5b7f-2634-41b4-857e-dbae4def4d3c None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:06.385070 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ae5b7f-2634-41b4-857e-dbae4def4d3c None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:06.385577 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ae5b7f-2634-41b4-857e-dbae4def4d3c None admin] PATH_INFO: `/v3/users/swift` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:06.394132 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ae5b7f-2634-41b4-857e-dbae4def4d3c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:06.395840 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ae5b7f-2634-41b4-857e-dbae4def4d3c None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:06.407486 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-55ae5b7f-2634-41b4-857e-dbae4def4d3c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 29 01:59:06.407486 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:06.407486 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:06.407486 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:06.407486 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:06.407486 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:06.407486 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:06.407486 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:06.407486 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:06.407486 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:06.407486 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:06.407486 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:06.407486 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 29 01:59:06.407486 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 29 01:59:06.407486 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 29 01:59:06.407486 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 29 01:59:06.408414 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:06.408414 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:06.408414 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 29 01:59:06.408414 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:59:06.408414 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 29 01:59:06.408414 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:59:06.408414 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:06.408414 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:06.408414 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:06.408414 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:06.408414 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:06.408414 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:06.408414 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:06.408414 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:06.408414 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:06.408414 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:06.408414 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:06.408414 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:06.409499 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:06.409499 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:06.409499 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 29 01:59:06.409499 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 29 01:59:06.409499 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 29 01:59:06.409499 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 29 01:59:06.409499 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 29 01:59:06.409499 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 29 01:59:06.409499 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 29 01:59:06.409499 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:59:06.416377 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 385/789] 10.222.0.49 () {56 vars in 1096 bytes} [Thu Sep 29 01:59:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:06.417707 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ae5b7f-2634-41b4-857e-dbae4def4d3c None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:06.419481 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d95b47c-515d-4597-bb7f-cca527e995e4 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:06.460499 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f88c7aa-c1eb-4bc7-97c5-15231a5e25f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:06.460869 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88c7aa-c1eb-4bc7-97c5-15231a5e25f4 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:06.461155 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88c7aa-c1eb-4bc7-97c5-15231a5e25f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:06.461491 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88c7aa-c1eb-4bc7-97c5-15231a5e25f4 None admin] PATH_INFO: `/v3/services` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:06.462107 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f88c7aa-c1eb-4bc7-97c5-15231a5e25f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:06.463698 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f88c7aa-c1eb-4bc7-97c5-15231a5e25f4 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:06.465375 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:06.471443 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 405/790] 10.222.0.49 () {56 vars in 1087 bytes} [Thu Sep 29 01:59:06 2022] GET /identity/v3/services => generated 772 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:06.472437 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f88c7aa-c1eb-4bc7-97c5-15231a5e25f4 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:06.495268 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:06.582327 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ae5b7f-2634-41b4-857e-dbae4def4d3c None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:06.648033 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a9fc05-7310-4718-b245-47d7ea8bbfce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:06.648689 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a9fc05-7310-4718-b245-47d7ea8bbfce None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:06.648973 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a9fc05-7310-4718-b245-47d7ea8bbfce None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:06.649252 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a9fc05-7310-4718-b245-47d7ea8bbfce None admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:06.649985 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a9fc05-7310-4718-b245-47d7ea8bbfce None admin] RBAC: Adding query filter params (name=service) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:06.650289 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a9fc05-7310-4718-b245-47d7ea8bbfce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:06.651841 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a9fc05-7310-4718-b245-47d7ea8bbfce None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:06.665948 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 386/791] 10.222.0.49 () {56 vars in 1103 bytes} [Thu Sep 29 01:59:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:06.675034 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a9fc05-7310-4718-b245-47d7ea8bbfce None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:06.692248 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f88c7aa-c1eb-4bc7-97c5-15231a5e25f4 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:06.745123 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992253fa-4904-4fce-9a52-b43a834f9339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:06.746129 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992253fa-4904-4fce-9a52-b43a834f9339 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:06.746740 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992253fa-4904-4fce-9a52-b43a834f9339 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:06.747322 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992253fa-4904-4fce-9a52-b43a834f9339 None admin] PATH_INFO: `/v3/users` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:06.748285 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992253fa-4904-4fce-9a52-b43a834f9339 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:06.748808 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992253fa-4904-4fce-9a52-b43a834f9339 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:06.751004 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992253fa-4904-4fce-9a52-b43a834f9339 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:06.773207 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 406/792] 10.222.0.49 () {56 vars in 1135 bytes} [Thu Sep 29 01:59:06 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:06.774841 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d29a584-578c-4f2a-b9ab-6669b6c396a2 None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:06.775358 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d29a584-578c-4f2a-b9ab-6669b6c396a2 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:06.775891 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d29a584-578c-4f2a-b9ab-6669b6c396a2 None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:06.777296 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 407/793] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:59:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:59:06.778490 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d29a584-578c-4f2a-b9ab-6669b6c396a2 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:06.794915 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a9fc05-7310-4718-b245-47d7ea8bbfce None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:06.798795 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:06.834562 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db2dafd-4281-4149-9345-c8165786d9fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:06.835030 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db2dafd-4281-4149-9345-c8165786d9fc None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:06.835487 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db2dafd-4281-4149-9345-c8165786d9fc None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:06.835805 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db2dafd-4281-4149-9345-c8165786d9fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:06.847408 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db2dafd-4281-4149-9345-c8165786d9fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:06.848915 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db2dafd-4281-4149-9345-c8165786d9fc None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:06.865119 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:06.866610 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-3db2dafd-4281-4149-9345-c8165786d9fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:06.866610 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:06.866610 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:06.866610 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:06.866610 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:06.866610 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:06.866610 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:06.866610 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:06.866610 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:06.866610 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:06.866610 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:06.866610 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:06.866610 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:59:06.866610 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:59:06.866610 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:59:06.866610 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:59:06.867529 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:06.867529 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:06.867529 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:06.867529 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:06.867529 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:06.867529 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:06.867529 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:06.867529 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:06.867529 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:06.867529 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:06.867529 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:06.867529 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:06.867529 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:06.867529 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:06.867529 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:06.867529 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:06.867529 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:59:06.868391 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:59:06.868391 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:06.868391 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:59:06.868391 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 387/794] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 01:59:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 01:59:06.869180 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9afc44-0896-4bbc-b06f-d5dc2af9edd8 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:06.873547 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9afc44-0896-4bbc-b06f-d5dc2af9edd8 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:06.875888 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9afc44-0896-4bbc-b06f-d5dc2af9edd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:06.900958 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-7f9afc44-0896-4bbc-b06f-d5dc2af9edd8 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:59:06.902413 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-7f9afc44-0896-4bbc-b06f-d5dc2af9edd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:59:06.915818 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d29a584-578c-4f2a-b9ab-6669b6c396a2 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:06.959365 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482974a4-93b7-40ec-87d2-35c0ba7cbc8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:06.960241 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482974a4-93b7-40ec-87d2-35c0ba7cbc8d None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:06.960858 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482974a4-93b7-40ec-87d2-35c0ba7cbc8d None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:06.961265 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482974a4-93b7-40ec-87d2-35c0ba7cbc8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:06.974910 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482974a4-93b7-40ec-87d2-35c0ba7cbc8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:06.977358 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482974a4-93b7-40ec-87d2-35c0ba7cbc8d None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:06.990442 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 388/795] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:59:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 29 01:59:06.990442 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9afc44-0896-4bbc-b06f-d5dc2af9edd8 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:07.007514 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-482974a4-93b7-40ec-87d2-35c0ba7cbc8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:07.007514 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:07.007514 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:07.007514 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:07.007514 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:07.007514 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:07.007514 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:07.007514 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:07.007514 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:07.007514 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:07.007514 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:07.007514 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:07.007514 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:59:07.007514 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:59:07.007514 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:59:07.007514 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:59:07.008713 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:07.008713 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:07.008713 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:07.008713 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:07.008713 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:07.008713 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:07.008713 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:07.008713 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:07.008713 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:07.008713 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:07.008713 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:07.008713 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:07.008713 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:07.008713 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:07.008713 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:07.008713 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:07.008713 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:59:07.009842 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:59:07.009842 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:07.009842 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:59:07.021343 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 408/796] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 01:59:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 01:59:07.021343 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482974a4-93b7-40ec-87d2-35c0ba7cbc8d None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:07.153457 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:07.172819 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9afc44-0896-4bbc-b06f-d5dc2af9edd8 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:07.191264 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482974a4-93b7-40ec-87d2-35c0ba7cbc8d None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:07.212627 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:07.215742 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1ac877-ea41-4e0d-97e5-b552b5fabc8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:07.216935 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1ac877-ea41-4e0d-97e5-b552b5fabc8b None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:07.217756 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1ac877-ea41-4e0d-97e5-b552b5fabc8b None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:07.218572 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1ac877-ea41-4e0d-97e5-b552b5fabc8b None admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:07.219872 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1ac877-ea41-4e0d-97e5-b552b5fabc8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:07.220207 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1ac877-ea41-4e0d-97e5-b552b5fabc8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:07.221818 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1ac877-ea41-4e0d-97e5-b552b5fabc8b None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:07.229354 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc394a5-d984-4c02-80c7-7a1d8486e62e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:07.230265 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc394a5-d984-4c02-80c7-7a1d8486e62e None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:07.230648 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc394a5-d984-4c02-80c7-7a1d8486e62e None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:07.231024 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc394a5-d984-4c02-80c7-7a1d8486e62e None admin] PATH_INFO: `/v3/domains` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:07.231854 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc394a5-d984-4c02-80c7-7a1d8486e62e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:07.232319 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc394a5-d984-4c02-80c7-7a1d8486e62e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:07.234027 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc394a5-d984-4c02-80c7-7a1d8486e62e None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:07.236270 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 389/797] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Sep 29 01:59:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:07.241829 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1ac877-ea41-4e0d-97e5-b552b5fabc8b None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:07.256790 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 409/798] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Sep 29 01:59:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:07.262550 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc394a5-d984-4c02-80c7-7a1d8486e62e None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:07.363502 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1ac877-ea41-4e0d-97e5-b552b5fabc8b None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:07.397423 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc394a5-d984-4c02-80c7-7a1d8486e62e None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:07.400051 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e2f059-8c3f-4445-b01e-95aa9b56a6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:07.401049 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2f059-8c3f-4445-b01e-95aa9b56a6dd None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:07.401049 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2f059-8c3f-4445-b01e-95aa9b56a6dd None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:07.401231 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2f059-8c3f-4445-b01e-95aa9b56a6dd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:07.410449 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e2f059-8c3f-4445-b01e-95aa9b56a6dd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:07.411835 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e2f059-8c3f-4445-b01e-95aa9b56a6dd None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:07.425379 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-29e2f059-8c3f-4445-b01e-95aa9b56a6dd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 29 01:59:07.425379 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:07.425379 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:07.425379 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:07.425379 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:07.425379 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:07.425379 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:07.425379 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:07.425379 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:07.425379 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:07.425379 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:07.425379 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:07.425379 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 29 01:59:07.425379 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 29 01:59:07.425379 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 29 01:59:07.425379 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 29 01:59:07.426379 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:07.426379 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:07.426379 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 29 01:59:07.426379 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:59:07.426379 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 29 01:59:07.426379 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:59:07.426379 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:07.426379 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:07.426379 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:07.426379 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:07.426379 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:07.426379 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:07.426379 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:07.426379 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:07.426379 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:07.426379 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:07.426379 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:07.426379 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:07.427313 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:07.427313 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:07.427313 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 29 01:59:07.427313 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 29 01:59:07.427313 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 29 01:59:07.427313 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 29 01:59:07.427313 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 29 01:59:07.427313 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 29 01:59:07.427313 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 29 01:59:07.427313 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:59:07.429391 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 390/799] 10.222.0.49 () {56 vars in 1117 bytes} [Thu Sep 29 01:59:07 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 01:59:07.430404 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e2f059-8c3f-4445-b01e-95aa9b56a6dd None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:07.444503 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37350d29-fa1d-4e62-a143-e5d06e84b819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:07.446221 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37350d29-fa1d-4e62-a143-e5d06e84b819 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:07.447018 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37350d29-fa1d-4e62-a143-e5d06e84b819 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:07.447490 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37350d29-fa1d-4e62-a143-e5d06e84b819 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:07.457186 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37350d29-fa1d-4e62-a143-e5d06e84b819 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:07.459951 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37350d29-fa1d-4e62-a143-e5d06e84b819 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:07.477202 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-37350d29-fa1d-4e62-a143-e5d06e84b819 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:59:07.477202 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:07.477202 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:07.477202 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:07.477202 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:07.477202 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:07.477202 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:07.477202 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:07.477202 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:07.477202 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:07.477202 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:07.477202 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:07.477202 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 29 01:59:07.477202 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 29 01:59:07.477202 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 29 01:59:07.478180 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 29 01:59:07.478180 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:07.478180 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:07.478180 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:07.478180 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:07.478180 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:07.478180 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:07.478180 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:07.478180 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:07.478180 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:07.478180 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:07.478180 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:07.478180 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:07.478180 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:07.478180 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:07.478180 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:07.478180 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:07.479068 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 29 01:59:07.479068 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 29 01:59:07.479068 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 29 01:59:07.479068 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 29 01:59:07.479068 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 29 01:59:07.479068 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 29 01:59:07.479068 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:59:07.479068 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:59:07.482250 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 410/800] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Sep 29 01:59:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:07.484587 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37350d29-fa1d-4e62-a143-e5d06e84b819 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:07.489713 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:07.532530 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:07.558981 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e2f059-8c3f-4445-b01e-95aa9b56a6dd None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:07.597036 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37350d29-fa1d-4e62-a143-e5d06e84b819 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:07.597671 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1302330-3f4b-4c04-9ef7-42dedcddcac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:07.598398 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1302330-3f4b-4c04-9ef7-42dedcddcac3 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:07.598684 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1302330-3f4b-4c04-9ef7-42dedcddcac3 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:07.598958 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1302330-3f4b-4c04-9ef7-42dedcddcac3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:07.611040 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1302330-3f4b-4c04-9ef7-42dedcddcac3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:59:07.616580 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-b1302330-3f4b-4c04-9ef7-42dedcddcac3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 01:59:07.616580 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:07.616580 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:07.616580 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:07.616580 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:07.616580 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:07.616580 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:07.616580 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:07.616580 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:07.616580 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:07.616580 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:07.616580 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:07.616580 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:59:07.616580 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:59:07.616580 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:59:07.616580 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:59:07.617774 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:59:07.617774 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:59:07.617774 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:59:07.617774 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:59:07.617774 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:07.617774 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:07.617774 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:07.617774 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:07.617774 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:07.617774 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:07.617774 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:07.617774 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:07.617774 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:07.617774 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:07.617774 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:07.617774 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:07.618602 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:07.618602 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:07.618602 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:07.618602 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:07.618602 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:59:07.618602 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:59:07.618602 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:59:07.618602 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:59:07.618602 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:59:07.618602 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:59:07.618602 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 01:59:07.618602 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:59:07.618602 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 391/801] 10.222.0.49 () {56 vars in 1096 bytes} [Thu Sep 29 01:59:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:07.618602 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1302330-3f4b-4c04-9ef7-42dedcddcac3 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:07.646128 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473a6bd2-bb76-4305-be89-5f94bd76a8df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:07.647351 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473a6bd2-bb76-4305-be89-5f94bd76a8df None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:07.647635 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473a6bd2-bb76-4305-be89-5f94bd76a8df None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:07.647909 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473a6bd2-bb76-4305-be89-5f94bd76a8df None admin] PATH_INFO: `/v3/users` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:07.648644 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473a6bd2-bb76-4305-be89-5f94bd76a8df None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:07.648948 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473a6bd2-bb76-4305-be89-5f94bd76a8df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:07.650427 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473a6bd2-bb76-4305-be89-5f94bd76a8df None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:07.673905 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 411/802] 10.222.0.49 () {56 vars in 1149 bytes} [Thu Sep 29 01:59:07 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:07.675338 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e0fade-2a56-41d0-a742-be2630d0ac6c None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:07.675712 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e0fade-2a56-41d0-a742-be2630d0ac6c None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:07.676076 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e0fade-2a56-41d0-a742-be2630d0ac6c None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:07.678142 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 412/803] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:59:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:59:07.679204 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e0fade-2a56-41d0-a742-be2630d0ac6c None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:07.692489 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:07.731153 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1302330-3f4b-4c04-9ef7-42dedcddcac3 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:07.767089 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2afe9f2-9ab4-46a8-a86b-d9f58363734a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:07.767701 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2afe9f2-9ab4-46a8-a86b-d9f58363734a None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:07.767992 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2afe9f2-9ab4-46a8-a86b-d9f58363734a None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:07.768260 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2afe9f2-9ab4-46a8-a86b-d9f58363734a None admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:07.768952 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2afe9f2-9ab4-46a8-a86b-d9f58363734a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:07.769259 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2afe9f2-9ab4-46a8-a86b-d9f58363734a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:07.770709 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2afe9f2-9ab4-46a8-a86b-d9f58363734a None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:07.783260 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 392/804] 10.222.0.49 () {56 vars in 1148 bytes} [Thu Sep 29 01:59:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:07.786182 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2afe9f2-9ab4-46a8-a86b-d9f58363734a None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:07.795930 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:07.802999 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e0fade-2a56-41d0-a742-be2630d0ac6c None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:07.838330 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5429ba-ecdb-41d8-9eac-e50c037cb33e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:07.838941 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5429ba-ecdb-41d8-9eac-e50c037cb33e None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:07.839203 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5429ba-ecdb-41d8-9eac-e50c037cb33e None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:07.839471 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5429ba-ecdb-41d8-9eac-e50c037cb33e None admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:07.840122 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5429ba-ecdb-41d8-9eac-e50c037cb33e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:07.840420 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5429ba-ecdb-41d8-9eac-e50c037cb33e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:07.842047 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5429ba-ecdb-41d8-9eac-e50c037cb33e None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:07.854988 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 413/805] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Sep 29 01:59:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:07.854988 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10e9dcc-7ff1-4e07-a574-17c7df987bfc None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:07.854988 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10e9dcc-7ff1-4e07-a574-17c7df987bfc None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:07.854988 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10e9dcc-7ff1-4e07-a574-17c7df987bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:07.871227 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-b10e9dcc-7ff1-4e07-a574-17c7df987bfc None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:59:07.872608 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-b10e9dcc-7ff1-4e07-a574-17c7df987bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:59:07.897495 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2afe9f2-9ab4-46a8-a86b-d9f58363734a None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:07.926344 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:07.937337 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea88f70-7f70-458c-835b-c5368b3fa013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:07.938113 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea88f70-7f70-458c-835b-c5368b3fa013 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:07.938394 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea88f70-7f70-458c-835b-c5368b3fa013 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:07.938666 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea88f70-7f70-458c-835b-c5368b3fa013 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:07.950083 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea88f70-7f70-458c-835b-c5368b3fa013 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:07.951780 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea88f70-7f70-458c-835b-c5368b3fa013 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:07.951897 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 414/806] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:59:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 29 01:59:07.952630 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10e9dcc-7ff1-4e07-a574-17c7df987bfc None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:07.979350 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-aea88f70-7f70-458c-835b-c5368b3fa013 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:07.979350 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:07.979350 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:07.979350 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:07.979350 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:07.979350 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:07.979350 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:07.979350 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:07.979350 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:07.979350 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:07.979350 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:07.979350 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:07.979350 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:59:07.979350 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:59:07.979350 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:59:07.979350 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:59:07.980556 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:07.980556 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:07.980556 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:07.980556 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:07.980556 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:07.980556 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:07.980556 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:07.980556 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:07.980556 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:07.980556 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:07.980556 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:07.980556 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:07.980556 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:07.980556 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:07.980556 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:07.980556 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:07.980556 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:59:07.981676 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:59:07.981676 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:07.981676 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:59:07.984082 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 393/807] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 01:59:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:07.985271 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea88f70-7f70-458c-835b-c5368b3fa013 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:08.067670 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:08.080879 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10e9dcc-7ff1-4e07-a574-17c7df987bfc None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:08.106144 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea88f70-7f70-458c-835b-c5368b3fa013 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:08.130633 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9d338c-d5f7-4866-a11d-8af9e7d69674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:08.131428 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9d338c-d5f7-4866-a11d-8af9e7d69674 None admin] REQUEST_METHOD: `PUT` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:08.131806 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9d338c-d5f7-4866-a11d-8af9e7d69674 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:08.132440 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9d338c-d5f7-4866-a11d-8af9e7d69674 None admin] PATH_INFO: `/v3/projects/6f1d8fd250c84c5887cb3173053ea2dd/users/c88bc0f32600416ca7c6a59f4196e497/roles/fe9bbc67742f4f5893f39b18eb31d59a` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:08.135132 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9d338c-d5f7-4866-a11d-8af9e7d69674 None admin] RBAC: Authorizing `identity:create_grant(project_id=6f1d8fd250c84c5887cb3173053ea2dd, user_id=c88bc0f32600416ca7c6a59f4196e497, role_id=fe9bbc67742f4f5893f39b18eb31d59a)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:08.137162 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9d338c-d5f7-4866-a11d-8af9e7d69674 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:08.148675 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bf58e3-a19c-4b24-a36f-cf5b55c19db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:08.149318 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bf58e3-a19c-4b24-a36f-cf5b55c19db0 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:08.149630 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bf58e3-a19c-4b24-a36f-cf5b55c19db0 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:08.149886 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bf58e3-a19c-4b24-a36f-cf5b55c19db0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:08.157862 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 415/808] 10.222.0.49 () {58 vars in 1439 bytes} [Thu Sep 29 01:59:07 2022] PUT /identity/v3/projects/6f1d8fd250c84c5887cb3173053ea2dd/users/c88bc0f32600416ca7c6a59f4196e497/roles/fe9bbc67742f4f5893f39b18eb31d59a => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 01:59:08.158820 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9d338c-d5f7-4866-a11d-8af9e7d69674 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:08.169295 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bf58e3-a19c-4b24-a36f-cf5b55c19db0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:08.172014 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bf58e3-a19c-4b24-a36f-cf5b55c19db0 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:08.193461 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-f1bf58e3-a19c-4b24-a36f-cf5b55c19db0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:08.193461 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:08.193461 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:08.193461 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:08.193461 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:08.193461 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:08.193461 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:08.193461 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:08.193461 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:08.193461 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:08.193461 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:08.193461 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:08.193461 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:59:08.193461 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:59:08.193461 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:59:08.193461 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:59:08.194455 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:08.194455 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:08.194455 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:08.194455 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:08.194455 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:08.194455 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:08.194455 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:08.194455 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:08.194455 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:08.194455 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:08.194455 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:08.194455 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:08.194455 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:08.194455 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:08.194455 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:08.194455 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:08.194455 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:59:08.195416 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:59:08.195416 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:08.195416 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:59:08.195416 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 394/809] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 01:59:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:08.200452 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bf58e3-a19c-4b24-a36f-cf5b55c19db0 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:08.236580 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:08.302370 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9d338c-d5f7-4866-a11d-8af9e7d69674 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:08.337734 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bf58e3-a19c-4b24-a36f-cf5b55c19db0 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:08.351577 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83ef228-994a-459e-b403-822d7f499907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:08.352835 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ef228-994a-459e-b403-822d7f499907 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:08.353335 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ef228-994a-459e-b403-822d7f499907 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:08.354092 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ef228-994a-459e-b403-822d7f499907 None admin] PATH_INFO: `/v3/domains` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:08.355531 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83ef228-994a-459e-b403-822d7f499907 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:08.356056 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83ef228-994a-459e-b403-822d7f499907 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:08.358199 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83ef228-994a-459e-b403-822d7f499907 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:08.381821 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 416/810] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Sep 29 01:59:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:08.382533 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83ef228-994a-459e-b403-822d7f499907 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:08.386737 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88127005-9903-4de5-9562-df59e0274d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:08.387357 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88127005-9903-4de5-9562-df59e0274d24 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:08.387631 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88127005-9903-4de5-9562-df59e0274d24 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:08.387900 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88127005-9903-4de5-9562-df59e0274d24 None admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:08.389187 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88127005-9903-4de5-9562-df59e0274d24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:08.389187 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88127005-9903-4de5-9562-df59e0274d24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:08.390955 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88127005-9903-4de5-9562-df59e0274d24 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:08.400237 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:08.410081 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 395/811] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Sep 29 01:59:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:08.412864 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88127005-9903-4de5-9562-df59e0274d24 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:08.520321 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:08.523308 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83ef228-994a-459e-b403-822d7f499907 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:08.534215 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88127005-9903-4de5-9562-df59e0274d24 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:08.561898 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb946b0b-5bb1-49a7-b120-09e13c292543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:08.563403 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb946b0b-5bb1-49a7-b120-09e13c292543 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:08.564111 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb946b0b-5bb1-49a7-b120-09e13c292543 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:08.564576 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb946b0b-5bb1-49a7-b120-09e13c292543 None admin] PATH_INFO: `/v3/services/network` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:08.565619 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb946b0b-5bb1-49a7-b120-09e13c292543 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:08.567274 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb946b0b-5bb1-49a7-b120-09e13c292543 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:08.579252 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-bb946b0b-5bb1-49a7-b120-09e13c292543 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 29 01:59:08.579252 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:08.579252 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 29 01:59:08.579252 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 29 01:59:08.579252 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 29 01:59:08.579252 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 29 01:59:08.579252 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 29 01:59:08.579252 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 29 01:59:08.579252 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 29 01:59:08.579252 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:59:08.579252 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 29 01:59:08.579252 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:59:08.579252 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:08.579252 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:08.579252 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:08.579252 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:08.579252 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:08.580282 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:08.580282 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:08.580282 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:08.580282 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:08.580282 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:08.580282 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:08.580282 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 29 01:59:08.580282 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 29 01:59:08.580282 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 29 01:59:08.580282 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 29 01:59:08.580282 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:08.580282 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:08.580282 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:08.580282 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:08.580282 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:08.580282 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:08.581103 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:08.581103 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:08.581103 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:08.581103 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:08.581103 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:08.581103 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:08.581103 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:08.581103 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:08.581103 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:08.581103 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:08.581103 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 29 01:59:08.581103 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 29 01:59:08.581103 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 29 01:59:08.581103 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:59:08.581849 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d67a45-697a-4695-bea8-207e927750e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:08.581849 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d67a45-697a-4695-bea8-207e927750e9 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:08.581849 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d67a45-697a-4695-bea8-207e927750e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:08.581849 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d67a45-697a-4695-bea8-207e927750e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:08.582775 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 417/812] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Sep 29 01:59:08 2022] GET /identity/v3/services/network => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:08.586079 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb946b0b-5bb1-49a7-b120-09e13c292543 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:08.595644 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d67a45-697a-4695-bea8-207e927750e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:08.597102 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d67a45-697a-4695-bea8-207e927750e9 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:08.613418 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-31d67a45-697a-4695-bea8-207e927750e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:59:08.613418 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:08.613418 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:08.613418 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:08.613418 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:08.613418 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:08.613418 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:08.613418 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:08.613418 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:08.613418 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:08.613418 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:08.613418 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:08.613418 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 29 01:59:08.613418 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 29 01:59:08.613418 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 29 01:59:08.614321 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 29 01:59:08.614321 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:08.614321 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:08.614321 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:08.614321 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:08.614321 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:08.614321 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:08.614321 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:08.614321 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:08.614321 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:08.614321 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:08.614321 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:08.614321 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:08.614321 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:08.614321 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:08.614321 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:08.614321 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:08.615197 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 29 01:59:08.615197 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 29 01:59:08.615197 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 29 01:59:08.615197 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 29 01:59:08.615197 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 29 01:59:08.615197 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 29 01:59:08.615197 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:59:08.615197 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:59:08.615197 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 396/813] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Sep 29 01:59:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:08.615694 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d67a45-697a-4695-bea8-207e927750e9 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:08.687619 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:08.714824 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb946b0b-5bb1-49a7-b120-09e13c292543 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:08.747582 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d67a45-697a-4695-bea8-207e927750e9 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:08.761330 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315841ba-009f-422b-a16d-9ee1f284e794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:08.762045 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315841ba-009f-422b-a16d-9ee1f284e794 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:08.762389 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315841ba-009f-422b-a16d-9ee1f284e794 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:08.762598 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315841ba-009f-422b-a16d-9ee1f284e794 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:08.771124 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315841ba-009f-422b-a16d-9ee1f284e794 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:08.772690 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315841ba-009f-422b-a16d-9ee1f284e794 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:08.785808 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-315841ba-009f-422b-a16d-9ee1f284e794 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 29 01:59:08.785808 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:08.785808 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:08.785808 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:08.785808 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:08.785808 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:08.785808 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:08.785808 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:08.785808 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:08.785808 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:08.785808 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:08.785808 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:08.785808 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 29 01:59:08.785808 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 29 01:59:08.785808 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 29 01:59:08.785808 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 29 01:59:08.786746 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:08.786746 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:08.786746 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 29 01:59:08.786746 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:59:08.786746 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 29 01:59:08.786746 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:59:08.786746 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:08.786746 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:08.786746 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:08.786746 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:08.786746 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:08.786746 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:08.786746 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:08.786746 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:08.786746 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:08.786746 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:08.786746 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:08.786746 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:08.787682 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:08.787682 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:08.787682 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 29 01:59:08.787682 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 29 01:59:08.787682 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 29 01:59:08.787682 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 29 01:59:08.787682 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 29 01:59:08.787682 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 29 01:59:08.787682 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 29 01:59:08.787682 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:59:08.787682 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 418/814] 10.222.0.49 () {56 vars in 1093 bytes} [Thu Sep 29 01:59:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:08.788273 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315841ba-009f-422b-a16d-9ee1f284e794 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:08.790574 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4e45b5-92c6-4077-927f-ac038610098b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:08.791354 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4e45b5-92c6-4077-927f-ac038610098b None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:08.792000 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4e45b5-92c6-4077-927f-ac038610098b None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:08.792388 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4e45b5-92c6-4077-927f-ac038610098b None admin] PATH_INFO: `/v3/services` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:08.793153 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4e45b5-92c6-4077-927f-ac038610098b None admin] RBAC: Adding query filter params (name=network) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:08.793848 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4e45b5-92c6-4077-927f-ac038610098b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:08.795337 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4e45b5-92c6-4077-927f-ac038610098b None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:08.800920 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 397/815] 10.222.0.49 () {56 vars in 1112 bytes} [Thu Sep 29 01:59:08 2022] GET /identity/v3/services?name=network => generated 124 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:08.802044 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4e45b5-92c6-4077-927f-ac038610098b None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:08.822591 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:08.915824 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315841ba-009f-422b-a16d-9ee1f284e794 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:08.924073 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4e45b5-92c6-4077-927f-ac038610098b None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:08.953176 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bc11e1-71be-4a9f-8db6-69f3cb321f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:08.953810 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc11e1-71be-4a9f-8db6-69f3cb321f3f None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:08.954093 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc11e1-71be-4a9f-8db6-69f3cb321f3f None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:08.954361 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc11e1-71be-4a9f-8db6-69f3cb321f3f None admin] PATH_INFO: `/v3/projects` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:08.955077 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bc11e1-71be-4a9f-8db6-69f3cb321f3f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:08.955377 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bc11e1-71be-4a9f-8db6-69f3cb321f3f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:08.956802 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bc11e1-71be-4a9f-8db6-69f3cb321f3f None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:08.958513 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:08.959884 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83000fea-1868-4b67-9554-9ec5bdc9c150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:08.960573 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83000fea-1868-4b67-9554-9ec5bdc9c150 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:08.960916 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83000fea-1868-4b67-9554-9ec5bdc9c150 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:08.961183 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83000fea-1868-4b67-9554-9ec5bdc9c150 None admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:08.961960 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83000fea-1868-4b67-9554-9ec5bdc9c150 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:08.962257 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83000fea-1868-4b67-9554-9ec5bdc9c150 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:08.963648 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83000fea-1868-4b67-9554-9ec5bdc9c150 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:08.976120 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 419/816] 10.222.0.49 () {56 vars in 1148 bytes} [Thu Sep 29 01:59:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:08.977018 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bc11e1-71be-4a9f-8db6-69f3cb321f3f None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:08.989267 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 398/817] 10.222.0.49 () {56 vars in 1133 bytes} [Thu Sep 29 01:59:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:08.989267 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb09dae-a0ca-4820-8c1a-5b44a3e821cf None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:08.989267 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb09dae-a0ca-4820-8c1a-5b44a3e821cf None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:08.989267 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb09dae-a0ca-4820-8c1a-5b44a3e821cf None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:08.989646 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 399/818] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:59:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:59:08.990152 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb09dae-a0ca-4820-8c1a-5b44a3e821cf None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:09.071475 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:09.085506 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bc11e1-71be-4a9f-8db6-69f3cb321f3f None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:09.105775 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb09dae-a0ca-4820-8c1a-5b44a3e821cf None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:09.121262 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f387bc2c-c9af-4879-a0e1-8cff242bcbf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:09.121895 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f387bc2c-c9af-4879-a0e1-8cff242bcbf6 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:09.122176 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f387bc2c-c9af-4879-a0e1-8cff242bcbf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:09.122451 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f387bc2c-c9af-4879-a0e1-8cff242bcbf6 None admin] PATH_INFO: `/v3/services` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:09.123076 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f387bc2c-c9af-4879-a0e1-8cff242bcbf6 None admin] RBAC: Adding query filter params (type=network) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:09.123378 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f387bc2c-c9af-4879-a0e1-8cff242bcbf6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:09.124799 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f387bc2c-c9af-4879-a0e1-8cff242bcbf6 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:09.130243 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 420/819] 10.222.0.49 () {56 vars in 1112 bytes} [Thu Sep 29 01:59:08 2022] GET /identity/v3/services?type=network => generated 350 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:09.130861 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f387bc2c-c9af-4879-a0e1-8cff242bcbf6 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:09.147437 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0747709f-5a4a-4f52-9dd8-2710d89b92e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:09.148094 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0747709f-5a4a-4f52-9dd8-2710d89b92e7 None admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:09.148370 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0747709f-5a4a-4f52-9dd8-2710d89b92e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:09.148637 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0747709f-5a4a-4f52-9dd8-2710d89b92e7 None admin] PATH_INFO: `/v3/projects/6f1d8fd250c84c5887cb3173053ea2dd/users/0f8f13f302de4701a7f4e0562bca08cf/roles/393e6032e5cc4678b8351026fe4434f8` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:09.163318 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0747709f-5a4a-4f52-9dd8-2710d89b92e7 None admin] RBAC: Authorizing `identity:create_grant(project_id=6f1d8fd250c84c5887cb3173053ea2dd, user_id=0f8f13f302de4701a7f4e0562bca08cf, role_id=393e6032e5cc4678b8351026fe4434f8)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:09.164771 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0747709f-5a4a-4f52-9dd8-2710d89b92e7 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:09.180069 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 400/820] 10.222.0.49 () {58 vars in 1439 bytes} [Thu Sep 29 01:59:08 2022] PUT /identity/v3/projects/6f1d8fd250c84c5887cb3173053ea2dd/users/0f8f13f302de4701a7f4e0562bca08cf/roles/393e6032e5cc4678b8351026fe4434f8 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 01:59:09.181468 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4846871a-4ad9-49e5-9b8b-53b1b53d386f None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:09.181751 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4846871a-4ad9-49e5-9b8b-53b1b53d386f None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:09.182017 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4846871a-4ad9-49e5-9b8b-53b1b53d386f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:09.202162 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-4846871a-4ad9-49e5-9b8b-53b1b53d386f None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:59:09.204405 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-4846871a-4ad9-49e5-9b8b-53b1b53d386f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:59:09.206606 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:09.261791 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f387bc2c-c9af-4879-a0e1-8cff242bcbf6 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:09.304328 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94a1540-0ccb-4144-b294-1f71f44cebfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:09.304950 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a1540-0ccb-4144-b294-1f71f44cebfd None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:09.305230 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a1540-0ccb-4144-b294-1f71f44cebfd None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:09.305548 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a1540-0ccb-4144-b294-1f71f44cebfd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:09.308594 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 401/821] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:59:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 29 01:59:09.310819 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4846871a-4ad9-49e5-9b8b-53b1b53d386f None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:09.401829 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:09.412792 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94a1540-0ccb-4144-b294-1f71f44cebfd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:09.414400 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94a1540-0ccb-4144-b294-1f71f44cebfd None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:09.476024 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4846871a-4ad9-49e5-9b8b-53b1b53d386f None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:09.490922 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:09.518049 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0609eecd-3663-412c-9532-add729f9e62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:09.519090 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0609eecd-3663-412c-9532-add729f9e62d None admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:09.519575 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0609eecd-3663-412c-9532-add729f9e62d None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:09.520071 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0609eecd-3663-412c-9532-add729f9e62d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:09.521113 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0609eecd-3663-412c-9532-add729f9e62d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:09.522880 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0609eecd-3663-412c-9532-add729f9e62d None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:09.560899 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 402/822] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 01:59:09 2022] POST /identity/v3/endpoints => generated 337 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 01:59:09.567175 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 421/823] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Sep 29 01:59:09 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 29 01:59:09.577544 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0609eecd-3663-412c-9532-add729f9e62d None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:09.643362 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94a1540-0ccb-4144-b294-1f71f44cebfd None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:09.782385 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0609eecd-3663-412c-9532-add729f9e62d None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:09.786053 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:09.796961 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94a1540-0ccb-4144-b294-1f71f44cebfd None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:09.838395 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43356554-bf70-455d-a14e-c948ed4af712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:09.839065 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43356554-bf70-455d-a14e-c948ed4af712 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:09.839345 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43356554-bf70-455d-a14e-c948ed4af712 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:09.839613 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43356554-bf70-455d-a14e-c948ed4af712 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:09.840199 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43356554-bf70-455d-a14e-c948ed4af712 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:09.841601 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43356554-bf70-455d-a14e-c948ed4af712 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:09.850922 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-43356554-bf70-455d-a14e-c948ed4af712 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 29 01:59:09.850922 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:09.850922 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 29 01:59:09.850922 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 29 01:59:09.850922 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 29 01:59:09.850922 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 29 01:59:09.850922 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 29 01:59:09.850922 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 29 01:59:09.850922 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 29 01:59:09.850922 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:59:09.850922 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 29 01:59:09.850922 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:59:09.850922 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:09.850922 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:09.850922 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:09.850922 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:09.850922 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:09.851961 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:09.851961 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:09.851961 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:09.851961 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:09.851961 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:09.851961 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:09.851961 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 29 01:59:09.851961 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 29 01:59:09.851961 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 29 01:59:09.851961 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 29 01:59:09.851961 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:09.851961 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:09.851961 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:09.851961 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:09.851961 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:09.851961 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:09.852796 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:09.852796 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:09.852796 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:09.852796 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:09.852796 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:09.852796 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:09.852796 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:09.852796 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:09.852796 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:09.852796 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:09.852796 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 29 01:59:09.852796 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 29 01:59:09.852796 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 29 01:59:09.852796 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:59:09.852796 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 422/824] 10.222.0.49 () {56 vars in 1129 bytes} [Thu Sep 29 01:59:09 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 01:59:09.854170 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e64c691-fe40-42b3-83a2-22749cbf3619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:09.854802 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e64c691-fe40-42b3-83a2-22749cbf3619 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:09.855109 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e64c691-fe40-42b3-83a2-22749cbf3619 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:09.855367 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e64c691-fe40-42b3-83a2-22749cbf3619 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:09.860911 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43356554-bf70-455d-a14e-c948ed4af712 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:09.868852 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e64c691-fe40-42b3-83a2-22749cbf3619 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:09.870754 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e64c691-fe40-42b3-83a2-22749cbf3619 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:09.887348 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-0e64c691-fe40-42b3-83a2-22749cbf3619 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:09.887348 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:09.887348 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:09.887348 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:09.887348 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:09.887348 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:09.887348 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:09.887348 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:09.887348 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:09.887348 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:09.887348 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:09.887348 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:09.887348 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:59:09.887348 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:59:09.887348 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:59:09.887348 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:59:09.888557 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:09.888557 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:09.888557 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:09.888557 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:09.888557 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:09.888557 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:09.888557 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:09.888557 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:09.888557 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:09.888557 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:09.888557 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:09.888557 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:09.888557 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:09.888557 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:09.888557 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:09.888557 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:09.888557 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:59:09.890735 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:59:09.890735 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:09.890735 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:59:09.890735 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 403/825] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 01:59:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:09.898869 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:09.900763 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e64c691-fe40-42b3-83a2-22749cbf3619 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:10.004676 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43356554-bf70-455d-a14e-c948ed4af712 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:10.048696 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e64c691-fe40-42b3-83a2-22749cbf3619 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:10.052048 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef495a46-2582-4167-9812-a0d33416ca33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:10.052669 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef495a46-2582-4167-9812-a0d33416ca33 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:10.053937 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef495a46-2582-4167-9812-a0d33416ca33 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:10.054216 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef495a46-2582-4167-9812-a0d33416ca33 None admin] PATH_INFO: `/v3/services` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:10.054853 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef495a46-2582-4167-9812-a0d33416ca33 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:10.055155 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef495a46-2582-4167-9812-a0d33416ca33 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:10.056535 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef495a46-2582-4167-9812-a0d33416ca33 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:10.062896 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 423/826] 10.222.0.49 () {56 vars in 1124 bytes} [Thu Sep 29 01:59:09 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:59:10.068529 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef495a46-2582-4167-9812-a0d33416ca33 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:10.093459 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924b9285-6c18-4fd0-b6c1-a9e887ac6d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:10.094411 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924b9285-6c18-4fd0-b6c1-a9e887ac6d96 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:10.094837 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924b9285-6c18-4fd0-b6c1-a9e887ac6d96 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:10.095249 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924b9285-6c18-4fd0-b6c1-a9e887ac6d96 None admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:10.096534 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924b9285-6c18-4fd0-b6c1-a9e887ac6d96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:10.097008 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924b9285-6c18-4fd0-b6c1-a9e887ac6d96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:10.098820 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924b9285-6c18-4fd0-b6c1-a9e887ac6d96 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:10.118382 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 404/827] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Sep 29 01:59:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:10.119850 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924b9285-6c18-4fd0-b6c1-a9e887ac6d96 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:10.141852 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:10.177750 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:10.187255 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef495a46-2582-4167-9812-a0d33416ca33 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:10.240720 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924b9285-6c18-4fd0-b6c1-a9e887ac6d96 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:10.244363 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cfeebb-20e3-477a-b328-d45e881460ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:10.244990 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cfeebb-20e3-477a-b328-d45e881460ce None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:10.245267 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cfeebb-20e3-477a-b328-d45e881460ce None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:10.245563 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cfeebb-20e3-477a-b328-d45e881460ce None admin] PATH_INFO: `/v3/services` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:10.246204 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cfeebb-20e3-477a-b328-d45e881460ce None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:10.246505 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cfeebb-20e3-477a-b328-d45e881460ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:10.247928 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cfeebb-20e3-477a-b328-d45e881460ce None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:10.254188 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 424/828] 10.222.0.49 () {56 vars in 1124 bytes} [Thu Sep 29 01:59:10 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:59:10.260048 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cfeebb-20e3-477a-b328-d45e881460ce None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:10.283244 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e867ae5e-a153-4f90-9370-fdc36ac97caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:10.284243 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e867ae5e-a153-4f90-9370-fdc36ac97caa None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:10.284723 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e867ae5e-a153-4f90-9370-fdc36ac97caa None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:10.285203 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e867ae5e-a153-4f90-9370-fdc36ac97caa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:10.292676 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e867ae5e-a153-4f90-9370-fdc36ac97caa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:10.294363 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e867ae5e-a153-4f90-9370-fdc36ac97caa None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:10.306498 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-e867ae5e-a153-4f90-9370-fdc36ac97caa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:59:10.306498 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:10.306498 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:10.306498 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:10.306498 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:10.306498 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:10.306498 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:10.306498 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:10.306498 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:10.306498 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:10.306498 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:10.306498 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:10.306498 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 29 01:59:10.306498 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 29 01:59:10.306498 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 29 01:59:10.307391 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 29 01:59:10.307391 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:10.307391 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:10.307391 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:10.307391 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:10.307391 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:10.307391 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:10.307391 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:10.307391 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:10.307391 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:10.307391 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:10.307391 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:10.307391 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:10.307391 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:10.307391 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:10.307391 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:10.307391 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:10.308342 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 29 01:59:10.308342 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 29 01:59:10.308342 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 29 01:59:10.308342 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 29 01:59:10.308342 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 29 01:59:10.308342 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 29 01:59:10.308342 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:59:10.308342 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:59:10.315793 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 405/829] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Sep 29 01:59:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 01:59:10.317660 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e867ae5e-a153-4f90-9370-fdc36ac97caa None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:10.373194 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cfeebb-20e3-477a-b328-d45e881460ce None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:10.402512 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:10.414073 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3829a54-8f99-4270-b735-3cf8e83a5b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:10.414878 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3829a54-8f99-4270-b735-3cf8e83a5b07 None admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:10.415306 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3829a54-8f99-4270-b735-3cf8e83a5b07 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:10.415721 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3829a54-8f99-4270-b735-3cf8e83a5b07 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:10.416972 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3829a54-8f99-4270-b735-3cf8e83a5b07 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:10.418527 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3829a54-8f99-4270-b735-3cf8e83a5b07 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:10.429632 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e867ae5e-a153-4f90-9370-fdc36ac97caa None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:10.453726 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 425/830] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 01:59:10 2022] POST /identity/v3/endpoints => generated 346 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 29 01:59:10.481912 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fa3741-08d3-4923-8fe8-63f2f8b3eebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:10.482583 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa3741-08d3-4923-8fe8-63f2f8b3eebf None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:10.482864 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa3741-08d3-4923-8fe8-63f2f8b3eebf None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:10.483133 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa3741-08d3-4923-8fe8-63f2f8b3eebf None admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:10.483905 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fa3741-08d3-4923-8fe8-63f2f8b3eebf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:10.484213 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fa3741-08d3-4923-8fe8-63f2f8b3eebf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:10.485850 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fa3741-08d3-4923-8fe8-63f2f8b3eebf None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:10.504968 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 406/831] 10.222.0.49 () {56 vars in 1148 bytes} [Thu Sep 29 01:59:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:59:10.507207 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3829a54-8f99-4270-b735-3cf8e83a5b07 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:10.520217 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:10.638707 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3829a54-8f99-4270-b735-3cf8e83a5b07 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:10.658773 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc7d670-18c6-426e-a6cf-80bd14be05b8 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:10.659063 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc7d670-18c6-426e-a6cf-80bd14be05b8 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:10.659327 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc7d670-18c6-426e-a6cf-80bd14be05b8 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:10.660887 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 407/832] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:59:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 29 01:59:10.665934 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b888b1-36ff-4eaa-b3b1-e75630956e94 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:10.666214 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b888b1-36ff-4eaa-b3b1-e75630956e94 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:10.666740 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b888b1-36ff-4eaa-b3b1-e75630956e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:10.680518 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9502fdd7-46d3-4416-9da2-b192d1869452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:10.681122 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9502fdd7-46d3-4416-9da2-b192d1869452 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:10.682018 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9502fdd7-46d3-4416-9da2-b192d1869452 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:10.682300 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9502fdd7-46d3-4416-9da2-b192d1869452 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:10.683030 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9502fdd7-46d3-4416-9da2-b192d1869452 None admin] RBAC: Adding query filter params (role.id=fe9bbc67742f4f5893f39b18eb31d59a, scope.project.id=6f1d8fd250c84c5887cb3173053ea2dd, user.id=f3325a7111d447f4a9cf00c672d5420f) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:10.683481 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9502fdd7-46d3-4416-9da2-b192d1869452 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:10.685144 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9502fdd7-46d3-4416-9da2-b192d1869452 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:10.687603 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-c5b888b1-36ff-4eaa-b3b1-e75630956e94 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:59:10.688802 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-c5b888b1-36ff-4eaa-b3b1-e75630956e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:59:10.697438 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 426/833] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Sep 29 01:59:10 2022] GET /identity/v3/role_assignments?user.id=f3325a7111d447f4a9cf00c672d5420f&scope.project.id=6f1d8fd250c84c5887cb3173053ea2dd&role.id=fe9bbc67742f4f5893f39b18eb31d59a => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:10.768644 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 408/834] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:59:10 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 29 01:59:11.038479 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9502fdd7-46d3-4416-9da2-b192d1869452 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:11.121895 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:11.158005 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9502fdd7-46d3-4416-9da2-b192d1869452 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:11.194261 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa6ba4b-70f6-48ba-94bb-b1fffa7bf0ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:11.195264 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa6ba4b-70f6-48ba-94bb-b1fffa7bf0ea None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:11.195750 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa6ba4b-70f6-48ba-94bb-b1fffa7bf0ea None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:11.196220 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa6ba4b-70f6-48ba-94bb-b1fffa7bf0ea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:11.207754 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa6ba4b-70f6-48ba-94bb-b1fffa7bf0ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:59:11.213484 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-3fa6ba4b-70f6-48ba-94bb-b1fffa7bf0ea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 01:59:11.213484 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:11.213484 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:11.213484 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:11.213484 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:11.213484 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:11.213484 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:11.213484 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:11.213484 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:11.213484 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:11.213484 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:11.213484 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:11.213484 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:59:11.213484 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:59:11.213484 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:59:11.213484 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:59:11.214391 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:59:11.214391 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:59:11.214391 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:59:11.214391 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:59:11.214391 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:11.214391 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:11.214391 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:11.214391 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:11.214391 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:11.214391 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:11.214391 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:11.214391 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:11.214391 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:11.214391 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:11.214391 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:11.214391 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:11.215225 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:11.215225 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:11.215225 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:11.215225 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:11.215225 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:59:11.215225 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:59:11.215225 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:59:11.215225 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:59:11.215225 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:59:11.215225 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:59:11.215225 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 01:59:11.215225 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:59:11.218389 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 427/835] 10.222.0.49 () {56 vars in 1096 bytes} [Thu Sep 29 01:59:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:11.224106 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b888b1-36ff-4eaa-b3b1-e75630956e94 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:11.287355 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:11.328541 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b888b1-36ff-4eaa-b3b1-e75630956e94 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:11.363498 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c032bff7-c69a-427f-b0fd-204237bc506c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:11.364107 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c032bff7-c69a-427f-b0fd-204237bc506c None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:11.364385 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c032bff7-c69a-427f-b0fd-204237bc506c None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:11.364656 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c032bff7-c69a-427f-b0fd-204237bc506c None admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:11.365336 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c032bff7-c69a-427f-b0fd-204237bc506c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:11.365645 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c032bff7-c69a-427f-b0fd-204237bc506c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:11.367005 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c032bff7-c69a-427f-b0fd-204237bc506c None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:11.375919 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 409/836] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Sep 29 01:59:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:11.381166 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa6ba4b-70f6-48ba-94bb-b1fffa7bf0ea None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:11.497428 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa6ba4b-70f6-48ba-94bb-b1fffa7bf0ea None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:11.528688 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:11.535683 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1102c170-7191-467b-8a76-c6ba8ecd978d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:11.536583 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1102c170-7191-467b-8a76-c6ba8ecd978d None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:11.537068 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1102c170-7191-467b-8a76-c6ba8ecd978d None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:11.537598 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1102c170-7191-467b-8a76-c6ba8ecd978d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:11.549845 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1102c170-7191-467b-8a76-c6ba8ecd978d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:11.551560 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1102c170-7191-467b-8a76-c6ba8ecd978d None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:11.566724 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-1102c170-7191-467b-8a76-c6ba8ecd978d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:11.566724 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:11.566724 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:11.566724 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:11.566724 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:11.566724 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:11.566724 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:11.566724 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:11.566724 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:11.566724 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:11.566724 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:11.566724 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:11.566724 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:59:11.566724 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:59:11.566724 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:59:11.566724 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:59:11.567717 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:11.567717 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:11.567717 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:11.567717 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:11.567717 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:11.567717 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:11.567717 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:11.567717 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:11.567717 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:11.567717 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:11.567717 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:11.567717 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:11.567717 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:11.567717 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:11.567717 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:11.567717 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:11.567717 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:59:11.568622 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:59:11.568622 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:11.568622 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:59:11.570757 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 428/837] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 01:59:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 01:59:11.577613 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c032bff7-c69a-427f-b0fd-204237bc506c None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:11.594779 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c0f64e-d27e-429d-b2db-d16fc1b94321 None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:11.595058 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c0f64e-d27e-429d-b2db-d16fc1b94321 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:11.595335 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c0f64e-d27e-429d-b2db-d16fc1b94321 None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:11.596927 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 429/838] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:59:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 29 01:59:11.601966 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0467a53-ce2c-46c8-85e0-502ed5357805 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:11.602254 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0467a53-ce2c-46c8-85e0-502ed5357805 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:11.602529 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0467a53-ce2c-46c8-85e0-502ed5357805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:11.621549 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-b0467a53-ce2c-46c8-85e0-502ed5357805 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:59:11.622868 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-b0467a53-ce2c-46c8-85e0-502ed5357805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:59:11.688695 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c032bff7-c69a-427f-b0fd-204237bc506c None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:11.705689 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 430/839] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:59:11 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 29 01:59:11.713488 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:11.724904 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfcd7f0-8622-4966-a180-6ff25a71fc0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:11.725550 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfcd7f0-8622-4966-a180-6ff25a71fc0c None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:11.725810 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfcd7f0-8622-4966-a180-6ff25a71fc0c None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:11.726081 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfcd7f0-8622-4966-a180-6ff25a71fc0c None admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:11.726720 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfcd7f0-8622-4966-a180-6ff25a71fc0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:11.727020 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfcd7f0-8622-4966-a180-6ff25a71fc0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:11.728378 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfcd7f0-8622-4966-a180-6ff25a71fc0c None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:11.741489 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 410/840] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Sep 29 01:59:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:11.746626 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0467a53-ce2c-46c8-85e0-502ed5357805 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:11.846583 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0467a53-ce2c-46c8-85e0-502ed5357805 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:11.863843 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:11.886570 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8847dc02-76d6-41a6-8faf-2f521c394de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:11.887208 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8847dc02-76d6-41a6-8faf-2f521c394de8 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:11.887488 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8847dc02-76d6-41a6-8faf-2f521c394de8 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:11.887763 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8847dc02-76d6-41a6-8faf-2f521c394de8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:11.895286 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8847dc02-76d6-41a6-8faf-2f521c394de8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:11.896735 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8847dc02-76d6-41a6-8faf-2f521c394de8 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:11.920629 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-8847dc02-76d6-41a6-8faf-2f521c394de8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 29 01:59:11.920629 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:11.920629 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:11.920629 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:11.920629 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:11.920629 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:11.920629 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:11.920629 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:11.920629 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:11.920629 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:11.920629 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:11.920629 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:11.920629 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 29 01:59:11.920629 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 29 01:59:11.920629 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 29 01:59:11.920629 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 29 01:59:11.921684 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:11.921684 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:11.921684 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 29 01:59:11.921684 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:59:11.921684 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 29 01:59:11.921684 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:59:11.921684 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:11.921684 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:11.921684 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:11.921684 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:11.921684 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:11.921684 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:11.921684 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:11.921684 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:11.921684 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:11.921684 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:11.921684 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:11.921684 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:11.922846 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:11.922846 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:11.922846 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 29 01:59:11.922846 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 29 01:59:11.922846 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 29 01:59:11.922846 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 29 01:59:11.922846 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 29 01:59:11.922846 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 29 01:59:11.922846 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 29 01:59:11.922846 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:59:11.922846 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 431/841] 10.222.0.49 () {56 vars in 1096 bytes} [Thu Sep 29 01:59:11 2022] GET /identity/v3/users/swift => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:11.930604 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfcd7f0-8622-4966-a180-6ff25a71fc0c None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:11.992744 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8847dc02-76d6-41a6-8faf-2f521c394de8 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:12.048877 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfcd7f0-8622-4966-a180-6ff25a71fc0c None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:12.091954 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe2a86e-3f9c-40bd-968e-e56ed0bae1b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:12.092611 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe2a86e-3f9c-40bd-968e-e56ed0bae1b5 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:12.093087 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe2a86e-3f9c-40bd-968e-e56ed0bae1b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:12.093637 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe2a86e-3f9c-40bd-968e-e56ed0bae1b5 None admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:12.094902 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe2a86e-3f9c-40bd-968e-e56ed0bae1b5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:12.095228 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe2a86e-3f9c-40bd-968e-e56ed0bae1b5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:12.097025 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe2a86e-3f9c-40bd-968e-e56ed0bae1b5 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:12.106893 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8847dc02-76d6-41a6-8faf-2f521c394de8 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:12.120532 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 411/842] 10.222.0.49 () {56 vars in 1135 bytes} [Thu Sep 29 01:59:11 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:12.126690 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe2a86e-3f9c-40bd-968e-e56ed0bae1b5 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:12.148107 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a875408-09c3-4a49-882b-fe8ff7a34a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:12.148764 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a875408-09c3-4a49-882b-fe8ff7a34a62 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:12.149036 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a875408-09c3-4a49-882b-fe8ff7a34a62 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:12.149489 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a875408-09c3-4a49-882b-fe8ff7a34a62 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:12.160185 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a875408-09c3-4a49-882b-fe8ff7a34a62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:59:12.165577 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-5a875408-09c3-4a49-882b-fe8ff7a34a62 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 29 01:59:12.165577 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:12.165577 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:12.165577 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:12.165577 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:12.165577 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:12.165577 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:12.165577 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:12.165577 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:12.165577 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:12.165577 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:12.165577 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:12.165577 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:59:12.165577 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:59:12.165577 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:59:12.165577 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:59:12.166837 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:59:12.166837 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:59:12.166837 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:59:12.166837 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:59:12.166837 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:12.166837 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:12.166837 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:12.166837 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:12.166837 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:12.166837 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:12.166837 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:12.166837 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:12.166837 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:12.166837 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:12.166837 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:12.166837 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:12.167864 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:12.167864 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:12.167864 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:12.167864 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:12.167864 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:59:12.167864 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:59:12.167864 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:59:12.167864 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:59:12.167864 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:59:12.167864 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:59:12.167864 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 29 01:59:12.167864 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:59:12.167864 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 432/843] 10.222.0.49 () {56 vars in 1102 bytes} [Thu Sep 29 01:59:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 01:59:12.173277 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a875408-09c3-4a49-882b-fe8ff7a34a62 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:12.185556 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:12.216786 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:12.266097 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe2a86e-3f9c-40bd-968e-e56ed0bae1b5 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:12.289614 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a875408-09c3-4a49-882b-fe8ff7a34a62 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:12.303295 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7019c567-2d37-42a9-9ad5-be02c874b963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:12.304006 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7019c567-2d37-42a9-9ad5-be02c874b963 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:12.304292 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7019c567-2d37-42a9-9ad5-be02c874b963 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:12.304562 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7019c567-2d37-42a9-9ad5-be02c874b963 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:12.326658 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87346fc8-4455-431b-88d8-bafc32b7ccbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:12.327679 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87346fc8-4455-431b-88d8-bafc32b7ccbd None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:12.328161 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87346fc8-4455-431b-88d8-bafc32b7ccbd None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:12.328680 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87346fc8-4455-431b-88d8-bafc32b7ccbd None admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:12.329567 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87346fc8-4455-431b-88d8-bafc32b7ccbd None admin] RBAC: Adding query filter params (name=service) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:12.330118 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87346fc8-4455-431b-88d8-bafc32b7ccbd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:12.331703 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87346fc8-4455-431b-88d8-bafc32b7ccbd None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:12.340542 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 433/844] 10.222.0.49 () {56 vars in 1103 bytes} [Thu Sep 29 01:59:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:59:12.347749 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87346fc8-4455-431b-88d8-bafc32b7ccbd None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:12.383179 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7019c567-2d37-42a9-9ad5-be02c874b963 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:12.384742 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7019c567-2d37-42a9-9ad5-be02c874b963 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:12.432005 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:12.447401 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:12.455318 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87346fc8-4455-431b-88d8-bafc32b7ccbd None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:12.492373 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eea1aa-3264-4c06-865e-573ec47854e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:12.493413 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eea1aa-3264-4c06-865e-573ec47854e0 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:12.493897 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eea1aa-3264-4c06-865e-573ec47854e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:12.494388 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eea1aa-3264-4c06-865e-573ec47854e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:12.506137 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eea1aa-3264-4c06-865e-573ec47854e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:12.507938 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eea1aa-3264-4c06-865e-573ec47854e0 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:12.510256 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 412/845] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Sep 29 01:59:12 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 29 01:59:12.515846 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7019c567-2d37-42a9-9ad5-be02c874b963 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:12.525063 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-e0eea1aa-3264-4c06-865e-573ec47854e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:12.525063 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:12.525063 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:12.525063 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:12.525063 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:12.525063 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:12.525063 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:12.525063 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:12.525063 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:12.525063 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:12.525063 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:12.525063 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:12.525063 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:59:12.525063 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:59:12.525063 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:59:12.525063 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:59:12.526012 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:12.526012 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:12.526012 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:12.526012 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:12.526012 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:12.526012 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:12.526012 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:12.526012 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:12.526012 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:12.526012 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:12.526012 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:12.526012 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:12.526012 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:12.526012 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:12.526012 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:12.526012 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:12.526012 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:59:12.526891 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:59:12.526891 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:12.526891 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:59:12.528907 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 434/846] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 01:59:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:12.535551 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eea1aa-3264-4c06-865e-573ec47854e0 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:12.640202 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7019c567-2d37-42a9-9ad5-be02c874b963 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:12.643813 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eea1aa-3264-4c06-865e-573ec47854e0 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:12.680305 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e671dc-dbef-4b11-aca8-fe337196f535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:12.681113 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28a8bb3-3a51-4848-9232-0db9cd0a6e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:12.681571 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e671dc-dbef-4b11-aca8-fe337196f535 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:12.681833 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a8bb3-3a51-4848-9232-0db9cd0a6e55 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:12.682104 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a8bb3-3a51-4848-9232-0db9cd0a6e55 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:12.682369 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a8bb3-3a51-4848-9232-0db9cd0a6e55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:12.682704 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e671dc-dbef-4b11-aca8-fe337196f535 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:12.683177 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e671dc-dbef-4b11-aca8-fe337196f535 None admin] PATH_INFO: `/v3/domains` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:12.684031 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e671dc-dbef-4b11-aca8-fe337196f535 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:12.684534 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e671dc-dbef-4b11-aca8-fe337196f535 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:12.686150 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e671dc-dbef-4b11-aca8-fe337196f535 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:12.694535 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28a8bb3-3a51-4848-9232-0db9cd0a6e55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:12.696506 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28a8bb3-3a51-4848-9232-0db9cd0a6e55 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:12.699121 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:12.705721 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 435/847] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Sep 29 01:59:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:12.707662 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e671dc-dbef-4b11-aca8-fe337196f535 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:12.715017 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-b28a8bb3-3a51-4848-9232-0db9cd0a6e55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:12.715017 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:12.715017 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:12.715017 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:12.715017 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:12.715017 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:12.715017 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:12.715017 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:12.715017 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:12.715017 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:12.715017 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:12.715017 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:12.715017 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:59:12.715017 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:59:12.715017 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:59:12.715017 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:59:12.715980 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:12.715980 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:12.715980 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:12.715980 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:12.715980 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:12.715980 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:12.715980 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:12.715980 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:12.715980 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:12.715980 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:12.715980 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:12.715980 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:12.715980 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:12.715980 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:12.715980 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:12.715980 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:12.715980 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:59:12.716896 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:59:12.716896 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:12.716896 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:59:12.720566 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:12.721518 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 413/848] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 01:59:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:12.722460 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28a8bb3-3a51-4848-9232-0db9cd0a6e55 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:12.825680 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e671dc-dbef-4b11-aca8-fe337196f535 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:12.847392 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28a8bb3-3a51-4848-9232-0db9cd0a6e55 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:12.864139 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4556a75c-d8c4-4821-9cf8-ec5dbc231a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:12.865104 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4556a75c-d8c4-4821-9cf8-ec5dbc231a76 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:12.865617 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4556a75c-d8c4-4821-9cf8-ec5dbc231a76 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:12.866114 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4556a75c-d8c4-4821-9cf8-ec5dbc231a76 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:12.875529 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4556a75c-d8c4-4821-9cf8-ec5dbc231a76 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:12.877295 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4556a75c-d8c4-4821-9cf8-ec5dbc231a76 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:12.885424 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0008c45-c468-4d78-8b87-93381878421e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:12.886027 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0008c45-c468-4d78-8b87-93381878421e None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:12.886303 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0008c45-c468-4d78-8b87-93381878421e None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:12.886570 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0008c45-c468-4d78-8b87-93381878421e None admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:12.887202 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0008c45-c468-4d78-8b87-93381878421e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:12.887498 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0008c45-c468-4d78-8b87-93381878421e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:12.888859 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0008c45-c468-4d78-8b87-93381878421e None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:12.891842 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-4556a75c-d8c4-4821-9cf8-ec5dbc231a76 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 29 01:59:12.891842 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:12.891842 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:12.891842 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:12.891842 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:12.891842 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:12.891842 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:12.891842 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:12.891842 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:12.891842 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:12.891842 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:12.891842 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:12.891842 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 29 01:59:12.891842 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 29 01:59:12.891842 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 29 01:59:12.891842 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 29 01:59:12.892984 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:12.892984 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:12.892984 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 29 01:59:12.892984 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:59:12.892984 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 29 01:59:12.892984 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:59:12.892984 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:12.892984 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:12.892984 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:12.892984 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:12.892984 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:12.892984 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:12.892984 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:12.892984 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:12.892984 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:12.892984 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:12.892984 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:12.892984 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:12.894205 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:12.894205 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:12.894205 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 29 01:59:12.894205 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 29 01:59:12.894205 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 29 01:59:12.894205 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 29 01:59:12.894205 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 29 01:59:12.894205 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 29 01:59:12.894205 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 29 01:59:12.894205 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:59:12.897635 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 436/849] 10.222.0.49 () {56 vars in 1117 bytes} [Thu Sep 29 01:59:12 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:12.898902 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d0dc77-9606-4fb0-83b8-eb7e5be10e1c None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:12.899186 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d0dc77-9606-4fb0-83b8-eb7e5be10e1c None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:12.899452 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d0dc77-9606-4fb0-83b8-eb7e5be10e1c None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:12.904860 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 437/850] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:59:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:59:12.904860 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d0dc77-9606-4fb0-83b8-eb7e5be10e1c None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:12.913994 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 414/851] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Sep 29 01:59:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:12.918854 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad594a1-249c-4ccf-9361-938f55eb0caa None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:12.919141 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad594a1-249c-4ccf-9361-938f55eb0caa None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:12.919409 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad594a1-249c-4ccf-9361-938f55eb0caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:12.937929 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-2ad594a1-249c-4ccf-9361-938f55eb0caa None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:59:12.939143 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-2ad594a1-249c-4ccf-9361-938f55eb0caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:59:12.979720 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:12.996012 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:13.019003 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 415/852] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:59:12 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 29 01:59:13.019891 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad594a1-249c-4ccf-9361-938f55eb0caa None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:13.029481 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d0dc77-9606-4fb0-83b8-eb7e5be10e1c None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:13.072591 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828cbd93-04c4-449b-8d08-943c9e53eee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:13.074080 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828cbd93-04c4-449b-8d08-943c9e53eee6 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:13.074857 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828cbd93-04c4-449b-8d08-943c9e53eee6 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:13.075338 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828cbd93-04c4-449b-8d08-943c9e53eee6 None admin] PATH_INFO: `/v3/users` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:13.076911 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828cbd93-04c4-449b-8d08-943c9e53eee6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:13.078186 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828cbd93-04c4-449b-8d08-943c9e53eee6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:13.080266 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828cbd93-04c4-449b-8d08-943c9e53eee6 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:13.102272 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 438/853] 10.222.0.49 () {56 vars in 1149 bytes} [Thu Sep 29 01:59:12 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:13.103820 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b417cc55-f011-4fe7-a1ba-9f5c8808d1a6 None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:13.104343 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b417cc55-f011-4fe7-a1ba-9f5c8808d1a6 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:13.104820 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b417cc55-f011-4fe7-a1ba-9f5c8808d1a6 None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:13.106509 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 439/854] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:59:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:59:13.111989 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b417cc55-f011-4fe7-a1ba-9f5c8808d1a6 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:13.131549 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad594a1-249c-4ccf-9361-938f55eb0caa None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:13.167952 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec7553f-8e1d-4b7c-b34f-71357d7490ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:13.168928 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec7553f-8e1d-4b7c-b34f-71357d7490ad None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:13.169434 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec7553f-8e1d-4b7c-b34f-71357d7490ad None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:13.169901 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec7553f-8e1d-4b7c-b34f-71357d7490ad None admin] PATH_INFO: `/v3/projects/service` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:13.178083 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec7553f-8e1d-4b7c-b34f-71357d7490ad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:13.179754 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec7553f-8e1d-4b7c-b34f-71357d7490ad None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:13.192040 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-7ec7553f-8e1d-4b7c-b34f-71357d7490ad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:59:13.192040 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:13.192040 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:13.192040 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:13.192040 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:13.192040 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:13.192040 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:13.192040 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:13.192040 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:13.192040 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:13.192040 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:13.192040 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:13.192040 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 29 01:59:13.192040 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 29 01:59:13.192040 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 29 01:59:13.192915 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 29 01:59:13.192915 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:13.192915 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:13.192915 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:13.192915 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:13.192915 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:13.192915 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:13.192915 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:13.192915 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:13.192915 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:13.192915 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:13.192915 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:13.192915 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:13.192915 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:13.192915 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:13.192915 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:13.192915 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:13.198799 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 29 01:59:13.198799 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 29 01:59:13.198799 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 29 01:59:13.198799 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 29 01:59:13.198799 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 29 01:59:13.198799 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 29 01:59:13.198799 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:59:13.198799 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:59:13.198799 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 416/855] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Sep 29 01:59:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:13.198799 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a09a2b-d9a7-4aba-902e-878e9c05369f None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:13.198799 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a09a2b-d9a7-4aba-902e-878e9c05369f None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:13.199404 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a09a2b-d9a7-4aba-902e-878e9c05369f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:13.213627 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-43a09a2b-d9a7-4aba-902e-878e9c05369f None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:59:13.214822 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-43a09a2b-d9a7-4aba-902e-878e9c05369f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:59:13.225398 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b417cc55-f011-4fe7-a1ba-9f5c8808d1a6 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:13.250757 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:13.257058 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:13.263471 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e2c947-23df-4fae-a27c-91f0bf786916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:13.264090 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e2c947-23df-4fae-a27c-91f0bf786916 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:13.264410 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e2c947-23df-4fae-a27c-91f0bf786916 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:13.264754 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e2c947-23df-4fae-a27c-91f0bf786916 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:13.286182 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 417/856] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:59:13 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 29 01:59:13.290167 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a09a2b-d9a7-4aba-902e-878e9c05369f None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:13.341016 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e2c947-23df-4fae-a27c-91f0bf786916 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:13.343194 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e2c947-23df-4fae-a27c-91f0bf786916 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:13.396145 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a09a2b-d9a7-4aba-902e-878e9c05369f None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:13.434641 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17981b3c-c2ab-444a-8d5f-8bcde9ff71e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:13.435173 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17981b3c-c2ab-444a-8d5f-8bcde9ff71e9 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:13.435456 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17981b3c-c2ab-444a-8d5f-8bcde9ff71e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:13.435725 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17981b3c-c2ab-444a-8d5f-8bcde9ff71e9 None admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:13.436448 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17981b3c-c2ab-444a-8d5f-8bcde9ff71e9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:13.436748 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17981b3c-c2ab-444a-8d5f-8bcde9ff71e9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:13.438187 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17981b3c-c2ab-444a-8d5f-8bcde9ff71e9 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:13.453387 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 418/857] 10.222.0.49 () {56 vars in 1148 bytes} [Thu Sep 29 01:59:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:13.453387 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17981b3c-c2ab-444a-8d5f-8bcde9ff71e9 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:13.453842 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 440/858] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Sep 29 01:59:13 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 29 01:59:13.454893 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e2c947-23df-4fae-a27c-91f0bf786916 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:13.479368 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:13.494190 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:13.560488 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e2c947-23df-4fae-a27c-91f0bf786916 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:13.569054 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17981b3c-c2ab-444a-8d5f-8bcde9ff71e9 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:13.596029 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b852ade6-569b-4f97-ab58-c7a1886f6a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:13.596653 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b852ade6-569b-4f97-ab58-c7a1886f6a3a None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:13.596926 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b852ade6-569b-4f97-ab58-c7a1886f6a3a None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:13.597195 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b852ade6-569b-4f97-ab58-c7a1886f6a3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:13.606419 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512776ec-2610-475e-b01a-2904cae47570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:13.607036 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512776ec-2610-475e-b01a-2904cae47570 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:13.607200 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b852ade6-569b-4f97-ab58-c7a1886f6a3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:13.607319 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512776ec-2610-475e-b01a-2904cae47570 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:13.607568 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512776ec-2610-475e-b01a-2904cae47570 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:13.608146 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512776ec-2610-475e-b01a-2904cae47570 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:13.608798 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b852ade6-569b-4f97-ab58-c7a1886f6a3a None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:13.609743 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512776ec-2610-475e-b01a-2904cae47570 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:13.618369 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-512776ec-2610-475e-b01a-2904cae47570 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 29 01:59:13.618369 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:13.618369 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 29 01:59:13.618369 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 29 01:59:13.618369 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 29 01:59:13.618369 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 29 01:59:13.618369 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 29 01:59:13.618369 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 29 01:59:13.618369 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 29 01:59:13.618369 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:59:13.618369 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 29 01:59:13.618369 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:59:13.618369 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:13.618369 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:13.618369 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:13.618369 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:13.618369 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:13.619371 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:13.619371 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:13.619371 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:13.619371 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:13.619371 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:13.619371 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:13.619371 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 29 01:59:13.619371 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 29 01:59:13.619371 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 29 01:59:13.619371 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 29 01:59:13.619371 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:13.619371 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:13.619371 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:13.619371 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:13.619371 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:13.619371 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:13.620219 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:13.620219 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:13.620219 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:13.620219 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:13.620219 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:13.620219 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:13.620219 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:13.620219 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:13.620219 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:13.620219 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:13.620219 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 29 01:59:13.620219 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 29 01:59:13.620219 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 29 01:59:13.620219 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:59:13.620219 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 419/859] 10.222.0.49 () {56 vars in 1114 bytes} [Thu Sep 29 01:59:13 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:13.621611 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512776ec-2610-475e-b01a-2904cae47570 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:13.623724 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-b852ade6-569b-4f97-ab58-c7a1886f6a3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:13.623724 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:13.623724 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:13.623724 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:13.623724 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:13.623724 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:13.623724 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:13.623724 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:13.623724 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:13.623724 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:13.623724 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:13.623724 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:13.623724 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:59:13.623724 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:59:13.623724 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:59:13.623724 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:59:13.625358 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:13.625358 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:13.625358 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:13.625358 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:13.625358 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:13.625358 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:13.625358 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:13.625358 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:13.625358 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:13.625358 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:13.625358 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:13.625358 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:13.625358 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:13.625358 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:13.625358 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:13.625358 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:13.625358 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:59:13.626910 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:59:13.626910 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:13.626910 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:59:13.626910 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 441/860] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 01:59:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:13.626910 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b852ade6-569b-4f97-ab58-c7a1886f6a3a None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:13.701892 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:13.725941 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b852ade6-569b-4f97-ab58-c7a1886f6a3a None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:13.726875 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:13.730944 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512776ec-2610-475e-b01a-2904cae47570 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:13.761761 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be4c630-9fa7-41e2-bcf9-7eda3e8df365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:13.762397 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be4c630-9fa7-41e2-bcf9-7eda3e8df365 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:13.762680 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be4c630-9fa7-41e2-bcf9-7eda3e8df365 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:13.762956 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be4c630-9fa7-41e2-bcf9-7eda3e8df365 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:13.763534 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be4c630-9fa7-41e2-bcf9-7eda3e8df365 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:13.765667 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be4c630-9fa7-41e2-bcf9-7eda3e8df365 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:13.765851 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0c393f-b4aa-4bf2-a26e-bd54f380590d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:13.766442 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0c393f-b4aa-4bf2-a26e-bd54f380590d None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:13.766718 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0c393f-b4aa-4bf2-a26e-bd54f380590d None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:13.766986 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0c393f-b4aa-4bf2-a26e-bd54f380590d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:13.767702 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0c393f-b4aa-4bf2-a26e-bd54f380590d None admin] RBAC: Adding query filter params (role.id=fe9bbc67742f4f5893f39b18eb31d59a, scope.project.id=6f1d8fd250c84c5887cb3173053ea2dd, user.id=c88bc0f32600416ca7c6a59f4196e497) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:13.768006 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0c393f-b4aa-4bf2-a26e-bd54f380590d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:13.769418 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0c393f-b4aa-4bf2-a26e-bd54f380590d None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:13.774280 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-7be4c630-9fa7-41e2-bcf9-7eda3e8df365 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 29 01:59:13.774280 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:13.774280 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 29 01:59:13.774280 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 29 01:59:13.774280 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 29 01:59:13.774280 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 29 01:59:13.774280 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 29 01:59:13.774280 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 29 01:59:13.774280 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 29 01:59:13.774280 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:59:13.774280 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 29 01:59:13.774280 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:59:13.774280 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:13.774280 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:13.774280 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:13.774280 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:13.775289 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:13.775289 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:13.775289 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:13.775289 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:13.775289 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:13.775289 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:13.775289 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:13.775289 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 29 01:59:13.775289 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 29 01:59:13.775289 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 29 01:59:13.775289 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 29 01:59:13.775289 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:13.775289 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:13.775289 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:13.775289 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:13.775289 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:13.775289 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:13.776171 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:13.776171 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:13.776171 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:13.776171 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:13.776171 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:13.776171 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:13.776171 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:13.776171 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:13.776171 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:13.776171 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:13.776171 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 29 01:59:13.776171 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 29 01:59:13.776171 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 29 01:59:13.776171 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:59:13.776912 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 420/861] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Sep 29 01:59:13 2022] GET /identity/v3/role_assignments?user.id=c88bc0f32600416ca7c6a59f4196e497&scope.project.id=6f1d8fd250c84c5887cb3173053ea2dd&role.id=fe9bbc67742f4f5893f39b18eb31d59a => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:13.776912 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0c393f-b4aa-4bf2-a26e-bd54f380590d None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:13.780435 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 442/862] 10.222.0.49 () {56 vars in 1132 bytes} [Thu Sep 29 01:59:13 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:13.781400 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be4c630-9fa7-41e2-bcf9-7eda3e8df365 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:13.896605 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be4c630-9fa7-41e2-bcf9-7eda3e8df365 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:13.913774 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0c393f-b4aa-4bf2-a26e-bd54f380590d None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:13.937243 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84ad573-1d4f-439d-bf79-0721e869a244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:13.937910 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ad573-1d4f-439d-bf79-0721e869a244 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:13.938190 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ad573-1d4f-439d-bf79-0721e869a244 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:13.938463 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ad573-1d4f-439d-bf79-0721e869a244 None admin] PATH_INFO: `/v3/domains` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:13.939126 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84ad573-1d4f-439d-bf79-0721e869a244 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:13.939428 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84ad573-1d4f-439d-bf79-0721e869a244 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:13.941423 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84ad573-1d4f-439d-bf79-0721e869a244 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:13.951220 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:13.955750 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 443/863] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Sep 29 01:59:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:13.956592 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84ad573-1d4f-439d-bf79-0721e869a244 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:13.962126 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a48b1b-9a23-4d68-9bb7-f00ed9165e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:13.963638 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a48b1b-9a23-4d68-9bb7-f00ed9165e5d None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:13.963922 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a48b1b-9a23-4d68-9bb7-f00ed9165e5d None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:13.964191 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a48b1b-9a23-4d68-9bb7-f00ed9165e5d None admin] PATH_INFO: `/v3/services` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:13.964831 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a48b1b-9a23-4d68-9bb7-f00ed9165e5d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:13.965179 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a48b1b-9a23-4d68-9bb7-f00ed9165e5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:13.966593 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a48b1b-9a23-4d68-9bb7-f00ed9165e5d None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:13.976330 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 421/864] 10.222.0.49 () {56 vars in 1114 bytes} [Thu Sep 29 01:59:13 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:13.976850 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a48b1b-9a23-4d68-9bb7-f00ed9165e5d None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:14.009668 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:14.070478 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84ad573-1d4f-439d-bf79-0721e869a244 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:14.090485 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a48b1b-9a23-4d68-9bb7-f00ed9165e5d None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:14.109822 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef3673b-c283-4b34-8c1c-5bd8d227c14f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:14.110434 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef3673b-c283-4b34-8c1c-5bd8d227c14f None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:14.110711 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef3673b-c283-4b34-8c1c-5bd8d227c14f None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:14.110981 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef3673b-c283-4b34-8c1c-5bd8d227c14f None admin] PATH_INFO: `/v3/services` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:14.111609 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef3673b-c283-4b34-8c1c-5bd8d227c14f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:14.111905 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef3673b-c283-4b34-8c1c-5bd8d227c14f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:14.113269 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef3673b-c283-4b34-8c1c-5bd8d227c14f None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:14.118003 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 444/865] 10.222.0.49 () {56 vars in 1126 bytes} [Thu Sep 29 01:59:13 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:14.118603 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef3673b-c283-4b34-8c1c-5bd8d227c14f None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:14.133020 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b7a6e9-af0d-4912-90ad-cf2b41c32396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:14.134264 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b7a6e9-af0d-4912-90ad-cf2b41c32396 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:14.134750 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b7a6e9-af0d-4912-90ad-cf2b41c32396 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:14.135166 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b7a6e9-af0d-4912-90ad-cf2b41c32396 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:14.142492 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b7a6e9-af0d-4912-90ad-cf2b41c32396 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:14.144102 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b7a6e9-af0d-4912-90ad-cf2b41c32396 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:14.157994 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-16b7a6e9-af0d-4912-90ad-cf2b41c32396 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:59:14.157994 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:14.157994 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:14.157994 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:14.157994 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:14.157994 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:14.157994 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:14.157994 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:14.157994 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:14.157994 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:14.157994 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:14.157994 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:14.157994 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 29 01:59:14.157994 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 29 01:59:14.157994 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 29 01:59:14.159111 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 29 01:59:14.159111 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:14.159111 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:14.159111 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:14.159111 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:14.159111 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:14.159111 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:14.159111 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:14.159111 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:14.159111 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:14.159111 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:14.159111 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:14.159111 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:14.159111 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:14.159111 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:14.159111 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:14.159111 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:14.160207 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 29 01:59:14.160207 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 29 01:59:14.160207 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 29 01:59:14.160207 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 29 01:59:14.160207 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 29 01:59:14.160207 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 29 01:59:14.160207 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:59:14.160207 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:59:14.162687 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 422/866] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Sep 29 01:59:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:14.164012 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b7a6e9-af0d-4912-90ad-cf2b41c32396 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:14.186010 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:14.237886 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef3673b-c283-4b34-8c1c-5bd8d227c14f None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:14.273189 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5491c0fc-02c0-41c0-bd48-edc9fb37b1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:14.274085 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5491c0fc-02c0-41c0-bd48-edc9fb37b1b1 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:14.274361 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5491c0fc-02c0-41c0-bd48-edc9fb37b1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:14.274629 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5491c0fc-02c0-41c0-bd48-edc9fb37b1b1 None admin] PATH_INFO: `/v3/services` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:14.275411 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5491c0fc-02c0-41c0-bd48-edc9fb37b1b1 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:14.275913 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:14.276020 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5491c0fc-02c0-41c0-bd48-edc9fb37b1b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:14.277389 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5491c0fc-02c0-41c0-bd48-edc9fb37b1b1 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:14.293347 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 445/867] 10.222.0.49 () {56 vars in 1114 bytes} [Thu Sep 29 01:59:14 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:14.293347 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5491c0fc-02c0-41c0-bd48-edc9fb37b1b1 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:14.305878 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b7a6e9-af0d-4912-90ad-cf2b41c32396 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:14.350285 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8386a4d-4e03-4d84-b00e-01540431328f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:14.351044 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8386a4d-4e03-4d84-b00e-01540431328f None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:14.351392 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8386a4d-4e03-4d84-b00e-01540431328f None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:14.351739 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8386a4d-4e03-4d84-b00e-01540431328f None admin] PATH_INFO: `/v3/services` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:14.352551 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8386a4d-4e03-4d84-b00e-01540431328f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:14.353606 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8386a4d-4e03-4d84-b00e-01540431328f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:14.355498 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8386a4d-4e03-4d84-b00e-01540431328f None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:14.365582 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 423/868] 10.222.0.49 () {56 vars in 1126 bytes} [Thu Sep 29 01:59:14 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:14.414763 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5491c0fc-02c0-41c0-bd48-edc9fb37b1b1 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:14.446190 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:14.456353 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c125d73e-9d5b-4e29-acad-eec54178a365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:14.457048 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c125d73e-9d5b-4e29-acad-eec54178a365 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:14.457340 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c125d73e-9d5b-4e29-acad-eec54178a365 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:14.457633 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c125d73e-9d5b-4e29-acad-eec54178a365 None admin] PATH_INFO: `/v3/projects` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:14.458354 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c125d73e-9d5b-4e29-acad-eec54178a365 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:14.458660 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c125d73e-9d5b-4e29-acad-eec54178a365 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:14.460150 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c125d73e-9d5b-4e29-acad-eec54178a365 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:14.475777 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 446/869] 10.222.0.49 () {56 vars in 1148 bytes} [Thu Sep 29 01:59:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:14.484398 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8386a4d-4e03-4d84-b00e-01540431328f None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:14.615322 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8386a4d-4e03-4d84-b00e-01540431328f None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:14.651938 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99702ad-2790-46af-9f17-ab1cf0fdcb77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:14.652547 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99702ad-2790-46af-9f17-ab1cf0fdcb77 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:14.652832 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99702ad-2790-46af-9f17-ab1cf0fdcb77 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:14.653101 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99702ad-2790-46af-9f17-ab1cf0fdcb77 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:14.653881 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99702ad-2790-46af-9f17-ab1cf0fdcb77 None admin] RBAC: Adding query filter params (role.id=393e6032e5cc4678b8351026fe4434f8, scope.project.id=6f1d8fd250c84c5887cb3173053ea2dd, user.id=0f8f13f302de4701a7f4e0562bca08cf) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:14.654189 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99702ad-2790-46af-9f17-ab1cf0fdcb77 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:14.656555 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99702ad-2790-46af-9f17-ab1cf0fdcb77 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:14.663327 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 424/870] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Sep 29 01:59:14 2022] GET /identity/v3/role_assignments?user.id=0f8f13f302de4701a7f4e0562bca08cf&scope.project.id=6f1d8fd250c84c5887cb3173053ea2dd&role.id=393e6032e5cc4678b8351026fe4434f8 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:16.054611 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec0e1d-ab59-4050-b22d-6bc9dac7a68a None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:16.055127 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec0e1d-ab59-4050-b22d-6bc9dac7a68a None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:16.055127 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec0e1d-ab59-4050-b22d-6bc9dac7a68a None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:16.056596 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 447/871] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:59:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:59:16.062362 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34786908-51d3-4eb2-8b79-1ddc19494025 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:16.063171 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34786908-51d3-4eb2-8b79-1ddc19494025 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:16.063678 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34786908-51d3-4eb2-8b79-1ddc19494025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:16.083163 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-34786908-51d3-4eb2-8b79-1ddc19494025 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:59:16.084740 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-34786908-51d3-4eb2-8b79-1ddc19494025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:59:16.097780 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:16.161381 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 425/872] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:59:16 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 29 01:59:16.428609 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ec0e1d-ab59-4050-b22d-6bc9dac7a68a None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:16.500113 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9e1f85-c2fb-4ddc-8d85-b2d129a9315d None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:16.500472 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9e1f85-c2fb-4ddc-8d85-b2d129a9315d None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:16.500669 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9e1f85-c2fb-4ddc-8d85-b2d129a9315d None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:16.502266 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 426/873] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:59:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 29 01:59:16.507175 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9dc2bd-e508-47b6-8464-91dd423ee476 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:16.507456 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9dc2bd-e508-47b6-8464-91dd423ee476 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:16.507727 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9dc2bd-e508-47b6-8464-91dd423ee476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:16.529135 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-2f9dc2bd-e508-47b6-8464-91dd423ee476 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:59:16.530599 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-2f9dc2bd-e508-47b6-8464-91dd423ee476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:59:16.548463 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ec0e1d-ab59-4050-b22d-6bc9dac7a68a None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:16.601024 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e8fa5c-f2a0-4a4d-8e5d-ee0efae5a8cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:16.601696 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e8fa5c-f2a0-4a4d-8e5d-ee0efae5a8cc None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:16.601974 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e8fa5c-f2a0-4a4d-8e5d-ee0efae5a8cc None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:16.602240 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e8fa5c-f2a0-4a4d-8e5d-ee0efae5a8cc None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:16.602833 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e8fa5c-f2a0-4a4d-8e5d-ee0efae5a8cc None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:16.604259 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e8fa5c-f2a0-4a4d-8e5d-ee0efae5a8cc None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:16.614725 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-d3e8fa5c-f2a0-4a4d-8e5d-ee0efae5a8cc None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 29 01:59:16.614725 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:16.614725 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 29 01:59:16.614725 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 29 01:59:16.614725 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 29 01:59:16.614725 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 29 01:59:16.614725 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 29 01:59:16.614725 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 29 01:59:16.614725 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 29 01:59:16.614725 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:59:16.614725 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 29 01:59:16.614725 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:59:16.614725 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:16.614725 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:16.614725 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:16.614725 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:16.614725 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:16.615845 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:16.615845 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:16.615845 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:16.615845 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:16.615845 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:16.615845 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:16.615845 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 29 01:59:16.615845 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 29 01:59:16.615845 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 29 01:59:16.615845 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 29 01:59:16.615845 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:16.615845 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:16.615845 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:16.615845 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:16.615845 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:16.615845 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:16.617177 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:16.617177 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:16.617177 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:16.617177 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:16.617177 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:16.617177 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:16.617177 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:16.617177 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:16.617177 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:16.617177 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:16.617177 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 29 01:59:16.617177 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 29 01:59:16.617177 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 29 01:59:16.617177 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:59:16.617177 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 448/874] 10.222.0.49 () {56 vars in 1126 bytes} [Thu Sep 29 01:59:16 2022] GET /identity/v3/services/object-store => generated 93 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:16.622541 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e8fa5c-f2a0-4a4d-8e5d-ee0efae5a8cc None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:16.629898 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 427/875] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:59:16 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 29 01:59:16.684026 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:16.721555 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba33352-418a-4e7b-82b0-08fdbdd50035 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:16.722177 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba33352-418a-4e7b-82b0-08fdbdd50035 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:16.722652 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba33352-418a-4e7b-82b0-08fdbdd50035 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:16.724544 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 428/876] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:59:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 29 01:59:16.731531 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8178f2be-4457-475b-9c1b-3f8019af0d38 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:16.732165 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8178f2be-4457-475b-9c1b-3f8019af0d38 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:16.732637 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8178f2be-4457-475b-9c1b-3f8019af0d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:16.739595 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e8fa5c-f2a0-4a4d-8e5d-ee0efae5a8cc None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:16.755028 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-8178f2be-4457-475b-9c1b-3f8019af0d38 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:59:16.756863 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-8178f2be-4457-475b-9c1b-3f8019af0d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:59:16.782040 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba85e754-27d4-47e9-97cf-1bedd6a2fdfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:16.783539 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85e754-27d4-47e9-97cf-1bedd6a2fdfb None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:16.784289 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85e754-27d4-47e9-97cf-1bedd6a2fdfb None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:16.784771 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85e754-27d4-47e9-97cf-1bedd6a2fdfb None admin] PATH_INFO: `/v3/services` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:16.785917 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba85e754-27d4-47e9-97cf-1bedd6a2fdfb None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:16.786760 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba85e754-27d4-47e9-97cf-1bedd6a2fdfb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:16.788903 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba85e754-27d4-47e9-97cf-1bedd6a2fdfb None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:16.801750 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 449/877] 10.222.0.49 () {56 vars in 1122 bytes} [Thu Sep 29 01:59:16 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:16.804337 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba85e754-27d4-47e9-97cf-1bedd6a2fdfb None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:16.853368 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 429/878] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:59:16 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 29 01:59:16.930489 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8178f2be-4457-475b-9c1b-3f8019af0d38 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:16.934504 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:16.938964 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba85e754-27d4-47e9-97cf-1bedd6a2fdfb None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:16.957354 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:16.977425 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e28932-3e85-4f36-86c0-7a0e2b09a177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:16.978125 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e28932-3e85-4f36-86c0-7a0e2b09a177 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:16.978472 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e28932-3e85-4f36-86c0-7a0e2b09a177 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:16.978813 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e28932-3e85-4f36-86c0-7a0e2b09a177 None admin] PATH_INFO: `/v3/services` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:16.979508 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e28932-3e85-4f36-86c0-7a0e2b09a177 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:16.979873 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e28932-3e85-4f36-86c0-7a0e2b09a177 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:16.981732 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e28932-3e85-4f36-86c0-7a0e2b09a177 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:16.987969 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 450/879] 10.222.0.49 () {56 vars in 1122 bytes} [Thu Sep 29 01:59:16 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:17.034733 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af99554e-87a6-4521-b4ca-b635c65c53db None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:17.035017 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af99554e-87a6-4521-b4ca-b635c65c53db None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:17.035472 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af99554e-87a6-4521-b4ca-b635c65c53db None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:17.037305 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 451/880] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:59:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 29 01:59:17.043214 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285fbd5e-5750-4dc6-b703-fc668239a386 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:17.043564 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285fbd5e-5750-4dc6-b703-fc668239a386 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:17.043931 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285fbd5e-5750-4dc6-b703-fc668239a386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:17.063041 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8178f2be-4457-475b-9c1b-3f8019af0d38 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:17.063888 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-285fbd5e-5750-4dc6-b703-fc668239a386 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:59:17.065201 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-285fbd5e-5750-4dc6-b703-fc668239a386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:59:17.110002 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4d089c-2e6c-40f9-9a7f-f2234131e175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:17.110634 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4d089c-2e6c-40f9-9a7f-f2234131e175 None admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:17.110915 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4d089c-2e6c-40f9-9a7f-f2234131e175 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:17.111189 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4d089c-2e6c-40f9-9a7f-f2234131e175 None admin] PATH_INFO: `/v3/services` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:17.111858 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4d089c-2e6c-40f9-9a7f-f2234131e175 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:17.113238 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4d089c-2e6c-40f9-9a7f-f2234131e175 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:17.141428 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 430/881] 10.222.0.49 () {60 vars in 1141 bytes} [Thu Sep 29 01:59:16 2022] POST /identity/v3/services => generated 251 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 29 01:59:17.163621 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 452/882] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:59:17 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 29 01:59:17.164738 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4d089c-2e6c-40f9-9a7f-f2234131e175 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:17.239739 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:17.287111 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4d089c-2e6c-40f9-9a7f-f2234131e175 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:17.324718 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4925b04-1ae7-4313-8928-b2c938ea8550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:17.326161 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4925b04-1ae7-4313-8928-b2c938ea8550 None admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:17.326161 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4925b04-1ae7-4313-8928-b2c938ea8550 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:17.326161 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4925b04-1ae7-4313-8928-b2c938ea8550 None admin] PATH_INFO: `/v3/services` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:17.327348 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4925b04-1ae7-4313-8928-b2c938ea8550 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:17.329599 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4925b04-1ae7-4313-8928-b2c938ea8550 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:17.347092 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 431/883] 10.222.0.49 () {60 vars in 1141 bytes} [Thu Sep 29 01:59:17 2022] POST /identity/v3/services => generated 269 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 01:59:17.441872 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285fbd5e-5750-4dc6-b703-fc668239a386 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:17.564851 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285fbd5e-5750-4dc6-b703-fc668239a386 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:17.573527 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:17.608193 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f02623-e6c3-434c-83c3-74df5a2cf94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:17.608922 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f02623-e6c3-434c-83c3-74df5a2cf94c None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:17.609206 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f02623-e6c3-434c-83c3-74df5a2cf94c None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:17.609522 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f02623-e6c3-434c-83c3-74df5a2cf94c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:17.620486 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f02623-e6c3-434c-83c3-74df5a2cf94c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:59:17.626340 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-92f02623-e6c3-434c-83c3-74df5a2cf94c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 29 01:59:17.626340 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:17.626340 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:17.626340 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:17.626340 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:17.626340 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:17.626340 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:17.626340 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:17.626340 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:17.626340 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:17.626340 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:17.626340 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:17.626340 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:59:17.626340 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:59:17.626340 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:59:17.626340 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:59:17.628484 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:59:17.628484 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:59:17.628484 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:59:17.628484 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:59:17.628484 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:17.628484 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:17.628484 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:17.628484 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:17.628484 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:17.628484 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:17.628484 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:17.628484 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:17.628484 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:17.628484 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:17.628484 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:17.628484 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:17.630581 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:17.630581 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:17.630581 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:17.630581 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:17.630581 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:59:17.630581 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:59:17.630581 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:59:17.630581 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:59:17.630581 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:59:17.630581 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:59:17.630581 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 29 01:59:17.630581 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:59:17.630581 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 453/884] 10.222.0.49 () {56 vars in 1120 bytes} [Thu Sep 29 01:59:17 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:17.634130 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4925b04-1ae7-4313-8928-b2c938ea8550 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:17.737419 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4925b04-1ae7-4313-8928-b2c938ea8550 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:17.762088 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:17.773656 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58d83af-7c55-4624-8b7a-571f8d03278d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:17.774260 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58d83af-7c55-4624-8b7a-571f8d03278d None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:17.774525 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58d83af-7c55-4624-8b7a-571f8d03278d None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:17.774795 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58d83af-7c55-4624-8b7a-571f8d03278d None admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:17.775453 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58d83af-7c55-4624-8b7a-571f8d03278d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:17.775792 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58d83af-7c55-4624-8b7a-571f8d03278d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:17.777148 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58d83af-7c55-4624-8b7a-571f8d03278d None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:17.786425 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 432/885] 10.222.0.49 () {56 vars in 1115 bytes} [Thu Sep 29 01:59:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:17.792332 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f02623-e6c3-434c-83c3-74df5a2cf94c None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:17.904489 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f02623-e6c3-434c-83c3-74df5a2cf94c None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:17.940194 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f217507-2060-4ecd-a2d6-adcde989768c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:17.941111 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f217507-2060-4ecd-a2d6-adcde989768c None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:17.941568 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f217507-2060-4ecd-a2d6-adcde989768c None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:17.941977 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f217507-2060-4ecd-a2d6-adcde989768c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:17.954010 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f217507-2060-4ecd-a2d6-adcde989768c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:17.955693 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f217507-2060-4ecd-a2d6-adcde989768c None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:17.972026 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-8f217507-2060-4ecd-a2d6-adcde989768c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:17.972026 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:17.972026 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:17.972026 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:17.972026 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:17.972026 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:17.972026 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:17.972026 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:17.972026 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:17.972026 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:17.972026 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:17.972026 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:17.972026 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:59:17.972026 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:59:17.972026 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:59:17.972026 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:59:17.973244 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:17.973244 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:17.973244 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:17.973244 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:17.973244 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:17.973244 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:17.973244 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:17.973244 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:17.973244 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:17.973244 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:17.973244 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:17.973244 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:17.973244 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:17.973244 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:17.973244 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:17.973244 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:17.973244 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:59:17.974480 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:59:17.974480 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:17.974480 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:59:17.976182 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 454/886] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 01:59:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 01:59:17.981911 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58d83af-7c55-4624-8b7a-571f8d03278d None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:18.089592 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58d83af-7c55-4624-8b7a-571f8d03278d None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:18.131568 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018aae10-ef18-4c06-b4f8-b5aef601a9eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:18.132183 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018aae10-ef18-4c06-b4f8-b5aef601a9eb None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:18.132461 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018aae10-ef18-4c06-b4f8-b5aef601a9eb None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:18.132733 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018aae10-ef18-4c06-b4f8-b5aef601a9eb None admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:18.133403 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018aae10-ef18-4c06-b4f8-b5aef601a9eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:18.133706 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018aae10-ef18-4c06-b4f8-b5aef601a9eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:18.135062 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018aae10-ef18-4c06-b4f8-b5aef601a9eb None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:18.148436 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 433/887] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Sep 29 01:59:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:18.155437 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f217507-2060-4ecd-a2d6-adcde989768c None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:18.173634 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:18.265271 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f217507-2060-4ecd-a2d6-adcde989768c None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:18.302303 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59f0c27-93ac-4a47-ad2c-e18e5aa0abdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:18.303341 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59f0c27-93ac-4a47-ad2c-e18e5aa0abdc None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:18.303818 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59f0c27-93ac-4a47-ad2c-e18e5aa0abdc None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:18.304301 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59f0c27-93ac-4a47-ad2c-e18e5aa0abdc None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:18.312547 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59f0c27-93ac-4a47-ad2c-e18e5aa0abdc None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:18.314249 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59f0c27-93ac-4a47-ad2c-e18e5aa0abdc None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:18.325848 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-b59f0c27-93ac-4a47-ad2c-e18e5aa0abdc None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 29 01:59:18.325848 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:18.325848 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:18.325848 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:18.325848 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:18.325848 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:18.325848 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:18.325848 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:18.325848 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:18.325848 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:18.325848 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:18.325848 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:18.325848 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 29 01:59:18.325848 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 29 01:59:18.325848 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 29 01:59:18.325848 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 29 01:59:18.327879 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:18.327879 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:18.327879 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 29 01:59:18.327879 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:59:18.327879 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 29 01:59:18.327879 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:59:18.327879 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:18.327879 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:18.327879 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:18.327879 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:18.327879 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:18.327879 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:18.327879 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:18.327879 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:18.327879 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:18.327879 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:18.327879 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:18.327879 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:18.328817 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:18.328817 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:18.328817 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 29 01:59:18.328817 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 29 01:59:18.328817 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 29 01:59:18.328817 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 29 01:59:18.328817 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 29 01:59:18.328817 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 29 01:59:18.328817 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 29 01:59:18.328817 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:59:18.331323 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 455/888] 10.222.0.49 () {56 vars in 1117 bytes} [Thu Sep 29 01:59:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:18.337189 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018aae10-ef18-4c06-b4f8-b5aef601a9eb None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:18.388221 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:18.441676 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018aae10-ef18-4c06-b4f8-b5aef601a9eb None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:18.476131 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3daf060-c6a1-4bc3-8a81-3b01922f47d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:18.476801 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3daf060-c6a1-4bc3-8a81-3b01922f47d9 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:18.477121 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3daf060-c6a1-4bc3-8a81-3b01922f47d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:18.477444 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3daf060-c6a1-4bc3-8a81-3b01922f47d9 None admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:18.478184 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3daf060-c6a1-4bc3-8a81-3b01922f47d9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:18.478483 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3daf060-c6a1-4bc3-8a81-3b01922f47d9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:18.479935 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3daf060-c6a1-4bc3-8a81-3b01922f47d9 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:18.501392 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 434/889] 10.222.0.49 () {56 vars in 1149 bytes} [Thu Sep 29 01:59:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:18.507056 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59f0c27-93ac-4a47-ad2c-e18e5aa0abdc None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:18.587905 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:18.616570 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59f0c27-93ac-4a47-ad2c-e18e5aa0abdc None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:18.650738 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5128a73-c17a-45f1-b22b-5fed7aa5e5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:18.651338 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5128a73-c17a-45f1-b22b-5fed7aa5e5e7 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:18.651615 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5128a73-c17a-45f1-b22b-5fed7aa5e5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:18.651880 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5128a73-c17a-45f1-b22b-5fed7aa5e5e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:18.721956 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5128a73-c17a-45f1-b22b-5fed7aa5e5e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:18.723376 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5128a73-c17a-45f1-b22b-5fed7aa5e5e7 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:18.804647 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:18.832827 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 456/890] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Sep 29 01:59:18 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 29 01:59:18.838233 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3daf060-c6a1-4bc3-8a81-3b01922f47d9 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:18.948074 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3daf060-c6a1-4bc3-8a81-3b01922f47d9 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:18.950477 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:18.986914 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dd0fec-5d69-4d94-8dcd-be35f104aab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:18.987473 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd0fec-5d69-4d94-8dcd-be35f104aab7 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:18.987749 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd0fec-5d69-4d94-8dcd-be35f104aab7 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:18.988020 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd0fec-5d69-4d94-8dcd-be35f104aab7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:18.998749 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dd0fec-5d69-4d94-8dcd-be35f104aab7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:19.000550 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dd0fec-5d69-4d94-8dcd-be35f104aab7 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:19.016509 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-76dd0fec-5d69-4d94-8dcd-be35f104aab7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:19.016509 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:19.016509 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:19.016509 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:19.016509 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:19.016509 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:19.016509 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:19.016509 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:19.016509 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:19.016509 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:19.016509 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:19.016509 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:19.016509 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:59:19.016509 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:59:19.016509 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:59:19.016509 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:59:19.018282 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:19.018282 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:19.018282 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:19.018282 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:19.018282 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:19.018282 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:19.018282 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:19.018282 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:19.018282 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:19.018282 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:19.018282 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:19.018282 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:19.018282 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:19.018282 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:19.018282 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:19.018282 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:19.018282 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:59:19.019488 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:59:19.019488 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:19.019488 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:59:19.019488 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 435/891] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 01:59:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:19.023323 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5128a73-c17a-45f1-b22b-5fed7aa5e5e7 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:19.125928 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5128a73-c17a-45f1-b22b-5fed7aa5e5e7 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:19.165545 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc7be8-a3e1-4ab2-b495-29a08a378e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:19.166549 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc7be8-a3e1-4ab2-b495-29a08a378e55 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:19.166735 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc7be8-a3e1-4ab2-b495-29a08a378e55 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:19.166945 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc7be8-a3e1-4ab2-b495-29a08a378e55 None admin] PATH_INFO: `/v3/domains` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:19.167584 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dc7be8-a3e1-4ab2-b495-29a08a378e55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:19.167883 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dc7be8-a3e1-4ab2-b495-29a08a378e55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:19.169263 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dc7be8-a3e1-4ab2-b495-29a08a378e55 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:19.181434 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 457/892] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Sep 29 01:59:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:19.187390 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dd0fec-5d69-4d94-8dcd-be35f104aab7 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:19.293652 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dd0fec-5d69-4d94-8dcd-be35f104aab7 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:19.334559 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4b7abb-3a64-4b3e-bd9d-2a6044e8c78e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:19.335194 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b7abb-3a64-4b3e-bd9d-2a6044e8c78e None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:19.335614 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b7abb-3a64-4b3e-bd9d-2a6044e8c78e None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:19.335877 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b7abb-3a64-4b3e-bd9d-2a6044e8c78e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:19.343580 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4b7abb-3a64-4b3e-bd9d-2a6044e8c78e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:19.345022 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4b7abb-3a64-4b3e-bd9d-2a6044e8c78e None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:19.356790 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-ed4b7abb-3a64-4b3e-bd9d-2a6044e8c78e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:59:19.356790 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:19.356790 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:19.356790 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:19.356790 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:19.356790 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:19.356790 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:19.356790 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:19.356790 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:19.356790 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:19.356790 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:19.356790 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:19.356790 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 29 01:59:19.356790 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 29 01:59:19.356790 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 29 01:59:19.359122 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 29 01:59:19.359122 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:19.359122 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:19.359122 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:19.359122 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:19.359122 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:19.359122 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:19.359122 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:19.359122 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:19.359122 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:19.359122 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:19.359122 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:19.359122 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:19.359122 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:19.359122 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:19.359122 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:19.359122 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:19.361253 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 29 01:59:19.361253 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 29 01:59:19.361253 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 29 01:59:19.361253 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 29 01:59:19.361253 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 29 01:59:19.361253 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 29 01:59:19.361253 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:59:19.361253 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:59:19.361253 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 436/893] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Sep 29 01:59:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:19.366411 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc7be8-a3e1-4ab2-b495-29a08a378e55 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:19.405779 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:19.414945 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc12f5-ff57-483f-ab02-6be57e7b50c4 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:19.415560 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc12f5-ff57-483f-ab02-6be57e7b50c4 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:19.416315 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc12f5-ff57-483f-ab02-6be57e7b50c4 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:19.418580 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 437/894] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:59:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:59:19.425275 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8fee9-9275-4dcc-a1a2-f6e9a37f2edc None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:19.425623 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8fee9-9275-4dcc-a1a2-f6e9a37f2edc None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:19.425946 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8fee9-9275-4dcc-a1a2-f6e9a37f2edc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:19.446020 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-f4b8fee9-9275-4dcc-a1a2-f6e9a37f2edc None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:59:19.447341 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-f4b8fee9-9275-4dcc-a1a2-f6e9a37f2edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:59:19.459044 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:19.485939 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc7be8-a3e1-4ab2-b495-29a08a378e55 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:19.520558 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 438/895] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:59:19 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 29 01:59:19.527378 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b31cfe-dd7f-4dfa-ab13-909f7e3cdb9d None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:19.527378 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b31cfe-dd7f-4dfa-ab13-909f7e3cdb9d None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:19.527584 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acc50b1-f2ae-41b9-a58c-4c75fef4bae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:19.527699 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b31cfe-dd7f-4dfa-ab13-909f7e3cdb9d None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:19.527780 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acc50b1-f2ae-41b9-a58c-4c75fef4bae3 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:19.527780 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acc50b1-f2ae-41b9-a58c-4c75fef4bae3 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:19.527780 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acc50b1-f2ae-41b9-a58c-4c75fef4bae3 None admin] PATH_INFO: `/v3/projects` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:19.527975 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 439/896] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:59:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:59:19.528700 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2be326-8909-4703-9dc7-9f4f751fc357 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:19.528981 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2be326-8909-4703-9dc7-9f4f751fc357 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:19.529324 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2be326-8909-4703-9dc7-9f4f751fc357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:19.529549 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acc50b1-f2ae-41b9-a58c-4c75fef4bae3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:19.530608 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acc50b1-f2ae-41b9-a58c-4c75fef4bae3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:19.532250 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acc50b1-f2ae-41b9-a58c-4c75fef4bae3 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:19.549075 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 458/897] 10.222.0.49 () {56 vars in 1148 bytes} [Thu Sep 29 01:59:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:19.549744 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-9e2be326-8909-4703-9dc7-9f4f751fc357 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:59:19.551015 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-9e2be326-8909-4703-9dc7-9f4f751fc357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:59:19.560447 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acc50b1-f2ae-41b9-a58c-4c75fef4bae3 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:19.630964 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 440/898] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:59:19 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 29 01:59:19.678704 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:19.685236 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acc50b1-f2ae-41b9-a58c-4c75fef4bae3 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:19.719917 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08837cd-8d3d-4337-97b6-f986132e5b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:19.720518 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08837cd-8d3d-4337-97b6-f986132e5b41 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:19.720793 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08837cd-8d3d-4337-97b6-f986132e5b41 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:19.721063 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08837cd-8d3d-4337-97b6-f986132e5b41 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:19.721800 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08837cd-8d3d-4337-97b6-f986132e5b41 None admin] RBAC: Adding query filter params (role.id=3bbece89f99a4c658f63f212839b21ff, scope.project.id=6f1d8fd250c84c5887cb3173053ea2dd, user.id=0f8f13f302de4701a7f4e0562bca08cf) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:19.722182 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08837cd-8d3d-4337-97b6-f986132e5b41 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:19.723594 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08837cd-8d3d-4337-97b6-f986132e5b41 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:19.729525 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 459/899] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Sep 29 01:59:19 2022] GET /identity/v3/role_assignments?user.id=0f8f13f302de4701a7f4e0562bca08cf&scope.project.id=6f1d8fd250c84c5887cb3173053ea2dd&role.id=3bbece89f99a4c658f63f212839b21ff => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:19.817672 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2be326-8909-4703-9dc7-9f4f751fc357 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:19.908097 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:19.908563 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023115c2-70f3-48d5-9166-a878930f40f1 None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:19.909060 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023115c2-70f3-48d5-9166-a878930f40f1 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:19.909588 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023115c2-70f3-48d5-9166-a878930f40f1 None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:19.913971 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 460/900] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:59:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:59:19.914919 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023115c2-70f3-48d5-9166-a878930f40f1 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:19.939599 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2be326-8909-4703-9dc7-9f4f751fc357 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:19.977414 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eb5cdc-0f98-4efe-9c90-3ab93585e46e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:19.978037 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb5cdc-0f98-4efe-9c90-3ab93585e46e None admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:19.978312 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb5cdc-0f98-4efe-9c90-3ab93585e46e None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:19.978580 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb5cdc-0f98-4efe-9c90-3ab93585e46e None admin] PATH_INFO: `/v3/services` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:19.979240 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eb5cdc-0f98-4efe-9c90-3ab93585e46e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:19.980597 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eb5cdc-0f98-4efe-9c90-3ab93585e46e None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:19.997507 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 441/901] 10.222.0.49 () {60 vars in 1141 bytes} [Thu Sep 29 01:59:19 2022] POST /identity/v3/services => generated 241 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 01:59:19.999740 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45380a24-9eb1-4807-9c6d-a0e834c69041 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:20.000262 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45380a24-9eb1-4807-9c6d-a0e834c69041 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:20.000718 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45380a24-9eb1-4807-9c6d-a0e834c69041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:20.025865 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-45380a24-9eb1-4807-9c6d-a0e834c69041 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:59:20.028345 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-45380a24-9eb1-4807-9c6d-a0e834c69041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:59:20.043561 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023115c2-70f3-48d5-9166-a878930f40f1 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:20.093190 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b3616a-df67-4efb-a91d-8207bea4e853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:20.093769 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b3616a-df67-4efb-a91d-8207bea4e853 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:20.094045 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b3616a-df67-4efb-a91d-8207bea4e853 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:20.094318 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b3616a-df67-4efb-a91d-8207bea4e853 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:20.094959 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b3616a-df67-4efb-a91d-8207bea4e853 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:20.097207 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b3616a-df67-4efb-a91d-8207bea4e853 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:20.111184 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-65b3616a-df67-4efb-a91d-8207bea4e853 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 29 01:59:20.111184 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:20.111184 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 29 01:59:20.111184 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 29 01:59:20.111184 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 29 01:59:20.111184 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 29 01:59:20.111184 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 29 01:59:20.111184 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 29 01:59:20.111184 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 29 01:59:20.111184 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:59:20.111184 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 29 01:59:20.111184 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:59:20.111184 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:20.111184 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:20.111184 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:20.111184 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:20.111184 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:20.112302 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:20.112302 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:20.112302 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:20.112302 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:20.112302 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:20.112302 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:20.112302 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 29 01:59:20.112302 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 29 01:59:20.112302 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 29 01:59:20.112302 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 29 01:59:20.112302 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:20.112302 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:20.112302 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:20.112302 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:20.112302 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:20.112302 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:20.113149 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:20.113149 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:20.113149 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:20.113149 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:20.113149 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:20.113149 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:20.113149 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:20.113149 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:20.113149 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:20.113149 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:20.113149 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 29 01:59:20.113149 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 29 01:59:20.113149 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 29 01:59:20.113149 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:59:20.116103 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 461/902] 10.222.0.49 () {56 vars in 1114 bytes} [Thu Sep 29 01:59:19 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:20.121838 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b3616a-df67-4efb-a91d-8207bea4e853 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:20.131182 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 442/903] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:59:19 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 29 01:59:20.145461 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:20.240933 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b3616a-df67-4efb-a91d-8207bea4e853 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:20.277430 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97cb729-9662-4530-915d-9f353b87b344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:20.278477 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97cb729-9662-4530-915d-9f353b87b344 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:20.278967 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97cb729-9662-4530-915d-9f353b87b344 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:20.279546 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97cb729-9662-4530-915d-9f353b87b344 None admin] PATH_INFO: `/v3/services` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:20.280759 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97cb729-9662-4530-915d-9f353b87b344 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:20.281329 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97cb729-9662-4530-915d-9f353b87b344 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:20.283572 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97cb729-9662-4530-915d-9f353b87b344 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:20.288941 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 462/904] 10.222.0.49 () {56 vars in 1114 bytes} [Thu Sep 29 01:59:20 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:59:20.294859 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45380a24-9eb1-4807-9c6d-a0e834c69041 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:20.365060 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:20.401126 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45380a24-9eb1-4807-9c6d-a0e834c69041 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:20.401339 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97cb729-9662-4530-915d-9f353b87b344 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:20.441996 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecb4ed6-3fdb-47ff-b29f-2ece6a817405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:20.442609 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb4ed6-3fdb-47ff-b29f-2ece6a817405 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:20.442887 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb4ed6-3fdb-47ff-b29f-2ece6a817405 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:20.443157 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb4ed6-3fdb-47ff-b29f-2ece6a817405 None admin] PATH_INFO: `/v3/services` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:20.443794 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecb4ed6-3fdb-47ff-b29f-2ece6a817405 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:20.444094 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecb4ed6-3fdb-47ff-b29f-2ece6a817405 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:20.445479 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecb4ed6-3fdb-47ff-b29f-2ece6a817405 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:20.450880 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 443/905] 10.222.0.49 () {56 vars in 1114 bytes} [Thu Sep 29 01:59:20 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:20.457164 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecb4ed6-3fdb-47ff-b29f-2ece6a817405 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:20.509445 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:20.535544 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97cb729-9662-4530-915d-9f353b87b344 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:20.581703 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf4e1e4-977b-4b24-9254-84641acda46a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:20.582815 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf4e1e4-977b-4b24-9254-84641acda46a None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:20.583144 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf4e1e4-977b-4b24-9254-84641acda46a None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:20.583686 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf4e1e4-977b-4b24-9254-84641acda46a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:20.584277 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf4e1e4-977b-4b24-9254-84641acda46a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:20.586385 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf4e1e4-977b-4b24-9254-84641acda46a None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:20.589386 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecb4ed6-3fdb-47ff-b29f-2ece6a817405 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:20.598455 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-aaf4e1e4-977b-4b24-9254-84641acda46a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 29 01:59:20.598455 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:20.598455 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 29 01:59:20.598455 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 29 01:59:20.598455 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 29 01:59:20.598455 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 29 01:59:20.598455 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 29 01:59:20.598455 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 29 01:59:20.598455 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 29 01:59:20.598455 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:59:20.598455 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 29 01:59:20.598455 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:59:20.598455 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:20.598455 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:20.598455 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:20.598455 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:20.599528 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:20.599528 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:20.599528 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:20.599528 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:20.599528 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:20.599528 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:20.599528 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:20.599528 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 29 01:59:20.599528 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 29 01:59:20.599528 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 29 01:59:20.599528 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 29 01:59:20.599528 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:20.599528 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:20.599528 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:20.599528 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:20.599528 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:20.599528 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:20.600403 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:20.600403 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:20.600403 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:20.600403 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:20.600403 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:20.600403 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:20.600403 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:20.600403 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:20.600403 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:20.600403 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:20.600403 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 29 01:59:20.600403 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 29 01:59:20.600403 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 29 01:59:20.600403 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:59:20.600403 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 463/906] 10.222.0.49 () {56 vars in 1132 bytes} [Thu Sep 29 01:59:20 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:20.606589 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf4e1e4-977b-4b24-9254-84641acda46a None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:20.637761 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:20.647556 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04613ef-006a-463f-b628-56988ced6be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:20.648414 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04613ef-006a-463f-b628-56988ced6be1 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:20.648874 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04613ef-006a-463f-b628-56988ced6be1 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:20.649595 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04613ef-006a-463f-b628-56988ced6be1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:20.651565 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04613ef-006a-463f-b628-56988ced6be1 None admin] RBAC: Adding query filter params (interface=public, service_id=3924c9f0a6f248ccb760869e96189e38, region_id=RegionOne) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:20.652055 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04613ef-006a-463f-b628-56988ced6be1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:20.653657 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04613ef-006a-463f-b628-56988ced6be1 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:20.661483 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 444/907] 10.222.0.49 () {56 vars in 1251 bytes} [Thu Sep 29 01:59:20 2022] GET /identity/v3/endpoints?service_id=3924c9f0a6f248ccb760869e96189e38&interface=public®ion_id=RegionOne => generated 194 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:59:20.668218 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04613ef-006a-463f-b628-56988ced6be1 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:20.736255 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf4e1e4-977b-4b24-9254-84641acda46a None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:20.773393 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3a868b-0d2f-4dac-b014-b8daf1e28836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:20.774405 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a868b-0d2f-4dac-b014-b8daf1e28836 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:20.774891 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a868b-0d2f-4dac-b014-b8daf1e28836 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:20.775377 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a868b-0d2f-4dac-b014-b8daf1e28836 None admin] PATH_INFO: `/v3/services` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:20.776231 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3a868b-0d2f-4dac-b014-b8daf1e28836 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:20.776748 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3a868b-0d2f-4dac-b014-b8daf1e28836 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:20.778517 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3a868b-0d2f-4dac-b014-b8daf1e28836 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:20.786664 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 464/908] 10.222.0.49 () {56 vars in 1126 bytes} [Thu Sep 29 01:59:20 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:59:20.791886 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3a868b-0d2f-4dac-b014-b8daf1e28836 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:20.805599 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04613ef-006a-463f-b628-56988ced6be1 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:20.810738 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:20.852945 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108b96c9-65af-466b-a654-ccb69a09ee37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:20.854301 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108b96c9-65af-466b-a654-ccb69a09ee37 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:20.854745 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108b96c9-65af-466b-a654-ccb69a09ee37 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:20.855553 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108b96c9-65af-466b-a654-ccb69a09ee37 None admin] PATH_INFO: `/v3/services` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:20.856594 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108b96c9-65af-466b-a654-ccb69a09ee37 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:20.858708 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108b96c9-65af-466b-a654-ccb69a09ee37 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:20.867390 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 445/909] 10.222.0.49 () {56 vars in 1087 bytes} [Thu Sep 29 01:59:20 2022] GET /identity/v3/services => generated 1497 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 01:59:20.927328 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3a868b-0d2f-4dac-b014-b8daf1e28836 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:20.970018 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b3e371-e046-4174-87e6-1751f764a8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:20.970726 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b3e371-e046-4174-87e6-1751f764a8e3 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:20.971009 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b3e371-e046-4174-87e6-1751f764a8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:20.971280 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b3e371-e046-4174-87e6-1751f764a8e3 None admin] PATH_INFO: `/v3/services` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:20.971937 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b3e371-e046-4174-87e6-1751f764a8e3 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:20.972243 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b3e371-e046-4174-87e6-1751f764a8e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:20.973705 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b3e371-e046-4174-87e6-1751f764a8e3 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:20.980139 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 465/910] 10.222.0.49 () {56 vars in 1126 bytes} [Thu Sep 29 01:59:20 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:20.987201 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108b96c9-65af-466b-a654-ccb69a09ee37 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:21.057077 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:21.103652 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108b96c9-65af-466b-a654-ccb69a09ee37 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:21.141354 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba43ec10-5126-42cc-9713-8016af1fa995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:21.142398 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba43ec10-5126-42cc-9713-8016af1fa995 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:21.142941 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba43ec10-5126-42cc-9713-8016af1fa995 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:21.143416 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba43ec10-5126-42cc-9713-8016af1fa995 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:21.144337 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba43ec10-5126-42cc-9713-8016af1fa995 None admin] RBAC: Adding query filter params (interface=public, service_id=ba01e8a8eb354752bc1a61bd1142dd23, region_id=RegionOne) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:21.144874 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba43ec10-5126-42cc-9713-8016af1fa995 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:21.146467 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba43ec10-5126-42cc-9713-8016af1fa995 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:21.152174 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 446/911] 10.222.0.49 () {56 vars in 1251 bytes} [Thu Sep 29 01:59:20 2022] GET /identity/v3/endpoints?service_id=ba01e8a8eb354752bc1a61bd1142dd23&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:21.158540 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b3e371-e046-4174-87e6-1751f764a8e3 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:21.245944 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:21.273473 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b3e371-e046-4174-87e6-1751f764a8e3 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:21.309645 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d76fbe-1b44-46e3-b301-037321f31102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:21.310264 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d76fbe-1b44-46e3-b301-037321f31102 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:21.310541 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d76fbe-1b44-46e3-b301-037321f31102 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:21.310835 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d76fbe-1b44-46e3-b301-037321f31102 None admin] PATH_INFO: `/v3/services` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:21.311458 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d76fbe-1b44-46e3-b301-037321f31102 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:21.312831 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d76fbe-1b44-46e3-b301-037321f31102 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:21.319429 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 466/912] 10.222.0.49 () {56 vars in 1087 bytes} [Thu Sep 29 01:59:21 2022] GET /identity/v3/services => generated 1497 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 01:59:21.998169 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf9d580-10d4-492d-b6b4-83cdfcdf4940 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:22.000031 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf9d580-10d4-492d-b6b4-83cdfcdf4940 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:22.000539 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf9d580-10d4-492d-b6b4-83cdfcdf4940 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:22.002376 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 447/913] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:59:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:59:22.007293 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5600efb-fb03-4c39-a57c-3653d245969d None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:22.007585 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5600efb-fb03-4c39-a57c-3653d245969d None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:22.007862 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5600efb-fb03-4c39-a57c-3653d245969d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:22.026543 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-c5600efb-fb03-4c39-a57c-3653d245969d None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:59:22.027743 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-c5600efb-fb03-4c39-a57c-3653d245969d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:59:22.099971 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 467/914] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:59:22 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 29 01:59:22.251773 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef27c19-18b3-4d82-8f98-125fdd374df0 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:22.251971 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef27c19-18b3-4d82-8f98-125fdd374df0 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:22.252235 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef27c19-18b3-4d82-8f98-125fdd374df0 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:22.253869 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 448/915] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:59:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:59:22.260164 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f951e-d623-4512-8a01-60ecb0e5099e None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:22.260710 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f951e-d623-4512-8a01-60ecb0e5099e None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:22.260710 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f951e-d623-4512-8a01-60ecb0e5099e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:22.279435 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-b43f951e-d623-4512-8a01-60ecb0e5099e None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:59:22.281146 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-b43f951e-d623-4512-8a01-60ecb0e5099e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:59:22.345374 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:22.351511 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 468/916] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:59:22 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 29 01:59:22.391055 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef27c19-18b3-4d82-8f98-125fdd374df0 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:22.499647 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef27c19-18b3-4d82-8f98-125fdd374df0 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:22.524354 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:22.536707 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1151d085-7ccc-4c0f-915c-c564e044b3f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:22.537788 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1151d085-7ccc-4c0f-915c-c564e044b3f8 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:22.538500 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1151d085-7ccc-4c0f-915c-c564e044b3f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:22.538767 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1151d085-7ccc-4c0f-915c-c564e044b3f8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:22.550035 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1151d085-7ccc-4c0f-915c-c564e044b3f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:59:22.554863 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-1151d085-7ccc-4c0f-915c-c564e044b3f8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 29 01:59:22.554863 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:22.554863 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:22.554863 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:22.554863 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:22.554863 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:22.554863 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:22.554863 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:22.554863 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:22.554863 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:22.554863 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:22.554863 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:22.554863 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:59:22.554863 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:59:22.554863 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:59:22.554863 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:59:22.555794 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:59:22.555794 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:59:22.555794 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:59:22.555794 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:59:22.555794 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:22.555794 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:22.555794 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:22.555794 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:22.555794 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:22.555794 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:22.555794 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:22.555794 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:22.555794 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:22.555794 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:22.555794 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:22.555794 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:22.556642 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:22.556642 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:22.556642 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:22.556642 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:22.556642 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:59:22.556642 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:59:22.556642 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:59:22.556642 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:59:22.556642 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:59:22.556642 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:59:22.556642 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 29 01:59:22.556642 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:59:22.556642 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 449/917] 10.222.0.49 () {56 vars in 1120 bytes} [Thu Sep 29 01:59:22 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:22.564057 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43f951e-d623-4512-8a01-60ecb0e5099e None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:22.631379 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1151d085-7ccc-4c0f-915c-c564e044b3f8 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:22.671452 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43f951e-d623-4512-8a01-60ecb0e5099e None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:22.713126 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1a3889-c1e6-4fec-918b-622086479494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:22.713790 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a3889-c1e6-4fec-918b-622086479494 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:22.714075 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a3889-c1e6-4fec-918b-622086479494 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:22.714348 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a3889-c1e6-4fec-918b-622086479494 None admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:22.715014 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1a3889-c1e6-4fec-918b-622086479494 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:22.715340 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1a3889-c1e6-4fec-918b-622086479494 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:22.717002 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1a3889-c1e6-4fec-918b-622086479494 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:22.726596 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 469/918] 10.222.0.49 () {56 vars in 1115 bytes} [Thu Sep 29 01:59:22 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:22.731967 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1a3889-c1e6-4fec-918b-622086479494 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:22.755605 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1151d085-7ccc-4c0f-915c-c564e044b3f8 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:22.792759 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155f58af-d862-4b26-a1d3-30481e88df1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:22.793491 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f58af-d862-4b26-a1d3-30481e88df1a None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:22.793885 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f58af-d862-4b26-a1d3-30481e88df1a None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:22.794249 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f58af-d862-4b26-a1d3-30481e88df1a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:22.794944 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155f58af-d862-4b26-a1d3-30481e88df1a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:22.797302 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155f58af-d862-4b26-a1d3-30481e88df1a None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:22.806208 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:22.806772 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-155f58af-d862-4b26-a1d3-30481e88df1a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 29 01:59:22.806772 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:22.806772 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 29 01:59:22.806772 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 29 01:59:22.806772 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 29 01:59:22.806772 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 29 01:59:22.806772 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 29 01:59:22.806772 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 29 01:59:22.806772 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 29 01:59:22.806772 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:59:22.806772 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 29 01:59:22.806772 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:59:22.806772 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:22.806772 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:22.806772 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:22.806772 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:22.806772 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:22.807791 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:22.807791 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:22.807791 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:22.807791 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:22.807791 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:22.807791 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:22.807791 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 29 01:59:22.807791 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 29 01:59:22.807791 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 29 01:59:22.807791 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 29 01:59:22.807791 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:22.807791 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:22.807791 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:22.807791 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:22.807791 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:22.807791 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:22.808624 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:22.808624 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:22.808624 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:22.808624 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:22.808624 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:22.808624 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:22.808624 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:22.808624 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:22.808624 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:22.808624 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:22.808624 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 29 01:59:22.808624 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 29 01:59:22.808624 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 29 01:59:22.808624 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:59:22.808624 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 450/919] 10.222.0.49 () {56 vars in 1126 bytes} [Thu Sep 29 01:59:22 2022] GET /identity/v3/services/object-store => generated 93 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:22.816433 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155f58af-d862-4b26-a1d3-30481e88df1a None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:22.860023 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1a3889-c1e6-4fec-918b-622086479494 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:22.881345 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:22.899193 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04823227-c73a-4da2-a6e9-3cc5b678d625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:22.910905 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04823227-c73a-4da2-a6e9-3cc5b678d625 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:22.911198 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04823227-c73a-4da2-a6e9-3cc5b678d625 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:22.911531 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04823227-c73a-4da2-a6e9-3cc5b678d625 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:22.924474 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04823227-c73a-4da2-a6e9-3cc5b678d625 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:22.926080 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04823227-c73a-4da2-a6e9-3cc5b678d625 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:22.942294 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-04823227-c73a-4da2-a6e9-3cc5b678d625 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:22.942294 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:22.942294 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:22.942294 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:22.942294 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:22.942294 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:22.942294 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:22.942294 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:22.942294 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:22.942294 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:22.942294 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:22.942294 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:22.942294 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:59:22.942294 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:59:22.942294 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:59:22.942294 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:59:22.943287 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:22.943287 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:22.943287 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:22.943287 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:22.943287 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:22.943287 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:22.943287 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:22.943287 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:22.943287 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:22.943287 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:22.943287 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:22.943287 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:22.943287 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:22.943287 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:22.943287 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:22.943287 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:22.943287 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:59:22.944189 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:59:22.944189 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:22.944189 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:59:22.948222 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 470/920] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 01:59:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:22.949347 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04823227-c73a-4da2-a6e9-3cc5b678d625 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:22.954386 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155f58af-d862-4b26-a1d3-30481e88df1a None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:22.992319 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb244010-f9e9-45b4-a904-92234e8f05c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:22.993105 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb244010-f9e9-45b4-a904-92234e8f05c9 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:22.993219 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb244010-f9e9-45b4-a904-92234e8f05c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:22.993487 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb244010-f9e9-45b4-a904-92234e8f05c9 None admin] PATH_INFO: `/v3/services` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:22.994122 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb244010-f9e9-45b4-a904-92234e8f05c9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:22.994422 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb244010-f9e9-45b4-a904-92234e8f05c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:22.995787 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb244010-f9e9-45b4-a904-92234e8f05c9 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:23.006822 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 451/921] 10.222.0.49 () {56 vars in 1122 bytes} [Thu Sep 29 01:59:22 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:59:23.008240 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb244010-f9e9-45b4-a904-92234e8f05c9 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:23.080457 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04823227-c73a-4da2-a6e9-3cc5b678d625 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:23.095483 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:23.116713 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb244010-f9e9-45b4-a904-92234e8f05c9 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:23.119919 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1838110d-a531-43cd-ae9c-ed469bcd83b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:23.120804 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1838110d-a531-43cd-ae9c-ed469bcd83b6 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:23.121341 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1838110d-a531-43cd-ae9c-ed469bcd83b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:23.121820 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1838110d-a531-43cd-ae9c-ed469bcd83b6 None admin] PATH_INFO: `/v3/domains` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:23.122741 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1838110d-a531-43cd-ae9c-ed469bcd83b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:23.123913 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1838110d-a531-43cd-ae9c-ed469bcd83b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:23.125590 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1838110d-a531-43cd-ae9c-ed469bcd83b6 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:23.128619 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:23.139531 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 471/922] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Sep 29 01:59:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:23.146323 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1838110d-a531-43cd-ae9c-ed469bcd83b6 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:23.162835 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4de4472-0d86-4b71-a7d6-56a3a1756c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:23.163825 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de4472-0d86-4b71-a7d6-56a3a1756c90 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:23.163996 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de4472-0d86-4b71-a7d6-56a3a1756c90 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:23.164373 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de4472-0d86-4b71-a7d6-56a3a1756c90 None admin] PATH_INFO: `/v3/services` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:23.165155 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4de4472-0d86-4b71-a7d6-56a3a1756c90 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:23.165600 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4de4472-0d86-4b71-a7d6-56a3a1756c90 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:23.167387 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4de4472-0d86-4b71-a7d6-56a3a1756c90 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:23.177411 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 452/923] 10.222.0.49 () {56 vars in 1122 bytes} [Thu Sep 29 01:59:23 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:23.180432 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4de4472-0d86-4b71-a7d6-56a3a1756c90 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:23.281326 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1838110d-a531-43cd-ae9c-ed469bcd83b6 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:23.301808 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4de4472-0d86-4b71-a7d6-56a3a1756c90 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:23.316894 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e92b9f-5888-4c40-89e4-6e343bfa02e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:23.317553 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e92b9f-5888-4c40-89e4-6e343bfa02e0 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:23.317832 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e92b9f-5888-4c40-89e4-6e343bfa02e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:23.318102 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e92b9f-5888-4c40-89e4-6e343bfa02e0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:23.325277 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e92b9f-5888-4c40-89e4-6e343bfa02e0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:23.327346 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e92b9f-5888-4c40-89e4-6e343bfa02e0 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:23.336964 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd39df1c-e173-4116-a4f9-ce60de2da972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:23.337599 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd39df1c-e173-4116-a4f9-ce60de2da972 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:23.337881 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd39df1c-e173-4116-a4f9-ce60de2da972 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:23.338150 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd39df1c-e173-4116-a4f9-ce60de2da972 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:23.338845 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd39df1c-e173-4116-a4f9-ce60de2da972 None admin] RBAC: Adding query filter params (interface=public, service_id=a705977d734b4badbe5b124ad10f4698, region_id=RegionOne) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:23.339081 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-f6e92b9f-5888-4c40-89e4-6e343bfa02e0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 29 01:59:23.339081 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:23.339081 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:23.339081 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:23.339081 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:23.339081 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:23.339081 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:23.339081 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:23.339081 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:23.339081 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:23.339081 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:23.339081 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:23.339081 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 29 01:59:23.339081 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 29 01:59:23.339081 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 29 01:59:23.339081 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 29 01:59:23.340020 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:23.340020 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:23.340020 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 29 01:59:23.340020 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:59:23.340020 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 29 01:59:23.340020 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:59:23.340020 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:23.340020 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:23.340020 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:23.340020 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:23.340020 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:23.340020 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:23.340020 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:23.340020 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:23.340020 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:23.340020 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:23.340020 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:23.340020 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:23.340955 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:23.340955 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:23.340955 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 29 01:59:23.340955 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 29 01:59:23.340955 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 29 01:59:23.340955 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 29 01:59:23.340955 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 29 01:59:23.340955 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 29 01:59:23.340955 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 29 01:59:23.340955 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:59:23.342227 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd39df1c-e173-4116-a4f9-ce60de2da972 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:23.342519 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 472/924] 10.222.0.49 () {56 vars in 1117 bytes} [Thu Sep 29 01:59:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:23.342519 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfc53b5-f818-4524-b24d-3d33d7bd83fe None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:23.342519 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfc53b5-f818-4524-b24d-3d33d7bd83fe None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:23.342708 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfc53b5-f818-4524-b24d-3d33d7bd83fe None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:23.344081 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 473/925] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:59:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:59:23.345168 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd39df1c-e173-4116-a4f9-ce60de2da972 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:23.348916 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfc53b5-f818-4524-b24d-3d33d7bd83fe None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:23.356031 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 453/926] 10.222.0.49 () {56 vars in 1251 bytes} [Thu Sep 29 01:59:23 2022] GET /identity/v3/endpoints?service_id=a705977d734b4badbe5b124ad10f4698&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:23.356031 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d4819-fa96-4146-b92c-5c672d50e0be None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:23.356031 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d4819-fa96-4146-b92c-5c672d50e0be None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:23.356031 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d4819-fa96-4146-b92c-5c672d50e0be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:23.371718 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-562d4819-fa96-4146-b92c-5c672d50e0be None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:59:23.372637 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-562d4819-fa96-4146-b92c-5c672d50e0be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:59:23.389425 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:23.406790 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:23.453542 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 454/927] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:59:23 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 29 01:59:23.454471 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562d4819-fa96-4146-b92c-5c672d50e0be None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:23.478781 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfc53b5-f818-4524-b24d-3d33d7bd83fe None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:23.518537 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097f9630-c276-4764-908d-f2939a0aa8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:23.519171 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f9630-c276-4764-908d-f2939a0aa8d1 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:23.519452 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f9630-c276-4764-908d-f2939a0aa8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:23.519778 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f9630-c276-4764-908d-f2939a0aa8d1 None admin] PATH_INFO: `/v3/users` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:23.520518 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097f9630-c276-4764-908d-f2939a0aa8d1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:23.520977 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097f9630-c276-4764-908d-f2939a0aa8d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:23.522653 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097f9630-c276-4764-908d-f2939a0aa8d1 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:23.548320 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 474/928] 10.222.0.49 () {56 vars in 1149 bytes} [Thu Sep 29 01:59:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:23.550181 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097f9630-c276-4764-908d-f2939a0aa8d1 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:23.581524 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562d4819-fa96-4146-b92c-5c672d50e0be None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:23.619472 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e637938b-4ee0-484b-b69d-4b4508f0e425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:23.620007 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e637938b-4ee0-484b-b69d-4b4508f0e425 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:23.620292 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e637938b-4ee0-484b-b69d-4b4508f0e425 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:23.620563 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e637938b-4ee0-484b-b69d-4b4508f0e425 None admin] PATH_INFO: `/v3/services` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:23.621227 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e637938b-4ee0-484b-b69d-4b4508f0e425 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:23.622798 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e637938b-4ee0-484b-b69d-4b4508f0e425 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:23.633358 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 455/929] 10.222.0.49 () {56 vars in 1087 bytes} [Thu Sep 29 01:59:23 2022] GET /identity/v3/services => generated 1497 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 01:59:23.633358 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50feed7a-52f6-4e19-802e-b5f8f8102e62 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:23.633358 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50feed7a-52f6-4e19-802e-b5f8f8102e62 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:23.633358 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50feed7a-52f6-4e19-802e-b5f8f8102e62 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:23.633358 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 456/930] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:59:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:59:23.638633 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727deb03-d51e-4989-9d85-10393becbb61 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:23.639610 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727deb03-d51e-4989-9d85-10393becbb61 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:23.639881 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727deb03-d51e-4989-9d85-10393becbb61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:23.656921 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:23.664720 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-727deb03-d51e-4989-9d85-10393becbb61 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:59:23.666242 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-727deb03-d51e-4989-9d85-10393becbb61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:59:23.674840 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097f9630-c276-4764-908d-f2939a0aa8d1 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:23.702080 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:23.729512 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da255a7f-cfd1-448f-8622-b768342a48df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:23.730865 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da255a7f-cfd1-448f-8622-b768342a48df None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:23.731309 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da255a7f-cfd1-448f-8622-b768342a48df None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:23.731733 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da255a7f-cfd1-448f-8622-b768342a48df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:23.747289 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da255a7f-cfd1-448f-8622-b768342a48df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:23.749564 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da255a7f-cfd1-448f-8622-b768342a48df None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:23.756869 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 457/931] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:59:23 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 29 01:59:23.756869 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727deb03-d51e-4989-9d85-10393becbb61 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:23.778467 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-da255a7f-cfd1-448f-8622-b768342a48df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:23.778467 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:23.778467 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:23.778467 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:23.778467 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:23.778467 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:23.778467 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:23.778467 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:23.778467 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:23.778467 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:23.778467 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:23.778467 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:23.778467 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:59:23.778467 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:59:23.778467 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:59:23.778467 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:59:23.780078 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:23.780078 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:23.780078 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:23.780078 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:23.780078 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:23.780078 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:23.780078 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:23.780078 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:23.780078 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:23.780078 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:23.780078 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:23.780078 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:23.780078 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:23.780078 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:23.780078 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:23.780078 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:23.780078 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:59:23.781111 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:59:23.781111 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:23.781111 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:59:23.783092 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 475/932] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 01:59:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 01:59:23.788799 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da255a7f-cfd1-448f-8622-b768342a48df None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:23.881183 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727deb03-d51e-4989-9d85-10393becbb61 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:23.928748 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da255a7f-cfd1-448f-8622-b768342a48df None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:23.930030 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13410915-c718-4c4a-af6d-4a831285967e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:23.931040 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13410915-c718-4c4a-af6d-4a831285967e None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:23.931583 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13410915-c718-4c4a-af6d-4a831285967e None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:23.932080 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13410915-c718-4c4a-af6d-4a831285967e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:23.932861 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13410915-c718-4c4a-af6d-4a831285967e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:23.934455 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13410915-c718-4c4a-af6d-4a831285967e None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:23.945975 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-13410915-c718-4c4a-af6d-4a831285967e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 29 01:59:23.945975 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:23.945975 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 29 01:59:23.945975 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 29 01:59:23.945975 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 29 01:59:23.945975 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 29 01:59:23.945975 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 29 01:59:23.945975 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 29 01:59:23.945975 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 29 01:59:23.945975 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:59:23.945975 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 29 01:59:23.945975 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:59:23.945975 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:23.945975 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:23.945975 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:23.945975 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:23.945975 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:23.947016 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:23.947016 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:23.947016 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:23.947016 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:23.947016 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:23.947016 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:23.947016 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 29 01:59:23.947016 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 29 01:59:23.947016 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 29 01:59:23.947016 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 29 01:59:23.947016 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:23.947016 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:23.947016 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:23.947016 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:23.947016 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:23.947016 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:23.947846 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:23.947846 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:23.947846 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:23.947846 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:23.947846 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:23.947846 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:23.947846 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:23.947846 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:23.947846 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:23.947846 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:23.947846 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 29 01:59:23.947846 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 29 01:59:23.947846 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 29 01:59:23.947846 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:59:23.955529 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 458/933] 10.222.0.49 () {56 vars in 1114 bytes} [Thu Sep 29 01:59:23 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:23.957073 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13410915-c718-4c4a-af6d-4a831285967e None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:23.971306 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49e9af9-0108-4a22-b2dd-583b66dd1334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:23.972635 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49e9af9-0108-4a22-b2dd-583b66dd1334 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:23.973456 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49e9af9-0108-4a22-b2dd-583b66dd1334 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:23.973932 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49e9af9-0108-4a22-b2dd-583b66dd1334 None admin] PATH_INFO: `/v3/domains` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:23.975027 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49e9af9-0108-4a22-b2dd-583b66dd1334 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:23.976001 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49e9af9-0108-4a22-b2dd-583b66dd1334 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:23.978141 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49e9af9-0108-4a22-b2dd-583b66dd1334 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:23.989963 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:23.997422 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 476/934] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Sep 29 01:59:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:24.009134 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49e9af9-0108-4a22-b2dd-583b66dd1334 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:24.009511 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:24.070006 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13410915-c718-4c4a-af6d-4a831285967e None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:24.108337 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53a290b-8da4-454e-b0b4-c45ddb9a208f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:24.109090 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53a290b-8da4-454e-b0b4-c45ddb9a208f None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:24.109386 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53a290b-8da4-454e-b0b4-c45ddb9a208f None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:24.109660 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53a290b-8da4-454e-b0b4-c45ddb9a208f None admin] PATH_INFO: `/v3/services` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:24.110286 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53a290b-8da4-454e-b0b4-c45ddb9a208f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:24.110584 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53a290b-8da4-454e-b0b4-c45ddb9a208f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:24.111942 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53a290b-8da4-454e-b0b4-c45ddb9a208f None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:24.115817 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49e9af9-0108-4a22-b2dd-583b66dd1334 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:24.116879 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 459/935] 10.222.0.49 () {56 vars in 1114 bytes} [Thu Sep 29 01:59:23 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:24.117515 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53a290b-8da4-454e-b0b4-c45ddb9a208f None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:24.152126 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da6424b-ff5b-409f-a022-f1cc07c915a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:24.152679 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da6424b-ff5b-409f-a022-f1cc07c915a7 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:24.153059 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da6424b-ff5b-409f-a022-f1cc07c915a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:24.153257 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da6424b-ff5b-409f-a022-f1cc07c915a7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:24.161720 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da6424b-ff5b-409f-a022-f1cc07c915a7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:24.163170 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da6424b-ff5b-409f-a022-f1cc07c915a7 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:24.176413 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-6da6424b-ff5b-409f-a022-f1cc07c915a7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:59:24.176413 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:24.176413 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:24.176413 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:24.176413 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:24.176413 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:24.176413 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:24.176413 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:24.176413 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:24.176413 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:24.176413 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:24.176413 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:24.176413 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 29 01:59:24.176413 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 29 01:59:24.176413 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 29 01:59:24.177336 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 29 01:59:24.177336 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:24.177336 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:24.177336 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:24.177336 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:24.177336 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:24.177336 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:24.177336 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:24.177336 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:24.177336 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:24.177336 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:24.177336 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:24.177336 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:24.177336 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:24.177336 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:24.177336 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:24.177336 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:24.178222 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 29 01:59:24.178222 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 29 01:59:24.178222 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 29 01:59:24.178222 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 29 01:59:24.178222 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 29 01:59:24.178222 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 29 01:59:24.178222 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:59:24.178222 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:59:24.178222 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 477/936] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Sep 29 01:59:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:24.178694 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da6424b-ff5b-409f-a022-f1cc07c915a7 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:24.219364 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:24.230028 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53a290b-8da4-454e-b0b4-c45ddb9a208f None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:24.242878 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:24.273965 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da3098a-5c15-47b7-a781-1676fd528551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:24.274596 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da3098a-5c15-47b7-a781-1676fd528551 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:24.274868 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da3098a-5c15-47b7-a781-1676fd528551 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:24.275136 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da3098a-5c15-47b7-a781-1676fd528551 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:24.275715 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da3098a-5c15-47b7-a781-1676fd528551 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:24.277056 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da3098a-5c15-47b7-a781-1676fd528551 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:24.283941 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da6424b-ff5b-409f-a022-f1cc07c915a7 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:24.287274 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-2da3098a-5c15-47b7-a781-1676fd528551 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 29 01:59:24.287274 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:24.287274 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 29 01:59:24.287274 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 29 01:59:24.287274 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 29 01:59:24.287274 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 29 01:59:24.287274 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 29 01:59:24.287274 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 29 01:59:24.287274 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 29 01:59:24.287274 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:59:24.287274 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 29 01:59:24.287274 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:59:24.287274 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:24.287274 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:24.287274 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:24.287274 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:24.288183 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:24.288183 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:24.288183 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:24.288183 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:24.288183 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:24.288183 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:24.288183 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:24.288183 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 29 01:59:24.288183 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 29 01:59:24.288183 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 29 01:59:24.288183 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 29 01:59:24.288183 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:24.288183 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:24.288183 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:24.288183 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:24.288183 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:24.288183 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:24.289067 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:24.289067 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:24.289067 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:24.289067 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:24.289067 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:24.289067 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:24.289067 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:24.289067 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:24.289067 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:24.289067 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:24.289067 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 29 01:59:24.289067 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 29 01:59:24.289067 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 29 01:59:24.289067 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:59:24.293564 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 460/937] 10.222.0.49 () {56 vars in 1132 bytes} [Thu Sep 29 01:59:24 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:24.294282 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da3098a-5c15-47b7-a781-1676fd528551 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:24.319064 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b091cc2-a559-41e9-be43-6d32e8e17e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:24.319675 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b091cc2-a559-41e9-be43-6d32e8e17e8d None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:24.320032 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b091cc2-a559-41e9-be43-6d32e8e17e8d None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:24.320218 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b091cc2-a559-41e9-be43-6d32e8e17e8d None admin] PATH_INFO: `/v3/services` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:24.320847 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b091cc2-a559-41e9-be43-6d32e8e17e8d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:24.321358 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b091cc2-a559-41e9-be43-6d32e8e17e8d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:24.322571 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b091cc2-a559-41e9-be43-6d32e8e17e8d None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:24.328537 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 478/938] 10.222.0.49 () {56 vars in 1114 bytes} [Thu Sep 29 01:59:24 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:24.329380 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b091cc2-a559-41e9-be43-6d32e8e17e8d None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:24.407265 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da3098a-5c15-47b7-a781-1676fd528551 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:24.441288 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b091cc2-a559-41e9-be43-6d32e8e17e8d None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:24.442909 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826ce24b-8d4d-4f8c-882c-4c9527ffffbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:24.444225 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826ce24b-8d4d-4f8c-882c-4c9527ffffbf None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:24.444225 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826ce24b-8d4d-4f8c-882c-4c9527ffffbf None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:24.444225 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826ce24b-8d4d-4f8c-882c-4c9527ffffbf None admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:24.444964 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826ce24b-8d4d-4f8c-882c-4c9527ffffbf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:24.445351 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826ce24b-8d4d-4f8c-882c-4c9527ffffbf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:24.446821 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826ce24b-8d4d-4f8c-882c-4c9527ffffbf None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:24.464574 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 461/939] 10.222.0.49 () {56 vars in 1148 bytes} [Thu Sep 29 01:59:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:24.464574 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826ce24b-8d4d-4f8c-882c-4c9527ffffbf None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:24.475934 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:24.480076 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:24.485263 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94800f30-cc87-4511-a561-cf5ed5198588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:24.485906 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94800f30-cc87-4511-a561-cf5ed5198588 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:24.486189 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94800f30-cc87-4511-a561-cf5ed5198588 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:24.486464 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94800f30-cc87-4511-a561-cf5ed5198588 None admin] PATH_INFO: `/v3/services` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:24.487097 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94800f30-cc87-4511-a561-cf5ed5198588 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:24.487401 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94800f30-cc87-4511-a561-cf5ed5198588 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:24.488777 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94800f30-cc87-4511-a561-cf5ed5198588 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:24.494197 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 479/940] 10.222.0.49 () {56 vars in 1126 bytes} [Thu Sep 29 01:59:24 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:24.499502 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94800f30-cc87-4511-a561-cf5ed5198588 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:24.580826 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826ce24b-8d4d-4f8c-882c-4c9527ffffbf None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:24.614920 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aafd67-46d7-40d6-83ec-76ebe4d73c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:24.615506 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94800f30-cc87-4511-a561-cf5ed5198588 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:24.615618 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aafd67-46d7-40d6-83ec-76ebe4d73c91 None admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:24.615797 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aafd67-46d7-40d6-83ec-76ebe4d73c91 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:24.616064 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aafd67-46d7-40d6-83ec-76ebe4d73c91 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:24.616731 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aafd67-46d7-40d6-83ec-76ebe4d73c91 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:24.618130 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aafd67-46d7-40d6-83ec-76ebe4d73c91 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:24.641494 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 462/941] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 01:59:24 2022] POST /identity/v3/endpoints => generated 346 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 01:59:24.642359 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aafd67-46d7-40d6-83ec-76ebe4d73c91 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:24.683705 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23edede4-7c34-4715-80ed-35bbcf54a9ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:24.684768 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23edede4-7c34-4715-80ed-35bbcf54a9ae None admin] REQUEST_METHOD: `PUT` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:24.685532 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23edede4-7c34-4715-80ed-35bbcf54a9ae None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:24.687742 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23edede4-7c34-4715-80ed-35bbcf54a9ae None admin] PATH_INFO: `/v3/projects/6f1d8fd250c84c5887cb3173053ea2dd/users/0f8f13f302de4701a7f4e0562bca08cf/roles/3bbece89f99a4c658f63f212839b21ff` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:24.690399 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23edede4-7c34-4715-80ed-35bbcf54a9ae None admin] RBAC: Authorizing `identity:create_grant(project_id=6f1d8fd250c84c5887cb3173053ea2dd, user_id=0f8f13f302de4701a7f4e0562bca08cf, role_id=3bbece89f99a4c658f63f212839b21ff)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:24.692883 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23edede4-7c34-4715-80ed-35bbcf54a9ae None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:24.713828 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 480/942] 10.222.0.49 () {58 vars in 1439 bytes} [Thu Sep 29 01:59:24 2022] PUT /identity/v3/projects/6f1d8fd250c84c5887cb3173053ea2dd/users/0f8f13f302de4701a7f4e0562bca08cf/roles/3bbece89f99a4c658f63f212839b21ff => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 01:59:24.729580 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:24.778039 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aafd67-46d7-40d6-83ec-76ebe4d73c91 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:24.821703 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d204f66e-3c31-4cc6-b5d0-3ef634b17469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:24.822400 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d204f66e-3c31-4cc6-b5d0-3ef634b17469 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:24.822682 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d204f66e-3c31-4cc6-b5d0-3ef634b17469 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:24.822954 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d204f66e-3c31-4cc6-b5d0-3ef634b17469 None admin] PATH_INFO: `/v3/services` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:24.823616 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d204f66e-3c31-4cc6-b5d0-3ef634b17469 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:24.823921 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d204f66e-3c31-4cc6-b5d0-3ef634b17469 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:24.825357 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d204f66e-3c31-4cc6-b5d0-3ef634b17469 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:24.832345 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 463/943] 10.222.0.49 () {56 vars in 1126 bytes} [Thu Sep 29 01:59:24 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:24.837904 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23edede4-7c34-4715-80ed-35bbcf54a9ae None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:24.893908 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:24.960362 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23edede4-7c34-4715-80ed-35bbcf54a9ae None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:24.998619 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3818706-ba90-47f4-ae72-b10b7fb29d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:24.999644 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3818706-ba90-47f4-ae72-b10b7fb29d75 None admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:25.000130 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3818706-ba90-47f4-ae72-b10b7fb29d75 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:25.000641 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3818706-ba90-47f4-ae72-b10b7fb29d75 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:25.001566 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3818706-ba90-47f4-ae72-b10b7fb29d75 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:25.003120 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3818706-ba90-47f4-ae72-b10b7fb29d75 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:25.025922 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 481/944] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 01:59:24 2022] POST /identity/v3/endpoints => generated 347 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 01:59:25.913851 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d04908a-3f0c-4579-84b9-e7e88203298e None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:25.914312 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d04908a-3f0c-4579-84b9-e7e88203298e None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:25.914406 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d04908a-3f0c-4579-84b9-e7e88203298e None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:25.916230 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 464/945] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:59:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:59:25.923046 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e561e-295c-46d5-b8f4-9183c5da5a5c None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:25.923478 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e561e-295c-46d5-b8f4-9183c5da5a5c None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:25.923810 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e561e-295c-46d5-b8f4-9183c5da5a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:25.944056 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-265e561e-295c-46d5-b8f4-9183c5da5a5c None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:59:25.945501 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-265e561e-295c-46d5-b8f4-9183c5da5a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:59:26.022958 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 482/946] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:59:25 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 29 01:59:26.293300 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d04908a-3f0c-4579-84b9-e7e88203298e None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:26.407558 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d04908a-3f0c-4579-84b9-e7e88203298e None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:26.443629 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ac9191-8bfb-4be2-8075-e5c82049cd5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:26.444263 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac9191-8bfb-4be2-8075-e5c82049cd5d None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:26.444542 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac9191-8bfb-4be2-8075-e5c82049cd5d None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:26.444813 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac9191-8bfb-4be2-8075-e5c82049cd5d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:26.445425 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ac9191-8bfb-4be2-8075-e5c82049cd5d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:26.446907 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ac9191-8bfb-4be2-8075-e5c82049cd5d None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:26.448702 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:26.457501 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-05ac9191-8bfb-4be2-8075-e5c82049cd5d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 29 01:59:26.457501 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:26.457501 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 29 01:59:26.457501 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 29 01:59:26.457501 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 29 01:59:26.457501 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 29 01:59:26.457501 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 29 01:59:26.457501 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 29 01:59:26.457501 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 29 01:59:26.457501 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:59:26.457501 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 29 01:59:26.457501 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:59:26.457501 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:26.457501 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:26.457501 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:26.457501 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:26.457501 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:26.458510 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:26.458510 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:26.458510 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:26.458510 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:26.458510 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:26.458510 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:26.458510 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 29 01:59:26.458510 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 29 01:59:26.458510 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 29 01:59:26.458510 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 29 01:59:26.458510 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:26.458510 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:26.458510 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:26.458510 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:26.458510 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:26.458510 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:26.459354 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:26.459354 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:26.459354 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:26.459354 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:26.459354 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:26.459354 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:26.459354 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:26.459354 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:26.459354 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:26.459354 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:26.459354 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 29 01:59:26.459354 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 29 01:59:26.459354 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 29 01:59:26.459354 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:59:26.459354 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 465/947] 10.222.0.49 () {56 vars in 1126 bytes} [Thu Sep 29 01:59:26 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:26.464803 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265e561e-295c-46d5-b8f4-9183c5da5a5c None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:26.493787 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:26.572606 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265e561e-295c-46d5-b8f4-9183c5da5a5c None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:26.609321 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60647bd-cd0d-44ed-8918-12d4e833fff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:26.609959 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60647bd-cd0d-44ed-8918-12d4e833fff6 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:26.610239 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60647bd-cd0d-44ed-8918-12d4e833fff6 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:26.610509 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60647bd-cd0d-44ed-8918-12d4e833fff6 None admin] PATH_INFO: `/v3/services` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:26.611141 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60647bd-cd0d-44ed-8918-12d4e833fff6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:26.611444 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60647bd-cd0d-44ed-8918-12d4e833fff6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:26.612819 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60647bd-cd0d-44ed-8918-12d4e833fff6 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:26.618130 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 483/948] 10.222.0.49 () {56 vars in 1122 bytes} [Thu Sep 29 01:59:26 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:26.624753 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ac9191-8bfb-4be2-8075-e5c82049cd5d None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:26.731534 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ac9191-8bfb-4be2-8075-e5c82049cd5d None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:26.767363 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a6bdd1-38e1-4320-8aea-6e36e3960591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:26.767975 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a6bdd1-38e1-4320-8aea-6e36e3960591 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:26.768302 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a6bdd1-38e1-4320-8aea-6e36e3960591 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:26.768618 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a6bdd1-38e1-4320-8aea-6e36e3960591 None admin] PATH_INFO: `/v3/services` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:26.769250 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a6bdd1-38e1-4320-8aea-6e36e3960591 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:26.769580 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a6bdd1-38e1-4320-8aea-6e36e3960591 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:26.770952 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a6bdd1-38e1-4320-8aea-6e36e3960591 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:26.776394 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 466/949] 10.222.0.49 () {56 vars in 1122 bytes} [Thu Sep 29 01:59:26 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:26.782699 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60647bd-cd0d-44ed-8918-12d4e833fff6 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:26.885996 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:26.895189 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60647bd-cd0d-44ed-8918-12d4e833fff6 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:26.933009 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6f5a53-3c2c-40e7-b6c9-43edd01894e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:26.933749 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f5a53-3c2c-40e7-b6c9-43edd01894e9 None admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:26.933980 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f5a53-3c2c-40e7-b6c9-43edd01894e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:26.934208 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f5a53-3c2c-40e7-b6c9-43edd01894e9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:26.934914 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6f5a53-3c2c-40e7-b6c9-43edd01894e9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:26.937045 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6f5a53-3c2c-40e7-b6c9-43edd01894e9 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:26.961010 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 484/950] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 01:59:26 2022] POST /identity/v3/endpoints => generated 349 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 01:59:26.971245 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed7d9e-7259-4d7b-8df0-b258d1a38847 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:26.971764 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed7d9e-7259-4d7b-8df0-b258d1a38847 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:26.973714 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed7d9e-7259-4d7b-8df0-b258d1a38847 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:26.975798 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 467/951] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:59:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:59:26.982215 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca58e42-f884-43ec-9aba-1a36424a46e2 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:26.982713 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca58e42-f884-43ec-9aba-1a36424a46e2 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:26.982950 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca58e42-f884-43ec-9aba-1a36424a46e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:27.003622 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-2ca58e42-f884-43ec-9aba-1a36424a46e2 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:59:27.004874 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-2ca58e42-f884-43ec-9aba-1a36424a46e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:59:27.055415 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b48030-a19f-4d32-b723-638617c63bcb None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:27.055749 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b48030-a19f-4d32-b723-638617c63bcb None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:27.055988 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b48030-a19f-4d32-b723-638617c63bcb None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:27.057790 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 468/952] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:59:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:59:27.067913 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621817e9-3d48-4f16-a288-8169f698514c None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:27.068352 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621817e9-3d48-4f16-a288-8169f698514c None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:27.068764 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621817e9-3d48-4f16-a288-8169f698514c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:27.091089 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-621817e9-3d48-4f16-a288-8169f698514c None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:59:27.092477 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 485/953] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:59:26 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 29 01:59:27.092687 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-621817e9-3d48-4f16-a288-8169f698514c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:59:27.158896 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:27.169099 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 469/954] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:59:27 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 29 01:59:27.362331 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca58e42-f884-43ec-9aba-1a36424a46e2 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:27.370275 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89de1d6-5dec-42e9-9339-d0699940607b None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:27.370562 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89de1d6-5dec-42e9-9339-d0699940607b None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:27.370837 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89de1d6-5dec-42e9-9339-d0699940607b None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:27.373592 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 470/955] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:59:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 29 01:59:27.379733 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be7341-c920-4c3c-ae01-38167ec2de10 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:27.380022 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be7341-c920-4c3c-ae01-38167ec2de10 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:27.380303 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be7341-c920-4c3c-ae01-38167ec2de10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:27.403003 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-c4be7341-c920-4c3c-ae01-38167ec2de10 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:59:27.404736 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-c4be7341-c920-4c3c-ae01-38167ec2de10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:59:27.448993 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:27.478030 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca58e42-f884-43ec-9aba-1a36424a46e2 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:27.489948 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 471/956] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:59:27 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 29 01:59:27.490814 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be7341-c920-4c3c-ae01-38167ec2de10 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:27.520813 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b78af3-e862-446f-b5dc-ec95b724661c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:27.521462 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b78af3-e862-446f-b5dc-ec95b724661c None admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:27.521757 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b78af3-e862-446f-b5dc-ec95b724661c None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:27.522165 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b78af3-e862-446f-b5dc-ec95b724661c None admin] PATH_INFO: `/v3/projects` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:27.522778 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b78af3-e862-446f-b5dc-ec95b724661c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:27.524350 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b78af3-e862-446f-b5dc-ec95b724661c None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:27.527068 dv-cinder-740146-21-smb devstack@keystone.service[81648]: WARNING keystone.server.flask.common [None req-09b78af3-e862-446f-b5dc-ec95b724661c None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 29 01:59:27.547092 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.sql.core [None req-09b78af3-e862-446f-b5dc-ec95b724661c None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 29 01:59:27.547092 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 29 01:59:27.547092 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [parameters: {'id': '5c1deb58693c4529b9de39bf3d9f78dc', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 29 01:59:27.547092 dv-cinder-740146-21-smb devstack@keystone.service[81648]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81648) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 29 01:59:27.555558 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-09b78af3-e862-446f-b5dc-ec95b724661c None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5c1deb58693c4529b9de39bf3d9f78dc.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5c1deb58693c4529b9de39bf3d9f78dc. Sep 29 01:59:27.555558 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:27.555558 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 29 01:59:27.555558 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 29 01:59:27.555558 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 29 01:59:27.555558 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 29 01:59:27.555558 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 29 01:59:27.555558 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application result = self._query(query) Sep 29 01:59:27.555558 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 29 01:59:27.555558 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application conn.query(q) Sep 29 01:59:27.555558 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 29 01:59:27.555558 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 29 01:59:27.555558 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 29 01:59:27.556408 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application result.read() Sep 29 01:59:27.556408 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 29 01:59:27.556408 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 29 01:59:27.556408 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 29 01:59:27.556408 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 29 01:59:27.556408 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 29 01:59:27.556408 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 29 01:59:27.556408 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 29 01:59:27.556408 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 29 01:59:27.556408 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 29 01:59:27.556408 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:59:27.556408 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 29 01:59:27.556408 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:59:27.556408 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:27.556408 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 29 01:59:27.556408 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 29 01:59:27.556408 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 29 01:59:27.556408 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 29 01:59:27.557363 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 29 01:59:27.557363 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application next(self.gen) Sep 29 01:59:27.557363 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 29 01:59:27.557363 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application yield resource Sep 29 01:59:27.557363 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 29 01:59:27.557363 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application next(self.gen) Sep 29 01:59:27.557363 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 29 01:59:27.557363 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application self.session.rollback() Sep 29 01:59:27.557363 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 29 01:59:27.557363 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application self.force_reraise() Sep 29 01:59:27.557363 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 29 01:59:27.557363 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise self.value Sep 29 01:59:27.557363 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 29 01:59:27.557363 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 29 01:59:27.557363 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 29 01:59:27.557363 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application session.commit() Sep 29 01:59:27.557363 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 29 01:59:27.558250 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 29 01:59:27.558250 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 29 01:59:27.558250 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application self._prepare_impl() Sep 29 01:59:27.558250 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 29 01:59:27.558250 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application self.session.flush() Sep 29 01:59:27.558250 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 29 01:59:27.558250 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application self._flush(objects) Sep 29 01:59:27.558250 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 29 01:59:27.558250 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 29 01:59:27.558250 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 29 01:59:27.558250 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application compat.raise_( Sep 29 01:59:27.558250 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 29 01:59:27.558250 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception Sep 29 01:59:27.558250 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 29 01:59:27.558250 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application flush_context.execute() Sep 29 01:59:27.558250 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 29 01:59:27.558250 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rec.execute(self) Sep 29 01:59:27.559134 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 29 01:59:27.559134 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 29 01:59:27.559134 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 29 01:59:27.559134 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 29 01:59:27.559134 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 29 01:59:27.559134 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 29 01:59:27.559134 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 29 01:59:27.559134 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 29 01:59:27.559134 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 29 01:59:27.559134 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 29 01:59:27.559134 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 29 01:59:27.559134 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 29 01:59:27.559134 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 29 01:59:27.559134 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 29 01:59:27.559134 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 29 01:59:27.559935 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 29 01:59:27.559935 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 29 01:59:27.559935 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception Sep 29 01:59:27.559935 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 29 01:59:27.559935 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 29 01:59:27.559935 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 29 01:59:27.559935 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 29 01:59:27.559935 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 29 01:59:27.559935 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application result = self._query(query) Sep 29 01:59:27.559935 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 29 01:59:27.559935 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application conn.query(q) Sep 29 01:59:27.559935 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 29 01:59:27.559935 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 29 01:59:27.559935 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 29 01:59:27.559935 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application result.read() Sep 29 01:59:27.559935 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 29 01:59:27.559935 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 29 01:59:27.563307 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 29 01:59:27.563307 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 29 01:59:27.563307 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 29 01:59:27.563307 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 29 01:59:27.563307 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 29 01:59:27.563307 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 29 01:59:27.563307 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 29 01:59:27.563307 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 29 01:59:27.563307 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [parameters: {'id': '5c1deb58693c4529b9de39bf3d9f78dc', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 29 01:59:27.563307 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 29 01:59:27.563307 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:59:27.563307 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 29 01:59:27.563307 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:59:27.563307 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:27.563307 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 29 01:59:27.564627 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 29 01:59:27.564627 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 29 01:59:27.564627 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 29 01:59:27.564627 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 29 01:59:27.564627 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:59:27.564627 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 29 01:59:27.564627 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:59:27.564627 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:27.564627 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:27.564627 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:27.564627 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:27.564627 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:27.564627 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:27.564627 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:27.564627 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:27.564627 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:27.564627 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:27.565986 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:27.565986 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 29 01:59:27.565986 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 29 01:59:27.565986 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:27.565986 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:27.565986 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 29 01:59:27.565986 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 29 01:59:27.565986 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5c1deb58693c4529b9de39bf3d9f78dc. Sep 29 01:59:27.565986 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:59:27.565986 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 486/957] 10.222.0.49 () {60 vars in 1140 bytes} [Thu Sep 29 01:59:27 2022] POST /identity/v3/projects => generated 262 bytes in 195 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:27.566734 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b78af3-e862-446f-b5dc-ec95b724661c None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:27.617804 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be7341-c920-4c3c-ae01-38167ec2de10 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:27.648899 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:27.664326 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76acd62c-73c2-48be-b0f5-ca26c91eadf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:27.665017 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76acd62c-73c2-48be-b0f5-ca26c91eadf5 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:27.665301 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76acd62c-73c2-48be-b0f5-ca26c91eadf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:27.665611 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76acd62c-73c2-48be-b0f5-ca26c91eadf5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:27.679209 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76acd62c-73c2-48be-b0f5-ca26c91eadf5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:59:27.685145 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-76acd62c-73c2-48be-b0f5-ca26c91eadf5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 29 01:59:27.685145 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:27.685145 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:27.685145 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:27.685145 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:27.685145 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:27.685145 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:27.685145 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:27.685145 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:27.685145 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:27.685145 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:27.685145 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:27.685145 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:59:27.685145 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:59:27.685145 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:59:27.685145 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:59:27.686792 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:59:27.686792 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:59:27.686792 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:59:27.686792 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:59:27.686792 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:27.686792 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:27.686792 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:27.686792 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:27.686792 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:27.686792 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:27.686792 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:27.686792 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:27.686792 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:27.686792 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:27.686792 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:27.686792 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:27.687973 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:27.687973 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:27.687973 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:27.687973 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:27.687973 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:59:27.687973 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:59:27.687973 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:59:27.687973 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:59:27.687973 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:59:27.687973 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:59:27.687973 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 29 01:59:27.687973 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:59:27.687973 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 472/958] 10.222.0.49 () {56 vars in 1120 bytes} [Thu Sep 29 01:59:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:27.692778 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76acd62c-73c2-48be-b0f5-ca26c91eadf5 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:27.706639 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b78af3-e862-446f-b5dc-ec95b724661c None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:27.750166 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:27.760685 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b017c356-b4f4-4dec-a436-b69818ed9f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:27.762046 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b017c356-b4f4-4dec-a436-b69818ed9f21 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:27.762726 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b017c356-b4f4-4dec-a436-b69818ed9f21 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:27.763320 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b017c356-b4f4-4dec-a436-b69818ed9f21 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:27.773854 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b017c356-b4f4-4dec-a436-b69818ed9f21 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:27.776251 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b017c356-b4f4-4dec-a436-b69818ed9f21 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:27.792780 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-b017c356-b4f4-4dec-a436-b69818ed9f21 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:59:27.792780 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:27.792780 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:27.792780 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:27.792780 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:27.792780 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:27.792780 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:27.792780 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:27.792780 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:27.792780 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:27.792780 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:27.792780 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:27.792780 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 29 01:59:27.792780 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 29 01:59:27.792780 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 29 01:59:27.793900 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 29 01:59:27.793900 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:27.793900 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:27.793900 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:27.793900 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:27.793900 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:27.793900 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:27.793900 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:27.793900 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:27.793900 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:27.793900 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:27.793900 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:27.793900 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:27.793900 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:27.793900 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:27.793900 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:27.793900 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:27.798275 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 29 01:59:27.798275 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 29 01:59:27.798275 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 29 01:59:27.798275 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 29 01:59:27.798275 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 29 01:59:27.798275 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 29 01:59:27.798275 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:59:27.798275 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:59:27.798275 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 487/959] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Sep 29 01:59:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:27.798275 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b017c356-b4f4-4dec-a436-b69818ed9f21 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:27.822108 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76acd62c-73c2-48be-b0f5-ca26c91eadf5 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:27.858873 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadbde49-a180-4cba-9e45-cf70acaf4199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:27.859484 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadbde49-a180-4cba-9e45-cf70acaf4199 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:27.859871 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadbde49-a180-4cba-9e45-cf70acaf4199 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:27.860146 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadbde49-a180-4cba-9e45-cf70acaf4199 None admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:27.860807 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadbde49-a180-4cba-9e45-cf70acaf4199 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:27.861107 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadbde49-a180-4cba-9e45-cf70acaf4199 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:27.862770 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadbde49-a180-4cba-9e45-cf70acaf4199 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:27.877609 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 473/960] 10.222.0.49 () {56 vars in 1115 bytes} [Thu Sep 29 01:59:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:27.878514 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadbde49-a180-4cba-9e45-cf70acaf4199 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:27.908994 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b017c356-b4f4-4dec-a436-b69818ed9f21 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:27.935872 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:27.947586 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00f02ae-2b60-4233-8aac-2036537e50b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:27.948740 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00f02ae-2b60-4233-8aac-2036537e50b8 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:27.949022 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00f02ae-2b60-4233-8aac-2036537e50b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:27.949293 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00f02ae-2b60-4233-8aac-2036537e50b8 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:27.949898 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00f02ae-2b60-4233-8aac-2036537e50b8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:27.951926 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00f02ae-2b60-4233-8aac-2036537e50b8 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:27.960993 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-b00f02ae-2b60-4233-8aac-2036537e50b8 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 29 01:59:27.960993 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:27.960993 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 29 01:59:27.960993 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 29 01:59:27.960993 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 29 01:59:27.960993 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 29 01:59:27.960993 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 29 01:59:27.960993 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 29 01:59:27.960993 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 29 01:59:27.960993 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:59:27.960993 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 29 01:59:27.960993 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:59:27.960993 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:27.960993 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:27.960993 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:27.960993 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:27.960993 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:27.962161 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:27.962161 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:27.962161 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:27.962161 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:27.962161 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:27.962161 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:27.962161 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 29 01:59:27.962161 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 29 01:59:27.962161 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 29 01:59:27.962161 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 29 01:59:27.962161 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:27.962161 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:27.962161 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:27.962161 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:27.962161 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:27.962161 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:27.963497 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:27.963497 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:27.963497 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:27.963497 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:27.963497 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:27.963497 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:27.963497 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:27.963497 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:27.963497 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:27.963497 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:27.963497 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 29 01:59:27.963497 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 29 01:59:27.963497 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 29 01:59:27.963497 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:59:27.963497 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 488/961] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Sep 29 01:59:27 2022] GET /identity/v3/services/compute => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:27.964346 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00f02ae-2b60-4233-8aac-2036537e50b8 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:28.002217 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadbde49-a180-4cba-9e45-cf70acaf4199 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:28.020319 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:28.042926 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28784517-a1e2-47cd-bc67-ca0e838d046a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:28.043872 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28784517-a1e2-47cd-bc67-ca0e838d046a None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:28.044159 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28784517-a1e2-47cd-bc67-ca0e838d046a None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:28.044426 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28784517-a1e2-47cd-bc67-ca0e838d046a None admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:28.045566 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28784517-a1e2-47cd-bc67-ca0e838d046a None admin] RBAC: Adding query filter params (name=service) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:28.045880 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28784517-a1e2-47cd-bc67-ca0e838d046a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:28.047304 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28784517-a1e2-47cd-bc67-ca0e838d046a None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:28.073346 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 474/962] 10.222.0.49 () {56 vars in 1112 bytes} [Thu Sep 29 01:59:27 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:28.073346 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28784517-a1e2-47cd-bc67-ca0e838d046a None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:28.073656 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00f02ae-2b60-4233-8aac-2036537e50b8 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:28.117960 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2177583-b3ac-4c5b-a0ff-887f66b30ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:28.118698 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2177583-b3ac-4c5b-a0ff-887f66b30ed2 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:28.119057 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2177583-b3ac-4c5b-a0ff-887f66b30ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:28.119928 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2177583-b3ac-4c5b-a0ff-887f66b30ed2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:28.134365 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2177583-b3ac-4c5b-a0ff-887f66b30ed2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:28.136153 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2177583-b3ac-4c5b-a0ff-887f66b30ed2 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:28.157752 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-f2177583-b3ac-4c5b-a0ff-887f66b30ed2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:28.157752 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:28.157752 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:28.157752 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:28.157752 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:28.157752 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:28.157752 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:28.157752 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:28.157752 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:28.157752 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:28.157752 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:28.157752 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:28.157752 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:59:28.157752 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:59:28.157752 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:59:28.157752 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:59:28.158961 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:28.158961 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:28.158961 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:28.158961 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:28.158961 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:28.158961 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:28.158961 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:28.158961 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:28.158961 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:28.158961 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:28.158961 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:28.158961 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:28.158961 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:28.158961 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:28.158961 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:28.158961 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:28.158961 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:59:28.160105 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:59:28.160105 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:28.160105 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:59:28.161467 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 489/963] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 01:59:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:28.167090 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2177583-b3ac-4c5b-a0ff-887f66b30ed2 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:28.193364 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28784517-a1e2-47cd-bc67-ca0e838d046a None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:28.196643 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:28.235721 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbece9b9-88f8-4ca1-9846-a8f8973ccdb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:28.236768 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbece9b9-88f8-4ca1-9846-a8f8973ccdb8 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:28.237227 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbece9b9-88f8-4ca1-9846-a8f8973ccdb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:28.237741 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbece9b9-88f8-4ca1-9846-a8f8973ccdb8 None admin] PATH_INFO: `/v3/services` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:28.238558 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbece9b9-88f8-4ca1-9846-a8f8973ccdb8 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:28.239327 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbece9b9-88f8-4ca1-9846-a8f8973ccdb8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:28.241776 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbece9b9-88f8-4ca1-9846-a8f8973ccdb8 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:28.249119 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 475/964] 10.222.0.49 () {56 vars in 1112 bytes} [Thu Sep 29 01:59:28 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:28.255344 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbece9b9-88f8-4ca1-9846-a8f8973ccdb8 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:28.298902 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2177583-b3ac-4c5b-a0ff-887f66b30ed2 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:28.307973 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:28.346616 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2758a28f-a4c4-49e7-9ed1-80bcca25494e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:28.347227 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2758a28f-a4c4-49e7-9ed1-80bcca25494e None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:28.347500 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2758a28f-a4c4-49e7-9ed1-80bcca25494e None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:28.347763 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2758a28f-a4c4-49e7-9ed1-80bcca25494e None admin] PATH_INFO: `/v3/domains` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:28.348399 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2758a28f-a4c4-49e7-9ed1-80bcca25494e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:28.348696 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2758a28f-a4c4-49e7-9ed1-80bcca25494e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:28.350185 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2758a28f-a4c4-49e7-9ed1-80bcca25494e None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:28.366154 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 490/965] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Sep 29 01:59:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:28.371532 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2758a28f-a4c4-49e7-9ed1-80bcca25494e None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:28.386122 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbece9b9-88f8-4ca1-9846-a8f8973ccdb8 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:28.429160 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7792126e-296d-4de9-9e5f-0421422d8c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:28.429850 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7792126e-296d-4de9-9e5f-0421422d8c80 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:28.430133 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7792126e-296d-4de9-9e5f-0421422d8c80 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:28.430404 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7792126e-296d-4de9-9e5f-0421422d8c80 None admin] PATH_INFO: `/v3/services` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:28.431164 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7792126e-296d-4de9-9e5f-0421422d8c80 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:28.431429 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7792126e-296d-4de9-9e5f-0421422d8c80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:28.432914 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7792126e-296d-4de9-9e5f-0421422d8c80 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:28.439033 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 476/966] 10.222.0.49 () {56 vars in 1112 bytes} [Thu Sep 29 01:59:28 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:28.495307 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2758a28f-a4c4-49e7-9ed1-80bcca25494e None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:28.534961 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e058fe1-8ae1-4c3a-946e-b2260bf9eea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:28.536137 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e058fe1-8ae1-4c3a-946e-b2260bf9eea6 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:28.536620 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e058fe1-8ae1-4c3a-946e-b2260bf9eea6 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:28.537118 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e058fe1-8ae1-4c3a-946e-b2260bf9eea6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:28.548279 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e058fe1-8ae1-4c3a-946e-b2260bf9eea6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:28.550145 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e058fe1-8ae1-4c3a-946e-b2260bf9eea6 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:28.563467 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-7e058fe1-8ae1-4c3a-946e-b2260bf9eea6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 29 01:59:28.563467 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:28.563467 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:28.563467 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:28.563467 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:28.563467 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:28.563467 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:28.563467 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:28.563467 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:28.563467 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:28.563467 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:28.563467 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:28.563467 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 29 01:59:28.563467 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 29 01:59:28.563467 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 29 01:59:28.563467 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 29 01:59:28.564531 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:28.564531 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:28.564531 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 29 01:59:28.564531 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:59:28.564531 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 29 01:59:28.564531 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:59:28.564531 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:28.564531 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:28.564531 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:28.564531 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:28.564531 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:28.564531 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:28.564531 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:28.564531 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:28.564531 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:28.564531 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:28.564531 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:28.564531 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:28.565543 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:28.565543 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:28.565543 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 29 01:59:28.565543 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 29 01:59:28.565543 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 29 01:59:28.565543 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 29 01:59:28.565543 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 29 01:59:28.565543 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 29 01:59:28.565543 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 29 01:59:28.565543 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:59:28.568519 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 491/967] 10.222.0.49 () {56 vars in 1117 bytes} [Thu Sep 29 01:59:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:28.574185 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7792126e-296d-4de9-9e5f-0421422d8c80 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:28.610822 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:28.686854 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7792126e-296d-4de9-9e5f-0421422d8c80 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:28.722755 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8253a3a-67ed-4604-be40-cf6e015166c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:28.723365 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8253a3a-67ed-4604-be40-cf6e015166c6 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:28.723694 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8253a3a-67ed-4604-be40-cf6e015166c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:28.723965 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8253a3a-67ed-4604-be40-cf6e015166c6 None admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:28.724763 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8253a3a-67ed-4604-be40-cf6e015166c6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:28.725063 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8253a3a-67ed-4604-be40-cf6e015166c6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:28.726505 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8253a3a-67ed-4604-be40-cf6e015166c6 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:28.745479 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 477/968] 10.222.0.49 () {56 vars in 1149 bytes} [Thu Sep 29 01:59:28 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:28.754386 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e058fe1-8ae1-4c3a-946e-b2260bf9eea6 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:28.785188 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:28.862852 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e058fe1-8ae1-4c3a-946e-b2260bf9eea6 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:28.899508 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94a0f3c-d797-47c7-84c2-3b8704e2dcae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:28.900518 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a0f3c-d797-47c7-84c2-3b8704e2dcae None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:28.901028 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a0f3c-d797-47c7-84c2-3b8704e2dcae None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:28.901547 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a0f3c-d797-47c7-84c2-3b8704e2dcae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:28.975546 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94a0f3c-d797-47c7-84c2-3b8704e2dcae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:28.977005 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94a0f3c-d797-47c7-84c2-3b8704e2dcae None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:29.005050 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:29.081745 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 492/969] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Sep 29 01:59:28 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 29 01:59:29.087549 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8253a3a-67ed-4604-be40-cf6e015166c6 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:29.193190 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:29.206515 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8253a3a-67ed-4604-be40-cf6e015166c6 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:29.244448 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f723f94b-870d-4e61-bae8-0cef894456f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:29.245079 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f723f94b-870d-4e61-bae8-0cef894456f4 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:29.245384 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f723f94b-870d-4e61-bae8-0cef894456f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:29.245663 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f723f94b-870d-4e61-bae8-0cef894456f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:29.256361 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f723f94b-870d-4e61-bae8-0cef894456f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:29.257777 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f723f94b-870d-4e61-bae8-0cef894456f4 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:29.273679 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-f723f94b-870d-4e61-bae8-0cef894456f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:29.273679 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:29.273679 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:29.273679 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:29.273679 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:29.273679 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:29.273679 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:29.273679 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:29.273679 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:29.273679 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:29.273679 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:29.273679 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:29.273679 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:59:29.273679 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:59:29.273679 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:59:29.273679 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:59:29.274669 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:29.274669 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:29.274669 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:29.274669 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:29.274669 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:29.274669 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:29.274669 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:29.274669 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:29.274669 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:29.274669 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:29.274669 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:29.274669 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:29.274669 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:29.274669 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:29.274669 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:29.274669 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:29.274669 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:59:29.275629 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:59:29.275629 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:29.275629 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:59:29.275629 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 478/970] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 01:59:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:29.282176 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94a0f3c-d797-47c7-84c2-3b8704e2dcae None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:29.311217 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4204fa89-38b3-4c5a-be2b-44084e3bf263 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:29.311510 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4204fa89-38b3-4c5a-be2b-44084e3bf263 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:29.311768 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4204fa89-38b3-4c5a-be2b-44084e3bf263 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:29.313482 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 479/971] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:59:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 29 01:59:29.319235 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c0d76c-d0b4-42bb-ab1f-96e9e10360cd None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:29.319517 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c0d76c-d0b4-42bb-ab1f-96e9e10360cd None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:29.319789 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c0d76c-d0b4-42bb-ab1f-96e9e10360cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:29.340037 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-b2c0d76c-d0b4-42bb-ab1f-96e9e10360cd None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:59:29.341729 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-b2c0d76c-d0b4-42bb-ab1f-96e9e10360cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:59:29.397728 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94a0f3c-d797-47c7-84c2-3b8704e2dcae None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:29.414097 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 480/972] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:59:29 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 29 01:59:29.429689 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:29.435214 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04767cb8-da6b-4645-a7d2-909a535919d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:29.436934 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04767cb8-da6b-4645-a7d2-909a535919d9 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:29.437500 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04767cb8-da6b-4645-a7d2-909a535919d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:29.437994 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04767cb8-da6b-4645-a7d2-909a535919d9 None admin] PATH_INFO: `/v3/domains` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:29.438834 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04767cb8-da6b-4645-a7d2-909a535919d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:29.439335 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04767cb8-da6b-4645-a7d2-909a535919d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:29.440896 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04767cb8-da6b-4645-a7d2-909a535919d9 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:29.457409 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 493/973] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Sep 29 01:59:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:29.459279 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c0d76c-d0b4-42bb-ab1f-96e9e10360cd None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:29.529118 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:29.559927 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c0d76c-d0b4-42bb-ab1f-96e9e10360cd None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:29.596378 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e401da68-0465-48f4-b24c-58432fda0198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:29.597010 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401da68-0465-48f4-b24c-58432fda0198 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:29.597287 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401da68-0465-48f4-b24c-58432fda0198 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:29.597579 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401da68-0465-48f4-b24c-58432fda0198 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:29.604303 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e401da68-0465-48f4-b24c-58432fda0198 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:29.605776 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e401da68-0465-48f4-b24c-58432fda0198 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:29.618467 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-e401da68-0465-48f4-b24c-58432fda0198 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:59:29.618467 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:29.618467 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:29.618467 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:29.618467 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:29.618467 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:29.618467 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:29.618467 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:29.618467 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:29.618467 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:29.618467 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:29.618467 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:29.618467 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 29 01:59:29.618467 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 29 01:59:29.618467 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 29 01:59:29.619352 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 29 01:59:29.619352 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:29.619352 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:29.619352 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:29.619352 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:29.619352 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:29.619352 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:29.619352 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:29.619352 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:29.619352 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:29.619352 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:29.619352 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:29.619352 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:29.619352 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:29.619352 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:29.619352 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:29.619352 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:29.620625 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 29 01:59:29.620625 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 29 01:59:29.620625 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 29 01:59:29.620625 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 29 01:59:29.620625 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 29 01:59:29.620625 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 29 01:59:29.620625 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:59:29.620625 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:59:29.620625 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 481/974] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Sep 29 01:59:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 01:59:29.625884 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04767cb8-da6b-4645-a7d2-909a535919d9 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:29.698800 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e401da68-0465-48f4-b24c-58432fda0198 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:29.734125 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04767cb8-da6b-4645-a7d2-909a535919d9 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:29.771995 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd9ea0c-cac1-4b34-9fca-9fdc7af12dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:29.773010 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd9ea0c-cac1-4b34-9fca-9fdc7af12dc8 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:29.773550 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd9ea0c-cac1-4b34-9fca-9fdc7af12dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:29.774039 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd9ea0c-cac1-4b34-9fca-9fdc7af12dc8 None admin] PATH_INFO: `/v3/projects` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:29.774928 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd9ea0c-cac1-4b34-9fca-9fdc7af12dc8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:29.775452 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd9ea0c-cac1-4b34-9fca-9fdc7af12dc8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:29.777084 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd9ea0c-cac1-4b34-9fca-9fdc7af12dc8 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:29.791838 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 494/975] 10.222.0.49 () {56 vars in 1148 bytes} [Thu Sep 29 01:59:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:29.798368 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd9ea0c-cac1-4b34-9fca-9fdc7af12dc8 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:29.851113 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:29.861240 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e401da68-0465-48f4-b24c-58432fda0198 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:29.901946 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:29.911484 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d581489f-7c2e-4a27-9737-e19dd21890ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:29.912383 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d581489f-7c2e-4a27-9737-e19dd21890ee None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:29.912880 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d581489f-7c2e-4a27-9737-e19dd21890ee None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:29.913383 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d581489f-7c2e-4a27-9737-e19dd21890ee None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:29.914176 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d581489f-7c2e-4a27-9737-e19dd21890ee None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:29.916001 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d581489f-7c2e-4a27-9737-e19dd21890ee None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:29.922126 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd9ea0c-cac1-4b34-9fca-9fdc7af12dc8 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:29.925801 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-d581489f-7c2e-4a27-9737-e19dd21890ee None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 29 01:59:29.925801 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:29.925801 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 29 01:59:29.925801 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 29 01:59:29.925801 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 29 01:59:29.925801 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 29 01:59:29.925801 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 29 01:59:29.925801 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 29 01:59:29.925801 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 29 01:59:29.925801 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:59:29.925801 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 29 01:59:29.925801 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:59:29.925801 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:29.925801 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:29.925801 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:29.925801 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:29.925801 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:29.926817 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:29.926817 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:29.926817 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:29.926817 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:29.926817 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:29.926817 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:29.926817 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 29 01:59:29.926817 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 29 01:59:29.926817 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 29 01:59:29.926817 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 29 01:59:29.926817 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:29.926817 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:29.926817 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:29.926817 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:29.926817 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:29.926817 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:29.927679 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:29.927679 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:29.927679 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:29.927679 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:29.927679 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:29.927679 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:29.927679 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:29.927679 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:29.927679 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:29.927679 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:29.927679 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 29 01:59:29.927679 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 29 01:59:29.927679 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 29 01:59:29.927679 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:59:29.935159 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 482/976] 10.222.0.49 () {56 vars in 1126 bytes} [Thu Sep 29 01:59:29 2022] GET /identity/v3/services/object-store => generated 93 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:29.937258 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d581489f-7c2e-4a27-9737-e19dd21890ee None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:29.962964 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec733e9-fe9f-45af-a108-260cbaa95603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:29.963487 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec733e9-fe9f-45af-a108-260cbaa95603 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:29.963769 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec733e9-fe9f-45af-a108-260cbaa95603 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:29.964038 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec733e9-fe9f-45af-a108-260cbaa95603 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:29.964934 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec733e9-fe9f-45af-a108-260cbaa95603 None admin] RBAC: Adding query filter params (role.id=3bbece89f99a4c658f63f212839b21ff, scope.project.id=6f1d8fd250c84c5887cb3173053ea2dd, user.id=0f8f13f302de4701a7f4e0562bca08cf) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:29.965055 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec733e9-fe9f-45af-a108-260cbaa95603 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:29.966465 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec733e9-fe9f-45af-a108-260cbaa95603 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:29.981584 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 495/977] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Sep 29 01:59:29 2022] GET /identity/v3/role_assignments?user.id=0f8f13f302de4701a7f4e0562bca08cf&scope.project.id=6f1d8fd250c84c5887cb3173053ea2dd&role.id=3bbece89f99a4c658f63f212839b21ff => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:59:30.068768 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d581489f-7c2e-4a27-9737-e19dd21890ee None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:30.111152 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa67581-2364-410e-af2c-0d43ffdb9ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:30.112567 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa67581-2364-410e-af2c-0d43ffdb9ed9 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:30.113144 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa67581-2364-410e-af2c-0d43ffdb9ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:30.113658 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa67581-2364-410e-af2c-0d43ffdb9ed9 None admin] PATH_INFO: `/v3/services` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:30.114549 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa67581-2364-410e-af2c-0d43ffdb9ed9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:30.115094 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa67581-2364-410e-af2c-0d43ffdb9ed9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:30.116711 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa67581-2364-410e-af2c-0d43ffdb9ed9 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:30.127823 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 483/978] 10.222.0.49 () {56 vars in 1122 bytes} [Thu Sep 29 01:59:29 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:59:30.129759 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec733e9-fe9f-45af-a108-260cbaa95603 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:30.240451 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec733e9-fe9f-45af-a108-260cbaa95603 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:30.251813 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:30.278045 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a492282-8d03-4737-8387-58f674062c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:30.278810 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a492282-8d03-4737-8387-58f674062c02 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:30.279845 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a492282-8d03-4737-8387-58f674062c02 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:30.280244 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a492282-8d03-4737-8387-58f674062c02 None admin] PATH_INFO: `/v3/services` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:30.280980 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a492282-8d03-4737-8387-58f674062c02 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:30.281413 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a492282-8d03-4737-8387-58f674062c02 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:30.282879 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a492282-8d03-4737-8387-58f674062c02 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:30.293446 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 496/979] 10.222.0.49 () {56 vars in 1122 bytes} [Thu Sep 29 01:59:30 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:30.295779 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa67581-2364-410e-af2c-0d43ffdb9ed9 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:30.363833 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:30.410736 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa67581-2364-410e-af2c-0d43ffdb9ed9 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:30.425419 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248d7a9-37a5-491f-bd26-b01c6a80c09f None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:30.425831 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248d7a9-37a5-491f-bd26-b01c6a80c09f None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:30.426043 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248d7a9-37a5-491f-bd26-b01c6a80c09f None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:30.428313 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 497/980] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:59:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:59:30.432961 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415fdef6-786e-420f-a606-a9e03ec26cb2 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:30.433523 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415fdef6-786e-420f-a606-a9e03ec26cb2 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:30.433897 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415fdef6-786e-420f-a606-a9e03ec26cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:30.453579 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be690518-93e5-40c3-89e5-d1aeb03ee4f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:30.454554 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be690518-93e5-40c3-89e5-d1aeb03ee4f9 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:30.455127 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be690518-93e5-40c3-89e5-d1aeb03ee4f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:30.455603 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be690518-93e5-40c3-89e5-d1aeb03ee4f9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:30.456864 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be690518-93e5-40c3-89e5-d1aeb03ee4f9 None admin] RBAC: Adding query filter params (interface=admin, service_id=a705977d734b4badbe5b124ad10f4698, region_id=RegionOne) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:30.457217 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-415fdef6-786e-420f-a606-a9e03ec26cb2 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:59:30.457408 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be690518-93e5-40c3-89e5-d1aeb03ee4f9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:30.458954 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-415fdef6-786e-420f-a606-a9e03ec26cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:59:30.459886 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be690518-93e5-40c3-89e5-d1aeb03ee4f9 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:30.470145 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 484/981] 10.222.0.49 () {56 vars in 1249 bytes} [Thu Sep 29 01:59:30 2022] GET /identity/v3/endpoints?service_id=a705977d734b4badbe5b124ad10f4698&interface=admin®ion_id=RegionOne => generated 193 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:30.476944 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be690518-93e5-40c3-89e5-d1aeb03ee4f9 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:30.556509 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 498/982] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:59:30 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 29 01:59:30.617116 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be690518-93e5-40c3-89e5-d1aeb03ee4f9 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:30.643996 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:30.656955 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f073e446-1091-437c-8887-65c39d8ad064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:30.657891 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f073e446-1091-437c-8887-65c39d8ad064 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:30.658327 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f073e446-1091-437c-8887-65c39d8ad064 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:30.658736 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f073e446-1091-437c-8887-65c39d8ad064 None admin] PATH_INFO: `/v3/services` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:30.659485 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f073e446-1091-437c-8887-65c39d8ad064 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:30.660966 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f073e446-1091-437c-8887-65c39d8ad064 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:30.667717 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 485/983] 10.222.0.49 () {56 vars in 1087 bytes} [Thu Sep 29 01:59:30 2022] GET /identity/v3/services => generated 1497 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 29 01:59:30.721252 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c272135-c384-4de7-9bc3-9b87542598b3 None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:30.721570 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c272135-c384-4de7-9bc3-9b87542598b3 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:30.721847 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c272135-c384-4de7-9bc3-9b87542598b3 None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:30.723528 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 499/984] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:59:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:59:30.729469 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b92d3b-ffaa-461a-81ea-0943ed71e17d None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:30.730019 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b92d3b-ffaa-461a-81ea-0943ed71e17d None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:30.730502 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b92d3b-ffaa-461a-81ea-0943ed71e17d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:30.750680 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-64b92d3b-ffaa-461a-81ea-0943ed71e17d None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:59:30.752144 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-64b92d3b-ffaa-461a-81ea-0943ed71e17d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:59:30.831368 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 486/985] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:59:30 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 29 01:59:30.840117 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c272135-c384-4de7-9bc3-9b87542598b3 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:30.950898 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c272135-c384-4de7-9bc3-9b87542598b3 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:30.953718 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:30.988540 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728516ac-b71b-471c-9c3e-dcd2e7e2faf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:30.989205 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728516ac-b71b-471c-9c3e-dcd2e7e2faf7 None admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:30.989459 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728516ac-b71b-471c-9c3e-dcd2e7e2faf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:30.989720 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728516ac-b71b-471c-9c3e-dcd2e7e2faf7 None admin] PATH_INFO: `/v3/users` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:30.990386 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728516ac-b71b-471c-9c3e-dcd2e7e2faf7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:30.991947 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728516ac-b71b-471c-9c3e-dcd2e7e2faf7 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:31.010591 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.sql.core [None req-728516ac-b71b-471c-9c3e-dcd2e7e2faf7 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 29 01:59:31.010591 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 29 01:59:31.010591 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [parameters: {'user_id': 'efbdb9181d8d42128837ad01612bb7e8', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 29 01:59:31.010591 dv-cinder-740146-21-smb devstack@keystone.service[81648]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81648) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 29 01:59:31.019003 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-728516ac-b71b-471c-9c3e-dcd2e7e2faf7 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 29 01:59:31.019003 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:31.019003 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 29 01:59:31.019003 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 29 01:59:31.019003 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 29 01:59:31.019003 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 29 01:59:31.019003 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 29 01:59:31.019003 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application result = self._query(query) Sep 29 01:59:31.019003 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 29 01:59:31.019003 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application conn.query(q) Sep 29 01:59:31.019003 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 29 01:59:31.019003 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 29 01:59:31.019003 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 29 01:59:31.019003 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application result.read() Sep 29 01:59:31.019003 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 29 01:59:31.019881 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 29 01:59:31.019881 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 29 01:59:31.019881 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 29 01:59:31.019881 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 29 01:59:31.019881 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 29 01:59:31.019881 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 29 01:59:31.019881 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 29 01:59:31.019881 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 29 01:59:31.019881 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:59:31.019881 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 29 01:59:31.019881 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:59:31.019881 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:31.019881 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 29 01:59:31.019881 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 29 01:59:31.019881 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 29 01:59:31.019881 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 29 01:59:31.019881 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 29 01:59:31.019881 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application next(self.gen) Sep 29 01:59:31.020827 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 29 01:59:31.020827 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application yield resource Sep 29 01:59:31.020827 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 29 01:59:31.020827 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application next(self.gen) Sep 29 01:59:31.020827 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 29 01:59:31.020827 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application self.session.rollback() Sep 29 01:59:31.020827 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 29 01:59:31.020827 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application self.force_reraise() Sep 29 01:59:31.020827 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 29 01:59:31.020827 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise self.value Sep 29 01:59:31.020827 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 29 01:59:31.020827 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 29 01:59:31.020827 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 29 01:59:31.020827 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application session.commit() Sep 29 01:59:31.020827 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 29 01:59:31.020827 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 29 01:59:31.020827 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 29 01:59:31.021741 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application self._prepare_impl() Sep 29 01:59:31.021741 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 29 01:59:31.021741 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application self.session.flush() Sep 29 01:59:31.021741 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 29 01:59:31.021741 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application self._flush(objects) Sep 29 01:59:31.021741 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 29 01:59:31.021741 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 29 01:59:31.021741 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 29 01:59:31.021741 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application compat.raise_( Sep 29 01:59:31.021741 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 29 01:59:31.021741 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception Sep 29 01:59:31.021741 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 29 01:59:31.021741 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application flush_context.execute() Sep 29 01:59:31.021741 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 29 01:59:31.021741 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rec.execute(self) Sep 29 01:59:31.021741 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 29 01:59:31.021741 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 29 01:59:31.022624 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 29 01:59:31.022624 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 29 01:59:31.022624 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 29 01:59:31.022624 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 29 01:59:31.022624 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 29 01:59:31.022624 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 29 01:59:31.022624 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 29 01:59:31.022624 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 29 01:59:31.022624 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 29 01:59:31.022624 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 29 01:59:31.022624 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 29 01:59:31.022624 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 29 01:59:31.022624 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 29 01:59:31.022624 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 29 01:59:31.022624 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 29 01:59:31.022624 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception Sep 29 01:59:31.023474 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 29 01:59:31.023474 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 29 01:59:31.023474 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 29 01:59:31.023474 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 29 01:59:31.023474 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 29 01:59:31.023474 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application result = self._query(query) Sep 29 01:59:31.023474 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 29 01:59:31.023474 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application conn.query(q) Sep 29 01:59:31.023474 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 29 01:59:31.023474 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 29 01:59:31.023474 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 29 01:59:31.023474 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application result.read() Sep 29 01:59:31.023474 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 29 01:59:31.023474 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 29 01:59:31.023474 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 29 01:59:31.023474 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 29 01:59:31.024293 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 29 01:59:31.024293 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 29 01:59:31.024293 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 29 01:59:31.024293 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 29 01:59:31.024293 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 29 01:59:31.024293 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 29 01:59:31.024293 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [parameters: {'user_id': 'efbdb9181d8d42128837ad01612bb7e8', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 29 01:59:31.024293 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 29 01:59:31.024293 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:59:31.024293 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 29 01:59:31.024293 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:59:31.024293 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:31.024293 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:31.024293 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:31.024293 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:31.025062 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:31.025062 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:31.025062 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:31.025062 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:31.025062 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:31.025062 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:31.025062 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:31.025062 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 29 01:59:31.025062 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 29 01:59:31.025062 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:31.025062 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:31.025062 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 29 01:59:31.025062 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:59:31.025062 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 29 01:59:31.025062 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:59:31.025062 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 29 01:59:31.025062 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 29 01:59:31.031356 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 29 01:59:31.031356 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 29 01:59:31.031356 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 29 01:59:31.031356 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 29 01:59:31.031356 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 29 01:59:31.031356 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:59:31.031356 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 500/986] 10.222.0.49 () {60 vars in 1131 bytes} [Thu Sep 29 01:59:30 2022] POST /identity/v3/users => generated 160 bytes in 181 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:31.032243 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b92d3b-ffaa-461a-81ea-0943ed71e17d None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:31.122560 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728516ac-b71b-471c-9c3e-dcd2e7e2faf7 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:31.136101 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b92d3b-ffaa-461a-81ea-0943ed71e17d None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:31.161052 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:31.176562 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5672bd20-176c-4a96-9781-9765e076fe85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:31.177197 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5672bd20-176c-4a96-9781-9765e076fe85 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:31.177509 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5672bd20-176c-4a96-9781-9765e076fe85 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:31.177785 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5672bd20-176c-4a96-9781-9765e076fe85 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:31.184966 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5672bd20-176c-4a96-9781-9765e076fe85 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:31.186518 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5672bd20-176c-4a96-9781-9765e076fe85 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:31.200536 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-5672bd20-176c-4a96-9781-9765e076fe85 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 29 01:59:31.200536 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:31.200536 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:31.200536 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:31.200536 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:31.200536 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:31.200536 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:31.200536 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:31.200536 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:31.200536 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:31.200536 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:31.200536 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:31.200536 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 29 01:59:31.200536 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 29 01:59:31.200536 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 29 01:59:31.200536 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 29 01:59:31.201818 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:31.201818 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:31.201818 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 29 01:59:31.201818 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:59:31.201818 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 29 01:59:31.201818 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:59:31.201818 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:31.201818 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:31.201818 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:31.201818 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:31.201818 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:31.201818 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:31.201818 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:31.201818 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:31.201818 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:31.201818 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:31.201818 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:31.201818 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:31.202741 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:31.202741 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:31.202741 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 29 01:59:31.202741 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 29 01:59:31.202741 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 29 01:59:31.202741 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 29 01:59:31.202741 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 29 01:59:31.202741 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 29 01:59:31.202741 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 29 01:59:31.202741 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:59:31.202741 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 487/987] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Sep 29 01:59:31 2022] GET /identity/v3/users/cinder => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:31.207981 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5672bd20-176c-4a96-9781-9765e076fe85 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:31.259798 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728516ac-b71b-471c-9c3e-dcd2e7e2faf7 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:31.299049 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0778a125-f156-48e2-b000-610b33e40540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:31.300024 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0778a125-f156-48e2-b000-610b33e40540 None admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:31.300498 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0778a125-f156-48e2-b000-610b33e40540 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:31.300986 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0778a125-f156-48e2-b000-610b33e40540 None admin] PATH_INFO: `/v3/services` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:31.302375 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0778a125-f156-48e2-b000-610b33e40540 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:31.304624 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0778a125-f156-48e2-b000-610b33e40540 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:31.330403 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 501/988] 10.222.0.49 () {60 vars in 1141 bytes} [Thu Sep 29 01:59:31 2022] POST /identity/v3/services => generated 242 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 29 01:59:31.331508 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5672bd20-176c-4a96-9781-9765e076fe85 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:31.386421 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76132a6b-d733-4699-8b21-b5a88798c1d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:31.387061 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76132a6b-d733-4699-8b21-b5a88798c1d7 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:31.387338 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76132a6b-d733-4699-8b21-b5a88798c1d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:31.387609 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76132a6b-d733-4699-8b21-b5a88798c1d7 None admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:31.388711 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76132a6b-d733-4699-8b21-b5a88798c1d7 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:31.388853 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76132a6b-d733-4699-8b21-b5a88798c1d7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:31.391087 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76132a6b-d733-4699-8b21-b5a88798c1d7 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:31.436260 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 488/989] 10.222.0.49 () {56 vars in 1101 bytes} [Thu Sep 29 01:59:31 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:32.343398 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dad489-dcdc-4f85-8e73-8b1b3a020774 None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:32.343963 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dad489-dcdc-4f85-8e73-8b1b3a020774 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:32.343963 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dad489-dcdc-4f85-8e73-8b1b3a020774 None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:32.345430 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 502/990] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:59:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:59:32.350534 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a72ac62-5694-4d28-84b8-3c13071d2c73 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:32.350912 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a72ac62-5694-4d28-84b8-3c13071d2c73 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:32.351079 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a72ac62-5694-4d28-84b8-3c13071d2c73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:32.370449 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-1a72ac62-5694-4d28-84b8-3c13071d2c73 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:59:32.371650 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-1a72ac62-5694-4d28-84b8-3c13071d2c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:59:32.399782 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:32.443689 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 489/991] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:59:32 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 29 01:59:32.711636 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dad489-dcdc-4f85-8e73-8b1b3a020774 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:32.741780 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:32.824266 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dad489-dcdc-4f85-8e73-8b1b3a020774 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:32.859700 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a98594-fdb2-4e13-9c9d-de44f5e96227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:32.860332 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a98594-fdb2-4e13-9c9d-de44f5e96227 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:32.860610 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a98594-fdb2-4e13-9c9d-de44f5e96227 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:32.860880 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a98594-fdb2-4e13-9c9d-de44f5e96227 None admin] PATH_INFO: `/v3/services/image` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:32.861486 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a98594-fdb2-4e13-9c9d-de44f5e96227 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:32.862856 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a98594-fdb2-4e13-9c9d-de44f5e96227 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:32.871639 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-87a98594-fdb2-4e13-9c9d-de44f5e96227 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 29 01:59:32.871639 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:32.871639 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 29 01:59:32.871639 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 29 01:59:32.871639 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 29 01:59:32.871639 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 29 01:59:32.871639 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 29 01:59:32.871639 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 29 01:59:32.871639 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 29 01:59:32.871639 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:59:32.871639 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 29 01:59:32.871639 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:59:32.871639 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:32.871639 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:32.871639 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:32.871639 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:32.871639 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:32.873419 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:32.873419 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:32.873419 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:32.873419 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:32.873419 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:32.873419 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:32.873419 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 29 01:59:32.873419 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 29 01:59:32.873419 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 29 01:59:32.873419 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 29 01:59:32.873419 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:32.873419 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:32.873419 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:32.873419 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:32.873419 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:32.873419 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:32.874405 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:32.874405 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:32.874405 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:32.874405 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:32.874405 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:32.874405 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:32.874405 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:32.874405 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:32.874405 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:32.874405 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:32.874405 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 29 01:59:32.874405 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 29 01:59:32.874405 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 29 01:59:32.874405 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:59:32.878227 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 503/992] 10.222.0.49 () {56 vars in 1105 bytes} [Thu Sep 29 01:59:32 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:32.879667 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a72ac62-5694-4d28-84b8-3c13071d2c73 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:32.898244 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce41a032-c7e5-409a-810c-5b179b9d142b None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:32.898552 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce41a032-c7e5-409a-810c-5b179b9d142b None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:32.898785 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce41a032-c7e5-409a-810c-5b179b9d142b None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:32.900357 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 504/993] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:59:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 29 01:59:32.905708 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856bb37e-5981-4d58-9b43-051d3fce12cb None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:32.905796 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856bb37e-5981-4d58-9b43-051d3fce12cb None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:32.906030 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856bb37e-5981-4d58-9b43-051d3fce12cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:32.925139 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-856bb37e-5981-4d58-9b43-051d3fce12cb None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:59:32.926679 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-856bb37e-5981-4d58-9b43-051d3fce12cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:59:32.994399 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a72ac62-5694-4d28-84b8-3c13071d2c73 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:33.008184 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 505/994] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:59:32 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 29 01:59:33.029581 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3930648f-5cff-4523-bf69-d5975334f3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:33.030183 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3930648f-5cff-4523-bf69-d5975334f3a2 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:33.030456 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3930648f-5cff-4523-bf69-d5975334f3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:33.030718 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3930648f-5cff-4523-bf69-d5975334f3a2 None admin] PATH_INFO: `/v3/services` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:33.031338 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3930648f-5cff-4523-bf69-d5975334f3a2 None admin] RBAC: Adding query filter params (name=image) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:33.031634 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3930648f-5cff-4523-bf69-d5975334f3a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:33.032989 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3930648f-5cff-4523-bf69-d5975334f3a2 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:33.037936 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 490/995] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 01:59:32 2022] GET /identity/v3/services?name=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:59:33.046633 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856bb37e-5981-4d58-9b43-051d3fce12cb None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:33.068960 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:33.150579 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856bb37e-5981-4d58-9b43-051d3fce12cb None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:33.186887 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903ad18d-ac7f-4e88-9f28-d9cd6736b098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:33.187496 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903ad18d-ac7f-4e88-9f28-d9cd6736b098 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:33.187776 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903ad18d-ac7f-4e88-9f28-d9cd6736b098 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:33.188049 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903ad18d-ac7f-4e88-9f28-d9cd6736b098 None admin] PATH_INFO: `/v3/services` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:33.188680 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903ad18d-ac7f-4e88-9f28-d9cd6736b098 None admin] RBAC: Adding query filter params (type=image) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:33.188981 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903ad18d-ac7f-4e88-9f28-d9cd6736b098 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:33.190378 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903ad18d-ac7f-4e88-9f28-d9cd6736b098 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:33.201805 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 506/996] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 01:59:33 2022] GET /identity/v3/services?type=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:33.290258 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3930648f-5cff-4523-bf69-d5975334f3a2 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:33.320262 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:33.401859 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3930648f-5cff-4523-bf69-d5975334f3a2 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:33.440961 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd6adb6-88ae-4e49-b4d4-95a955f81566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:33.441640 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd6adb6-88ae-4e49-b4d4-95a955f81566 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:33.441916 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd6adb6-88ae-4e49-b4d4-95a955f81566 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:33.442185 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd6adb6-88ae-4e49-b4d4-95a955f81566 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:33.442844 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd6adb6-88ae-4e49-b4d4-95a955f81566 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:33.444373 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd6adb6-88ae-4e49-b4d4-95a955f81566 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:33.454483 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-fcd6adb6-88ae-4e49-b4d4-95a955f81566 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 29 01:59:33.454483 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:33.454483 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 29 01:59:33.454483 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 29 01:59:33.454483 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 29 01:59:33.454483 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 29 01:59:33.454483 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 29 01:59:33.454483 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 29 01:59:33.454483 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 29 01:59:33.454483 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:59:33.454483 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 29 01:59:33.454483 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:59:33.454483 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:33.454483 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:33.454483 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:33.454483 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:33.454483 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:33.455529 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:33.455529 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:33.455529 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:33.455529 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:33.455529 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:33.455529 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:33.455529 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 29 01:59:33.455529 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 29 01:59:33.455529 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 29 01:59:33.455529 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 29 01:59:33.455529 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:33.455529 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:33.455529 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:33.455529 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:33.455529 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:33.455529 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:33.456762 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:33.456762 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:33.456762 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:33.456762 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:33.456762 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:33.456762 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:33.456762 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:33.456762 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:33.456762 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:33.456762 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:33.456762 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 29 01:59:33.456762 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 29 01:59:33.456762 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 29 01:59:33.456762 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:59:33.456762 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 491/997] 10.222.0.49 () {56 vars in 1126 bytes} [Thu Sep 29 01:59:33 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:33.461749 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903ad18d-ac7f-4e88-9f28-d9cd6736b098 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:33.536044 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7734edb7-8c82-45cc-bdfb-478586882594 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:33.536364 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7734edb7-8c82-45cc-bdfb-478586882594 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:33.536587 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7734edb7-8c82-45cc-bdfb-478586882594 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:33.538085 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 492/998] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:59:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 29 01:59:33.543215 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823cbcb4-171b-4db4-9736-9d41a15c16a1 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:33.543424 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823cbcb4-171b-4db4-9736-9d41a15c16a1 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:33.543693 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823cbcb4-171b-4db4-9736-9d41a15c16a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:33.548032 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:33.564219 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-823cbcb4-171b-4db4-9736-9d41a15c16a1 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:59:33.565464 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-823cbcb4-171b-4db4-9736-9d41a15c16a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:59:33.565899 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903ad18d-ac7f-4e88-9f28-d9cd6736b098 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:33.600667 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe42118-a995-4fd2-8dde-21afc06ec095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:33.601545 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe42118-a995-4fd2-8dde-21afc06ec095 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:33.602000 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe42118-a995-4fd2-8dde-21afc06ec095 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:33.602278 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe42118-a995-4fd2-8dde-21afc06ec095 None admin] PATH_INFO: `/v3/services` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:33.602903 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe42118-a995-4fd2-8dde-21afc06ec095 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:33.603204 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe42118-a995-4fd2-8dde-21afc06ec095 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:33.604596 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe42118-a995-4fd2-8dde-21afc06ec095 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:33.610292 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 507/999] 10.222.0.49 () {56 vars in 1122 bytes} [Thu Sep 29 01:59:33 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:33.615706 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe42118-a995-4fd2-8dde-21afc06ec095 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:33.634132 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 493/1000] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:59:33 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 29 01:59:33.719475 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe42118-a995-4fd2-8dde-21afc06ec095 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:33.754510 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd38222-26c2-4251-bd30-795a68ba1b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:33.755122 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd38222-26c2-4251-bd30-795a68ba1b7e None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:33.755403 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd38222-26c2-4251-bd30-795a68ba1b7e None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:33.755677 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd38222-26c2-4251-bd30-795a68ba1b7e None admin] PATH_INFO: `/v3/services` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:33.756306 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd38222-26c2-4251-bd30-795a68ba1b7e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:33.756614 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd38222-26c2-4251-bd30-795a68ba1b7e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:33.758038 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd38222-26c2-4251-bd30-795a68ba1b7e None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:33.767965 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 508/1001] 10.222.0.49 () {56 vars in 1122 bytes} [Thu Sep 29 01:59:33 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:33.769548 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823cbcb4-171b-4db4-9736-9d41a15c16a1 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:33.793040 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:33.875690 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823cbcb4-171b-4db4-9736-9d41a15c16a1 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:33.899057 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd38222-26c2-4251-bd30-795a68ba1b7e None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:33.911965 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdd5640-ed5f-40ae-8e46-e4ad49c64ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:33.912579 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdd5640-ed5f-40ae-8e46-e4ad49c64ef9 None admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:33.912853 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdd5640-ed5f-40ae-8e46-e4ad49c64ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:33.913121 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdd5640-ed5f-40ae-8e46-e4ad49c64ef9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:33.913880 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdd5640-ed5f-40ae-8e46-e4ad49c64ef9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:33.915251 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdd5640-ed5f-40ae-8e46-e4ad49c64ef9 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:33.923102 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:33.932571 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 494/1002] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 01:59:33 2022] POST /identity/v3/endpoints => generated 325 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 01:59:34.022525 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd38222-26c2-4251-bd30-795a68ba1b7e None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:34.068560 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545d497b-4a14-4022-9fe5-46f8471bdea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:34.069202 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d497b-4a14-4022-9fe5-46f8471bdea2 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:34.069531 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d497b-4a14-4022-9fe5-46f8471bdea2 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:34.069832 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d497b-4a14-4022-9fe5-46f8471bdea2 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:34.070422 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545d497b-4a14-4022-9fe5-46f8471bdea2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:34.071840 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545d497b-4a14-4022-9fe5-46f8471bdea2 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:34.082732 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-545d497b-4a14-4022-9fe5-46f8471bdea2 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 29 01:59:34.082732 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:34.082732 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 29 01:59:34.082732 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 29 01:59:34.082732 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 29 01:59:34.082732 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 29 01:59:34.082732 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 29 01:59:34.082732 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 29 01:59:34.082732 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 29 01:59:34.082732 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:59:34.082732 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 29 01:59:34.082732 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:59:34.082732 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:34.082732 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:34.082732 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:34.082732 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:34.082732 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:34.083825 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:34.083825 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:34.083825 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:34.083825 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:34.083825 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:34.083825 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:34.083825 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 29 01:59:34.083825 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 29 01:59:34.083825 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 29 01:59:34.083825 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 29 01:59:34.083825 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:34.083825 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:34.083825 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:34.083825 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:34.083825 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:34.083825 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:34.090021 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:34.090021 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:34.090021 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:34.090021 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:34.090021 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:34.090021 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:34.090021 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:34.090021 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:34.090021 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:34.090021 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:34.090021 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 29 01:59:34.090021 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 29 01:59:34.090021 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 29 01:59:34.090021 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:59:34.090021 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 509/1003] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Sep 29 01:59:33 2022] GET /identity/v3/services/compute => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 01:59:34.091083 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdd5640-ed5f-40ae-8e46-e4ad49c64ef9 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:34.178105 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:34.200315 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdd5640-ed5f-40ae-8e46-e4ad49c64ef9 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:34.235575 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120307ea-9562-428b-85bc-ced66b8502cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:34.236187 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120307ea-9562-428b-85bc-ced66b8502cf None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:34.236466 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120307ea-9562-428b-85bc-ced66b8502cf None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:34.236736 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120307ea-9562-428b-85bc-ced66b8502cf None admin] PATH_INFO: `/v3/services` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:34.237462 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120307ea-9562-428b-85bc-ced66b8502cf None admin] RBAC: Adding query filter params (name=compute) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:34.237769 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120307ea-9562-428b-85bc-ced66b8502cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:34.239109 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120307ea-9562-428b-85bc-ced66b8502cf None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:34.244102 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 495/1004] 10.222.0.49 () {56 vars in 1112 bytes} [Thu Sep 29 01:59:34 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:34.250401 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545d497b-4a14-4022-9fe5-46f8471bdea2 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:34.325485 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:34.358721 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545d497b-4a14-4022-9fe5-46f8471bdea2 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:34.392800 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba70f4b-5bf3-4068-86fd-75ea2ba91ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:34.393436 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba70f4b-5bf3-4068-86fd-75ea2ba91ebf None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:34.393720 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba70f4b-5bf3-4068-86fd-75ea2ba91ebf None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:34.393992 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba70f4b-5bf3-4068-86fd-75ea2ba91ebf None admin] PATH_INFO: `/v3/services` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:34.394618 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba70f4b-5bf3-4068-86fd-75ea2ba91ebf None admin] RBAC: Adding query filter params (type=compute) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:34.394919 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba70f4b-5bf3-4068-86fd-75ea2ba91ebf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:34.396287 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba70f4b-5bf3-4068-86fd-75ea2ba91ebf None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:34.401278 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 510/1005] 10.222.0.49 () {56 vars in 1112 bytes} [Thu Sep 29 01:59:34 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:34.407908 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120307ea-9562-428b-85bc-ced66b8502cf None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:34.515636 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120307ea-9562-428b-85bc-ced66b8502cf None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:34.549352 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c36948b-9f59-4fbd-9ce5-300d61be014b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:34.550003 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c36948b-9f59-4fbd-9ce5-300d61be014b None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:34.550280 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c36948b-9f59-4fbd-9ce5-300d61be014b None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:34.550545 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c36948b-9f59-4fbd-9ce5-300d61be014b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:34.551228 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c36948b-9f59-4fbd-9ce5-300d61be014b None admin] RBAC: Adding query filter params (interface=public, service_id=4b3fe7d30d454022a20b5ebe9e53b058, region_id=RegionOne) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:34.551529 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c36948b-9f59-4fbd-9ce5-300d61be014b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:34.552869 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c36948b-9f59-4fbd-9ce5-300d61be014b None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:34.562681 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 496/1006] 10.222.0.49 () {56 vars in 1251 bytes} [Thu Sep 29 01:59:34 2022] GET /identity/v3/endpoints?service_id=4b3fe7d30d454022a20b5ebe9e53b058&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:34.563949 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba70f4b-5bf3-4068-86fd-75ea2ba91ebf None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:34.665004 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba70f4b-5bf3-4068-86fd-75ea2ba91ebf None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:34.698589 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec28abae-794f-4863-b79a-cf98eb42ce07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:34.699194 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec28abae-794f-4863-b79a-cf98eb42ce07 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:34.699463 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec28abae-794f-4863-b79a-cf98eb42ce07 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:34.699731 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec28abae-794f-4863-b79a-cf98eb42ce07 None admin] PATH_INFO: `/v3/services` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:34.700328 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec28abae-794f-4863-b79a-cf98eb42ce07 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:34.702308 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec28abae-794f-4863-b79a-cf98eb42ce07 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:34.704075 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:34.710504 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 511/1007] 10.222.0.49 () {56 vars in 1087 bytes} [Thu Sep 29 01:59:34 2022] GET /identity/v3/services => generated 1727 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 01:59:35.383037 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550d8294-6535-44c7-af1c-1366fe985c70 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:35.383416 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550d8294-6535-44c7-af1c-1366fe985c70 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:35.383593 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550d8294-6535-44c7-af1c-1366fe985c70 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:35.384948 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 497/1008] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:59:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:59:35.390173 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da61ff5-84b0-4f0f-a84c-b53561fd5918 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:35.390464 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da61ff5-84b0-4f0f-a84c-b53561fd5918 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:35.390739 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da61ff5-84b0-4f0f-a84c-b53561fd5918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:35.411158 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-5da61ff5-84b0-4f0f-a84c-b53561fd5918 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:59:35.412381 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-5da61ff5-84b0-4f0f-a84c-b53561fd5918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:59:35.479696 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 512/1009] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:59:35 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 29 01:59:35.748571 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550d8294-6535-44c7-af1c-1366fe985c70 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:35.760783 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:35.854357 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550d8294-6535-44c7-af1c-1366fe985c70 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:35.888334 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f0b386-d39a-474e-95dd-d6e86f3d2cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:35.889127 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f0b386-d39a-474e-95dd-d6e86f3d2cc4 None admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:35.889419 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f0b386-d39a-474e-95dd-d6e86f3d2cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:35.889696 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f0b386-d39a-474e-95dd-d6e86f3d2cc4 None admin] PATH_INFO: `/v3/services` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:35.890353 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f0b386-d39a-474e-95dd-d6e86f3d2cc4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:35.891712 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f0b386-d39a-474e-95dd-d6e86f3d2cc4 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:35.917152 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 498/1010] 10.222.0.49 () {60 vars in 1141 bytes} [Thu Sep 29 01:59:35 2022] POST /identity/v3/services => generated 242 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 01:59:36.136913 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb079cd-b05b-4d2e-b744-f3aba1a10e1b None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:36.137449 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb079cd-b05b-4d2e-b744-f3aba1a10e1b None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:36.137559 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb079cd-b05b-4d2e-b744-f3aba1a10e1b None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:36.138906 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 513/1011] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:59:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:59:36.144352 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e9e10d-1f49-466a-be44-2c45b195e08b None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:36.144635 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e9e10d-1f49-466a-be44-2c45b195e08b None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:36.144905 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e9e10d-1f49-466a-be44-2c45b195e08b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:36.162882 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-00e9e10d-1f49-466a-be44-2c45b195e08b None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:59:36.164047 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-00e9e10d-1f49-466a-be44-2c45b195e08b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:59:36.227046 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:36.240550 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 499/1012] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:59:36 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 29 01:59:36.508947 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb079cd-b05b-4d2e-b744-f3aba1a10e1b None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:36.614803 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb079cd-b05b-4d2e-b744-f3aba1a10e1b None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:36.646101 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:36.653156 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62d525a-e6f9-4a6a-ba21-932292430c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:36.653884 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62d525a-e6f9-4a6a-ba21-932292430c12 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:36.654159 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62d525a-e6f9-4a6a-ba21-932292430c12 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:36.654516 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62d525a-e6f9-4a6a-ba21-932292430c12 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:36.655621 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62d525a-e6f9-4a6a-ba21-932292430c12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:36.657079 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62d525a-e6f9-4a6a-ba21-932292430c12 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:36.658925 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 514/1013] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 01:59:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:36.665357 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e9e10d-1f49-466a-be44-2c45b195e08b None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:36.773604 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e9e10d-1f49-466a-be44-2c45b195e08b None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:36.818914 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ddecb1-b6dd-4da4-bc21-9ec27b0017e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:36.819534 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ddecb1-b6dd-4da4-bc21-9ec27b0017e1 None admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:36.819809 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ddecb1-b6dd-4da4-bc21-9ec27b0017e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:36.820073 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ddecb1-b6dd-4da4-bc21-9ec27b0017e1 None admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:36.820728 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ddecb1-b6dd-4da4-bc21-9ec27b0017e1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:36.822187 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ddecb1-b6dd-4da4-bc21-9ec27b0017e1 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:36.855098 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 500/1014] 10.222.0.49 () {60 vars in 1141 bytes} [Thu Sep 29 01:59:36 2022] POST /identity/v3/projects => generated 311 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 01:59:36.907964 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c4840f-e4fa-4a61-b25f-768f67c126ef None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:36.908511 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c4840f-e4fa-4a61-b25f-768f67c126ef None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:36.909008 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c4840f-e4fa-4a61-b25f-768f67c126ef None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:36.910690 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 515/1015] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:59:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:59:36.923504 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ae284c-df7e-4356-980c-a3cbcb4a909c None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:36.923919 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ae284c-df7e-4356-980c-a3cbcb4a909c None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:36.924088 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ae284c-df7e-4356-980c-a3cbcb4a909c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:36.945098 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-d1ae284c-df7e-4356-980c-a3cbcb4a909c None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:59:36.946393 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-d1ae284c-df7e-4356-980c-a3cbcb4a909c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:59:36.999813 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:37.037442 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 501/1016] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:59:36 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 29 01:59:37.332870 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c4840f-e4fa-4a61-b25f-768f67c126ef None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:37.452089 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c4840f-e4fa-4a61-b25f-768f67c126ef None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:37.490916 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487ff50d-1682-471d-9b32-b338b3d33aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:37.491556 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ff50d-1682-471d-9b32-b338b3d33aaa None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:37.491832 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ff50d-1682-471d-9b32-b338b3d33aaa None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:37.492091 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ff50d-1682-471d-9b32-b338b3d33aaa None admin] PATH_INFO: `/v3/services/compute` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:37.492679 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487ff50d-1682-471d-9b32-b338b3d33aaa None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:37.494097 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487ff50d-1682-471d-9b32-b338b3d33aaa None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:37.504287 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-487ff50d-1682-471d-9b32-b338b3d33aaa None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 29 01:59:37.504287 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:37.504287 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 29 01:59:37.504287 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 29 01:59:37.504287 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 29 01:59:37.504287 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 29 01:59:37.504287 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 29 01:59:37.504287 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 29 01:59:37.504287 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 29 01:59:37.504287 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:59:37.504287 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 29 01:59:37.504287 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:59:37.504287 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:37.504287 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:37.504287 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:37.504287 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:37.504287 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:37.505683 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:37.505683 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:37.505683 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:37.505683 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:37.505683 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:37.505683 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:37.505683 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 29 01:59:37.505683 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 29 01:59:37.505683 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 29 01:59:37.505683 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 29 01:59:37.505683 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:37.505683 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:37.505683 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:37.505683 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:37.505683 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:37.505683 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:37.506769 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:37.506769 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:37.506769 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:37.506769 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:37.506769 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:37.506769 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:37.506769 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:37.506769 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:37.506769 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:37.506769 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:37.506769 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 29 01:59:37.506769 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 29 01:59:37.506769 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 29 01:59:37.506769 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:59:37.509676 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 516/1017] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Sep 29 01:59:37 2022] GET /identity/v3/services/compute => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:37.512734 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ae284c-df7e-4356-980c-a3cbcb4a909c None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:37.633798 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ae284c-df7e-4356-980c-a3cbcb4a909c None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:37.671113 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437d54e5-7a21-43df-9f65-2e18e5a755f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:37.671733 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d54e5-7a21-43df-9f65-2e18e5a755f4 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:37.672002 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d54e5-7a21-43df-9f65-2e18e5a755f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:37.672270 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d54e5-7a21-43df-9f65-2e18e5a755f4 None admin] PATH_INFO: `/v3/services` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:37.672897 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437d54e5-7a21-43df-9f65-2e18e5a755f4 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:37.673192 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437d54e5-7a21-43df-9f65-2e18e5a755f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:37.674598 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437d54e5-7a21-43df-9f65-2e18e5a755f4 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:37.681406 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 502/1018] 10.222.0.49 () {56 vars in 1112 bytes} [Thu Sep 29 01:59:37 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:37.687809 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487ff50d-1682-471d-9b32-b338b3d33aaa None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:37.751133 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:37.791706 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487ff50d-1682-471d-9b32-b338b3d33aaa None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:37.825990 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f79b83b-acbf-4e59-9b6e-9da92a0b3d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:37.826723 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f79b83b-acbf-4e59-9b6e-9da92a0b3d78 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:37.827006 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f79b83b-acbf-4e59-9b6e-9da92a0b3d78 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:37.827256 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f79b83b-acbf-4e59-9b6e-9da92a0b3d78 None admin] PATH_INFO: `/v3/services` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:37.827882 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f79b83b-acbf-4e59-9b6e-9da92a0b3d78 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:37.828180 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f79b83b-acbf-4e59-9b6e-9da92a0b3d78 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:37.829566 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f79b83b-acbf-4e59-9b6e-9da92a0b3d78 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:37.839555 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 517/1019] 10.222.0.49 () {56 vars in 1112 bytes} [Thu Sep 29 01:59:37 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:37.840564 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437d54e5-7a21-43df-9f65-2e18e5a755f4 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:37.883444 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:37.954825 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437d54e5-7a21-43df-9f65-2e18e5a755f4 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:37.987707 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780acb6a-e23a-4b31-b8ea-0df504e27d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:37.988304 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780acb6a-e23a-4b31-b8ea-0df504e27d72 None admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:37.988575 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780acb6a-e23a-4b31-b8ea-0df504e27d72 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:37.988840 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780acb6a-e23a-4b31-b8ea-0df504e27d72 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:37.989519 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780acb6a-e23a-4b31-b8ea-0df504e27d72 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:37.990860 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780acb6a-e23a-4b31-b8ea-0df504e27d72 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:38.017338 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 503/1020] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 01:59:37 2022] POST /identity/v3/endpoints => generated 334 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 01:59:38.284097 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f934a4b-9f08-4d1b-bd24-41ce2f63e40f None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:38.284445 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f934a4b-9f08-4d1b-bd24-41ce2f63e40f None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:38.284588 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f934a4b-9f08-4d1b-bd24-41ce2f63e40f None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:38.286111 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 518/1021] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:59:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:59:38.291523 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987abaf2-7111-4687-b8d4-2632069e4fb1 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:38.292050 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987abaf2-7111-4687-b8d4-2632069e4fb1 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:38.292538 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987abaf2-7111-4687-b8d4-2632069e4fb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:38.313867 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-987abaf2-7111-4687-b8d4-2632069e4fb1 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:59:38.315073 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-987abaf2-7111-4687-b8d4-2632069e4fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:59:38.388505 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 504/1022] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:59:38 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 29 01:59:38.655217 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f934a4b-9f08-4d1b-bd24-41ce2f63e40f None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:38.759201 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f934a4b-9f08-4d1b-bd24-41ce2f63e40f None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:38.787940 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:38.798964 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde1761e-f378-4abf-9905-31b246685eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:38.799598 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde1761e-f378-4abf-9905-31b246685eef None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:38.799873 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde1761e-f378-4abf-9905-31b246685eef None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:38.800139 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde1761e-f378-4abf-9905-31b246685eef None admin] PATH_INFO: `/v3/services/image` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:38.800713 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde1761e-f378-4abf-9905-31b246685eef None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:38.802109 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde1761e-f378-4abf-9905-31b246685eef None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:38.811131 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-bde1761e-f378-4abf-9905-31b246685eef None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 29 01:59:38.811131 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:38.811131 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 29 01:59:38.811131 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 29 01:59:38.811131 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 29 01:59:38.811131 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 29 01:59:38.811131 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 29 01:59:38.811131 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 29 01:59:38.811131 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 29 01:59:38.811131 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:59:38.811131 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 29 01:59:38.811131 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:59:38.811131 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:38.811131 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:38.811131 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:38.811131 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:38.811131 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:38.812113 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:38.812113 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:38.812113 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:38.812113 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:38.812113 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:38.812113 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:38.812113 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 29 01:59:38.812113 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 29 01:59:38.812113 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 29 01:59:38.812113 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 29 01:59:38.812113 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:38.812113 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:38.812113 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:38.812113 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:38.812113 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:38.812113 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:38.812958 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:38.812958 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:38.812958 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:38.812958 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:38.812958 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:38.812958 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:38.812958 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:38.812958 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:38.812958 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:38.812958 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:38.812958 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 29 01:59:38.812958 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 29 01:59:38.812958 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 29 01:59:38.812958 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:59:38.812958 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 519/1023] 10.222.0.49 () {56 vars in 1105 bytes} [Thu Sep 29 01:59:38 2022] GET /identity/v3/services/image => generated 86 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 01:59:38.819824 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987abaf2-7111-4687-b8d4-2632069e4fb1 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:38.844656 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:38.931484 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987abaf2-7111-4687-b8d4-2632069e4fb1 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:38.964398 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515b3829-ad8e-4474-9516-1bf5d38e3d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:38.965003 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515b3829-ad8e-4474-9516-1bf5d38e3d01 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:38.965276 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515b3829-ad8e-4474-9516-1bf5d38e3d01 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:38.965571 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515b3829-ad8e-4474-9516-1bf5d38e3d01 None admin] PATH_INFO: `/v3/services` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:38.966769 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515b3829-ad8e-4474-9516-1bf5d38e3d01 None admin] RBAC: Adding query filter params (name=image) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:38.967066 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515b3829-ad8e-4474-9516-1bf5d38e3d01 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:38.968413 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515b3829-ad8e-4474-9516-1bf5d38e3d01 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:38.973280 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 505/1024] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 01:59:38 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:38.978755 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde1761e-f378-4abf-9905-31b246685eef None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:39.083866 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde1761e-f378-4abf-9905-31b246685eef None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:39.117727 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f301ec6-dd13-4f17-82ef-a0f30bb32bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:39.118387 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f301ec6-dd13-4f17-82ef-a0f30bb32bb9 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:39.118670 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f301ec6-dd13-4f17-82ef-a0f30bb32bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:39.118939 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f301ec6-dd13-4f17-82ef-a0f30bb32bb9 None admin] PATH_INFO: `/v3/services` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:39.119723 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f301ec6-dd13-4f17-82ef-a0f30bb32bb9 None admin] RBAC: Adding query filter params (type=image) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:39.120026 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f301ec6-dd13-4f17-82ef-a0f30bb32bb9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:39.121405 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f301ec6-dd13-4f17-82ef-a0f30bb32bb9 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:39.131720 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 520/1025] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 01:59:38 2022] GET /identity/v3/services?type=image => generated 350 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:59:39.132658 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515b3829-ad8e-4474-9516-1bf5d38e3d01 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:39.223693 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:39.240050 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515b3829-ad8e-4474-9516-1bf5d38e3d01 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:39.273859 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e71179-2da7-42bf-a42c-5871c20f1cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:39.274466 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e71179-2da7-42bf-a42c-5871c20f1cbe None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:39.274742 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e71179-2da7-42bf-a42c-5871c20f1cbe None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:39.275007 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e71179-2da7-42bf-a42c-5871c20f1cbe None admin] PATH_INFO: `/v3/endpoints` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:39.275701 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e71179-2da7-42bf-a42c-5871c20f1cbe None admin] RBAC: Adding query filter params (interface=public, service_id=5ab5233343fd4ca4b2eb45057a4eca05, region_id=RegionOne) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:39.276002 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e71179-2da7-42bf-a42c-5871c20f1cbe None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:39.277370 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e71179-2da7-42bf-a42c-5871c20f1cbe None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:39.287378 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 506/1026] 10.222.0.49 () {56 vars in 1251 bytes} [Thu Sep 29 01:59:39 2022] GET /identity/v3/endpoints?service_id=5ab5233343fd4ca4b2eb45057a4eca05&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:59:39.288188 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f301ec6-dd13-4f17-82ef-a0f30bb32bb9 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:39.290609 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497ead9f-e081-48f0-9b08-240b38d45521 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:39.290890 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497ead9f-e081-48f0-9b08-240b38d45521 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:39.291156 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497ead9f-e081-48f0-9b08-240b38d45521 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:39.292393 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 507/1027] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:59:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 29 01:59:39.298023 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092101a4-7306-4d93-b8cf-bc723761c018 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:39.298312 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092101a4-7306-4d93-b8cf-bc723761c018 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:39.298584 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092101a4-7306-4d93-b8cf-bc723761c018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:39.317290 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-092101a4-7306-4d93-b8cf-bc723761c018 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:59:39.318508 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-092101a4-7306-4d93-b8cf-bc723761c018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:59:39.352245 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:39.394543 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 508/1028] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:59:39 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 29 01:59:39.404887 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f301ec6-dd13-4f17-82ef-a0f30bb32bb9 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:39.440745 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f041f5-9866-4b0a-a8aa-2516d673404b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:39.441377 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f041f5-9866-4b0a-a8aa-2516d673404b None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:39.441661 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f041f5-9866-4b0a-a8aa-2516d673404b None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:39.441932 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f041f5-9866-4b0a-a8aa-2516d673404b None admin] PATH_INFO: `/v3/services` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:39.442533 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f041f5-9866-4b0a-a8aa-2516d673404b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:39.443900 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f041f5-9866-4b0a-a8aa-2516d673404b None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:39.457367 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 521/1029] 10.222.0.49 () {56 vars in 1087 bytes} [Thu Sep 29 01:59:39 2022] GET /identity/v3/services => generated 1957 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 29 01:59:39.668485 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092101a4-7306-4d93-b8cf-bc723761c018 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:39.747924 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:39.767899 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092101a4-7306-4d93-b8cf-bc723761c018 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:39.802312 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dd853c-379f-46f6-8096-ebd4a14fa174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:39.802941 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dd853c-379f-46f6-8096-ebd4a14fa174 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:39.803216 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dd853c-379f-46f6-8096-ebd4a14fa174 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:39.803484 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dd853c-379f-46f6-8096-ebd4a14fa174 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:39.804581 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dd853c-379f-46f6-8096-ebd4a14fa174 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:39.806030 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dd853c-379f-46f6-8096-ebd4a14fa174 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:39.807764 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 509/1030] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 01:59:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:39.813500 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f041f5-9866-4b0a-a8aa-2516d673404b None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:39.924175 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f041f5-9866-4b0a-a8aa-2516d673404b None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:39.944175 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:39.962163 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3750e3-4fb4-4ed0-ab0f-c8c2d412aba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:39.962772 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3750e3-4fb4-4ed0-ab0f-c8c2d412aba3 None admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:39.963050 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3750e3-4fb4-4ed0-ab0f-c8c2d412aba3 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:39.963321 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3750e3-4fb4-4ed0-ab0f-c8c2d412aba3 None admin] PATH_INFO: `/v3/users` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:39.963980 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3750e3-4fb4-4ed0-ab0f-c8c2d412aba3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:39.965422 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3750e3-4fb4-4ed0-ab0f-c8c2d412aba3 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:39.989041 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 522/1031] 10.222.0.49 () {60 vars in 1132 bytes} [Thu Sep 29 01:59:39 2022] POST /identity/v3/users => generated 285 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 01:59:40.304211 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fab252-938e-4565-8a2d-c23fe1951407 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:40.304724 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fab252-938e-4565-8a2d-c23fe1951407 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:40.304724 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fab252-938e-4565-8a2d-c23fe1951407 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:40.306242 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 510/1032] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:59:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:59:40.311784 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59499bdd-adaf-4627-b82e-b91711567383 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:40.312073 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59499bdd-adaf-4627-b82e-b91711567383 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:40.312341 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59499bdd-adaf-4627-b82e-b91711567383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:40.331922 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-59499bdd-adaf-4627-b82e-b91711567383 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:59:40.333151 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-59499bdd-adaf-4627-b82e-b91711567383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:59:40.401924 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 523/1033] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:59:40 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 29 01:59:40.669223 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fab252-938e-4565-8a2d-c23fe1951407 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:40.774905 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fab252-938e-4565-8a2d-c23fe1951407 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:40.811184 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adce1a30-1f8b-4ecd-b818-585b1bab1116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:40.811816 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce1a30-1f8b-4ecd-b818-585b1bab1116 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:40.812096 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce1a30-1f8b-4ecd-b818-585b1bab1116 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:40.812367 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce1a30-1f8b-4ecd-b818-585b1bab1116 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:40.822484 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adce1a30-1f8b-4ecd-b818-585b1bab1116 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:59:40.828392 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-adce1a30-1f8b-4ecd-b818-585b1bab1116 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 29 01:59:40.828392 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:40.828392 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:40.828392 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:40.828392 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:40.828392 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:40.828392 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:40.828392 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:40.828392 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:40.828392 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:40.828392 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:40.828392 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:40.828392 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:59:40.828392 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:59:40.828392 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:59:40.828392 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:59:40.833481 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:59:40.833481 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:59:40.833481 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:59:40.833481 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:59:40.833481 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:40.833481 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:40.833481 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:40.833481 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:40.833481 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:40.833481 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:40.833481 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:40.833481 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:40.833481 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:40.833481 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:40.833481 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:40.833481 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:40.834369 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:40.834369 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:40.834369 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:40.834369 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:40.834369 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:59:40.834369 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:59:40.834369 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:59:40.834369 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:59:40.834369 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:59:40.834369 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:59:40.834369 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 29 01:59:40.834369 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:59:40.834369 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 511/1034] 10.222.0.49 () {56 vars in 1120 bytes} [Thu Sep 29 01:59:40 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:40.836204 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59499bdd-adaf-4627-b82e-b91711567383 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:40.944731 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59499bdd-adaf-4627-b82e-b91711567383 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:40.948176 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:40.984304 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6173daf-55fd-464c-8247-bc2846aa15f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:40.984913 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6173daf-55fd-464c-8247-bc2846aa15f6 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:40.985191 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6173daf-55fd-464c-8247-bc2846aa15f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:40.985493 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6173daf-55fd-464c-8247-bc2846aa15f6 None admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:40.986147 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6173daf-55fd-464c-8247-bc2846aa15f6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:40.986450 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6173daf-55fd-464c-8247-bc2846aa15f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:40.987816 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6173daf-55fd-464c-8247-bc2846aa15f6 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:40.996111 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 524/1035] 10.222.0.49 () {56 vars in 1115 bytes} [Thu Sep 29 01:59:40 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:41.002797 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adce1a30-1f8b-4ecd-b818-585b1bab1116 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:41.014689 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:41.105347 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adce1a30-1f8b-4ecd-b818-585b1bab1116 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:41.140480 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8cdf61-01bb-4b7e-98eb-49d34c9ba6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:41.141114 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8cdf61-01bb-4b7e-98eb-49d34c9ba6a1 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:41.141435 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8cdf61-01bb-4b7e-98eb-49d34c9ba6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:41.141710 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8cdf61-01bb-4b7e-98eb-49d34c9ba6a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:41.152056 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8cdf61-01bb-4b7e-98eb-49d34c9ba6a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:41.153755 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8cdf61-01bb-4b7e-98eb-49d34c9ba6a1 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:41.168707 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-3d8cdf61-01bb-4b7e-98eb-49d34c9ba6a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:41.168707 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:41.168707 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:41.168707 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:41.168707 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:41.168707 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:41.168707 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:41.168707 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:41.168707 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:41.168707 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:41.168707 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:41.168707 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:41.168707 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:59:41.168707 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:59:41.168707 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:59:41.168707 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:59:41.169939 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:41.169939 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:41.169939 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:41.169939 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:41.169939 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:41.169939 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:41.169939 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:41.169939 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:41.169939 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:41.169939 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:41.169939 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:41.169939 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:41.169939 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:41.169939 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:41.169939 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:41.169939 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:41.169939 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:59:41.170919 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:59:41.170919 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:41.170919 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:59:41.173624 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 512/1036] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 01:59:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:41.175988 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6173daf-55fd-464c-8247-bc2846aa15f6 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:41.280686 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6173daf-55fd-464c-8247-bc2846aa15f6 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:41.315467 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60529ec3-b8f4-4179-b5c0-a0da2daecdfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:41.316076 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60529ec3-b8f4-4179-b5c0-a0da2daecdfa None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:41.316353 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60529ec3-b8f4-4179-b5c0-a0da2daecdfa None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:41.316623 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60529ec3-b8f4-4179-b5c0-a0da2daecdfa None admin] PATH_INFO: `/v3/domains` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:41.317254 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60529ec3-b8f4-4179-b5c0-a0da2daecdfa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:41.317578 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60529ec3-b8f4-4179-b5c0-a0da2daecdfa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:41.318951 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60529ec3-b8f4-4179-b5c0-a0da2daecdfa None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:41.336379 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 525/1037] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Sep 29 01:59:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:59:41.337680 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8cdf61-01bb-4b7e-98eb-49d34c9ba6a1 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:41.402425 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:41.445737 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8cdf61-01bb-4b7e-98eb-49d34c9ba6a1 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:41.479754 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56349fe4-f205-4684-a3f4-45a905f6629f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:41.480376 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56349fe4-f205-4684-a3f4-45a905f6629f None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:41.480647 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56349fe4-f205-4684-a3f4-45a905f6629f None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:41.480909 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56349fe4-f205-4684-a3f4-45a905f6629f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:41.488806 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56349fe4-f205-4684-a3f4-45a905f6629f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:41.490286 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56349fe4-f205-4684-a3f4-45a905f6629f None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:41.503124 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-56349fe4-f205-4684-a3f4-45a905f6629f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 29 01:59:41.503124 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:41.503124 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:41.503124 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:41.503124 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:41.503124 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:41.503124 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:41.503124 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:41.503124 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:41.503124 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:41.503124 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:41.503124 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:41.503124 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 29 01:59:41.503124 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 29 01:59:41.503124 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 29 01:59:41.503124 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 29 01:59:41.504184 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:41.504184 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:41.504184 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 29 01:59:41.504184 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:59:41.504184 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 29 01:59:41.504184 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:59:41.504184 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:41.504184 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:41.504184 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:41.504184 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:41.504184 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:41.504184 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:41.504184 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:41.504184 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:41.504184 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:41.504184 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:41.504184 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:41.504184 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:41.505122 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:41.505122 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:41.505122 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 29 01:59:41.505122 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 29 01:59:41.505122 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 29 01:59:41.505122 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 29 01:59:41.505122 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 29 01:59:41.505122 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 29 01:59:41.505122 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 29 01:59:41.505122 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:59:41.505122 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 513/1038] 10.222.0.49 () {56 vars in 1093 bytes} [Thu Sep 29 01:59:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:41.510368 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60529ec3-b8f4-4179-b5c0-a0da2daecdfa None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:41.540026 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:41.616389 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6274f43f-0133-4581-af53-929961dcc51b None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:41.616737 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6274f43f-0133-4581-af53-929961dcc51b None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:41.616939 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6274f43f-0133-4581-af53-929961dcc51b None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:41.617120 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60529ec3-b8f4-4179-b5c0-a0da2daecdfa None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:41.618438 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 514/1039] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:59:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:59:41.624101 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d81fc-444b-4576-8de8-ecc3da412c89 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:41.624637 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d81fc-444b-4576-8de8-ecc3da412c89 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:41.625122 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d81fc-444b-4576-8de8-ecc3da412c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:41.644054 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-d03d81fc-444b-4576-8de8-ecc3da412c89 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:59:41.645583 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-d03d81fc-444b-4576-8de8-ecc3da412c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:59:41.652999 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df7637e-9cac-451e-bec4-86e5b2c724d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:41.654621 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df7637e-9cac-451e-bec4-86e5b2c724d2 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:41.654907 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df7637e-9cac-451e-bec4-86e5b2c724d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:41.655184 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df7637e-9cac-451e-bec4-86e5b2c724d2 None admin] PATH_INFO: `/v3/users` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:41.656273 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df7637e-9cac-451e-bec4-86e5b2c724d2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:41.656586 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df7637e-9cac-451e-bec4-86e5b2c724d2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:41.658337 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df7637e-9cac-451e-bec4-86e5b2c724d2 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:41.677798 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 526/1040] 10.222.0.49 () {56 vars in 1133 bytes} [Thu Sep 29 01:59:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:41.683482 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df7637e-9cac-451e-bec4-86e5b2c724d2 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:41.714831 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 515/1041] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:59:41 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 29 01:59:41.772943 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:41.791405 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df7637e-9cac-451e-bec4-86e5b2c724d2 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:41.826949 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d84121-1ad8-4119-bf8a-895de368a71b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:41.827554 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d84121-1ad8-4119-bf8a-895de368a71b None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:41.827836 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d84121-1ad8-4119-bf8a-895de368a71b None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:41.828109 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d84121-1ad8-4119-bf8a-895de368a71b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:41.895886 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d84121-1ad8-4119-bf8a-895de368a71b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:41.897358 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d84121-1ad8-4119-bf8a-895de368a71b None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:41.985268 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:41.987024 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03d81fc-444b-4576-8de8-ecc3da412c89 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:42.012422 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 527/1042] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Sep 29 01:59:41 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 29 01:59:42.014349 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d84121-1ad8-4119-bf8a-895de368a71b None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:42.040046 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:42.093176 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03d81fc-444b-4576-8de8-ecc3da412c89 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:42.126425 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d84121-1ad8-4119-bf8a-895de368a71b None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:42.134514 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353aa823-dfda-4806-b1d8-896fc87afaa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:42.135758 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353aa823-dfda-4806-b1d8-896fc87afaa7 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:42.136038 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353aa823-dfda-4806-b1d8-896fc87afaa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:42.136307 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353aa823-dfda-4806-b1d8-896fc87afaa7 None admin] PATH_INFO: `/v3/services/image` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:42.137272 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353aa823-dfda-4806-b1d8-896fc87afaa7 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:42.139083 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353aa823-dfda-4806-b1d8-896fc87afaa7 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:42.148816 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-353aa823-dfda-4806-b1d8-896fc87afaa7 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 29 01:59:42.148816 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:42.148816 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 29 01:59:42.148816 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 29 01:59:42.148816 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 29 01:59:42.148816 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 29 01:59:42.148816 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 29 01:59:42.148816 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 29 01:59:42.148816 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 29 01:59:42.148816 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:59:42.148816 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 29 01:59:42.148816 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:59:42.148816 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:42.148816 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:42.148816 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:42.148816 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:42.148816 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:42.150068 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:42.150068 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:42.150068 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:42.150068 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:42.150068 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:42.150068 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:42.150068 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 29 01:59:42.150068 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 29 01:59:42.150068 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 29 01:59:42.150068 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 29 01:59:42.150068 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:42.150068 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:42.150068 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:42.150068 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:42.150068 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:42.150068 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:42.150890 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:42.150890 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:42.150890 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:42.150890 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:42.150890 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:42.150890 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:42.150890 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:42.150890 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:42.150890 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:42.150890 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:42.150890 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 29 01:59:42.150890 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 29 01:59:42.150890 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 29 01:59:42.150890 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:59:42.150890 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 516/1043] 10.222.0.49 () {56 vars in 1105 bytes} [Thu Sep 29 01:59:41 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 01:59:42.155988 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353aa823-dfda-4806-b1d8-896fc87afaa7 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:42.168438 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c4e58-ab04-413a-99e4-c120ab72c3aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:42.170044 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c4e58-ab04-413a-99e4-c120ab72c3aa None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:42.170466 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c4e58-ab04-413a-99e4-c120ab72c3aa None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:42.170739 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c4e58-ab04-413a-99e4-c120ab72c3aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:42.181147 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825c4e58-ab04-413a-99e4-c120ab72c3aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:42.182619 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825c4e58-ab04-413a-99e4-c120ab72c3aa None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:42.197469 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-825c4e58-ab04-413a-99e4-c120ab72c3aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:42.197469 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:42.197469 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:42.197469 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:42.197469 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:42.197469 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:42.197469 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:42.197469 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:42.197469 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:42.197469 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:42.197469 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:42.197469 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:42.197469 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:59:42.197469 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:59:42.197469 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:59:42.197469 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:59:42.198457 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:42.198457 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:42.198457 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:42.198457 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:42.198457 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:42.198457 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:42.198457 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:42.198457 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:42.198457 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:42.198457 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:42.198457 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:42.198457 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:42.198457 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:42.198457 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:42.198457 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:42.198457 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:42.198457 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:59:42.199330 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:59:42.199330 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:42.199330 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:59:42.203759 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 528/1044] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 01:59:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 01:59:42.204859 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c4e58-ab04-413a-99e4-c120ab72c3aa None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:42.241986 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:42.266218 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353aa823-dfda-4806-b1d8-896fc87afaa7 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:42.280668 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:42.301234 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87d3d3e-884d-45ed-899d-78ef4fb2df0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:42.301866 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87d3d3e-884d-45ed-899d-78ef4fb2df0b None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:42.302144 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87d3d3e-884d-45ed-899d-78ef4fb2df0b None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:42.302412 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87d3d3e-884d-45ed-899d-78ef4fb2df0b None admin] PATH_INFO: `/v3/services` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:42.303034 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87d3d3e-884d-45ed-899d-78ef4fb2df0b None admin] RBAC: Adding query filter params (name=image) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:42.303333 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87d3d3e-884d-45ed-899d-78ef4fb2df0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:42.304713 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87d3d3e-884d-45ed-899d-78ef4fb2df0b None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:42.306436 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c4e58-ab04-413a-99e4-c120ab72c3aa None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:42.309445 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 517/1045] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 01:59:42 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:42.310762 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ba2d5-f892-45ec-8ad1-1d14dc9ff784 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:42.311045 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ba2d5-f892-45ec-8ad1-1d14dc9ff784 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:42.311315 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ba2d5-f892-45ec-8ad1-1d14dc9ff784 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:42.312648 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 518/1046] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:59:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:59:42.315288 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52ba2d5-f892-45ec-8ad1-1d14dc9ff784 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:42.341941 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398d415d-2f6f-4b87-b986-a14d08a44f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:42.342541 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398d415d-2f6f-4b87-b986-a14d08a44f5d None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:42.342819 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398d415d-2f6f-4b87-b986-a14d08a44f5d None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:42.343093 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398d415d-2f6f-4b87-b986-a14d08a44f5d None admin] PATH_INFO: `/v3/domains` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:42.343775 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398d415d-2f6f-4b87-b986-a14d08a44f5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:42.344023 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398d415d-2f6f-4b87-b986-a14d08a44f5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:42.345421 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398d415d-2f6f-4b87-b986-a14d08a44f5d None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:42.356926 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 529/1047] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Sep 29 01:59:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:42.358112 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e52beda-0e65-4ddf-be60-3c0f6eb55f30 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:42.358399 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e52beda-0e65-4ddf-be60-3c0f6eb55f30 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:42.358670 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e52beda-0e65-4ddf-be60-3c0f6eb55f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:42.376433 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-3e52beda-0e65-4ddf-be60-3c0f6eb55f30 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:59:42.377660 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-3e52beda-0e65-4ddf-be60-3c0f6eb55f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:59:42.424184 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52ba2d5-f892-45ec-8ad1-1d14dc9ff784 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:42.442836 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 530/1048] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:59:42 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 29 01:59:42.443661 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e52beda-0e65-4ddf-be60-3c0f6eb55f30 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:42.458263 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c8e155-4df4-4006-90e2-5da3a2695227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:42.458854 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c8e155-4df4-4006-90e2-5da3a2695227 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:42.459133 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c8e155-4df4-4006-90e2-5da3a2695227 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:42.459404 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c8e155-4df4-4006-90e2-5da3a2695227 None admin] PATH_INFO: `/v3/services` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:42.460053 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c8e155-4df4-4006-90e2-5da3a2695227 None admin] RBAC: Adding query filter params (type=image) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:42.460332 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c8e155-4df4-4006-90e2-5da3a2695227 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:42.461722 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c8e155-4df4-4006-90e2-5da3a2695227 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:42.466576 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 519/1049] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 01:59:42 2022] GET /identity/v3/services?type=image => generated 350 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:59:42.472183 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c8e155-4df4-4006-90e2-5da3a2695227 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:42.472310 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:42.519381 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:42.553849 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e52beda-0e65-4ddf-be60-3c0f6eb55f30 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:42.585143 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c8e155-4df4-4006-90e2-5da3a2695227 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:42.591094 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8ad62d-9791-4995-902c-a217186d1b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:42.591723 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ad62d-9791-4995-902c-a217186d1b2c None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:42.591997 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ad62d-9791-4995-902c-a217186d1b2c None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:42.592262 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ad62d-9791-4995-902c-a217186d1b2c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:42.601652 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8ad62d-9791-4995-902c-a217186d1b2c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:42.603653 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8ad62d-9791-4995-902c-a217186d1b2c None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:42.618661 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-6b8ad62d-9791-4995-902c-a217186d1b2c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:59:42.618661 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:42.618661 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:42.618661 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:42.618661 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:42.618661 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:42.618661 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:42.618661 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:42.618661 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:42.618661 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:42.618661 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:42.618661 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:42.618661 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 29 01:59:42.618661 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 29 01:59:42.618661 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 29 01:59:42.619547 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 29 01:59:42.619547 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:42.619547 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:42.619547 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:42.619547 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:42.619547 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:42.619547 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:42.619547 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:42.619547 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:42.619547 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:42.619547 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:42.619547 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:42.619547 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:42.619547 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:42.619547 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:42.619547 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:42.619547 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:42.621091 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 29 01:59:42.621091 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 29 01:59:42.621091 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 29 01:59:42.621091 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 29 01:59:42.621091 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 29 01:59:42.621091 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 29 01:59:42.621091 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:59:42.621091 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:59:42.621091 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 531/1050] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Sep 29 01:59:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:42.621634 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dbb954-a1a8-40b2-a18b-db5155294a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:42.621634 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dbb954-a1a8-40b2-a18b-db5155294a09 None admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:42.621634 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dbb954-a1a8-40b2-a18b-db5155294a09 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:42.622377 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dbb954-a1a8-40b2-a18b-db5155294a09 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:42.623154 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dbb954-a1a8-40b2-a18b-db5155294a09 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:42.624501 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dbb954-a1a8-40b2-a18b-db5155294a09 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:42.625972 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8ad62d-9791-4995-902c-a217186d1b2c None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:42.654001 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 520/1051] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 01:59:42 2022] POST /identity/v3/endpoints => generated 327 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 29 01:59:42.720238 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dbb954-a1a8-40b2-a18b-db5155294a09 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:42.734397 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:42.754532 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8ad62d-9791-4995-902c-a217186d1b2c None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:42.798944 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542bd608-f1fb-49d9-8ca6-27aef138e93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:42.799898 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542bd608-f1fb-49d9-8ca6-27aef138e93f None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:42.800349 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542bd608-f1fb-49d9-8ca6-27aef138e93f None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:42.800614 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542bd608-f1fb-49d9-8ca6-27aef138e93f None admin] PATH_INFO: `/v3/projects` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:42.801323 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542bd608-f1fb-49d9-8ca6-27aef138e93f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:42.801652 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542bd608-f1fb-49d9-8ca6-27aef138e93f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:42.803094 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542bd608-f1fb-49d9-8ca6-27aef138e93f None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:42.817221 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 532/1052] 10.222.0.49 () {56 vars in 1148 bytes} [Thu Sep 29 01:59:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:59:42.823267 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542bd608-f1fb-49d9-8ca6-27aef138e93f None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:42.834420 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:42.839517 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dbb954-a1a8-40b2-a18b-db5155294a09 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:42.884688 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaa3dcc-528c-4b91-8385-5087731a8354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:42.885237 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa3dcc-528c-4b91-8385-5087731a8354 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:42.885542 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa3dcc-528c-4b91-8385-5087731a8354 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:42.885817 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa3dcc-528c-4b91-8385-5087731a8354 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:42.898038 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaa3dcc-528c-4b91-8385-5087731a8354 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:59:42.902956 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-daaa3dcc-528c-4b91-8385-5087731a8354 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 01:59:42.902956 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:42.902956 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:42.902956 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:42.902956 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:42.902956 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:42.902956 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:42.902956 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:42.902956 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:42.902956 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:42.902956 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:42.902956 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:42.902956 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:59:42.902956 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:59:42.902956 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:59:42.902956 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:59:42.904032 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:59:42.904032 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:59:42.904032 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:59:42.904032 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:59:42.904032 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:42.904032 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:42.904032 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:42.904032 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:42.904032 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:42.904032 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:42.904032 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:42.904032 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:42.904032 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:42.904032 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:42.904032 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:42.904032 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:42.905715 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:42.905715 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:42.905715 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:42.905715 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:42.905715 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:59:42.905715 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:59:42.905715 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:59:42.905715 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:59:42.905715 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:59:42.905715 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:59:42.905715 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 01:59:42.905715 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:59:42.905715 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 521/1053] 10.222.0.49 () {56 vars in 1096 bytes} [Thu Sep 29 01:59:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 01:59:42.912442 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaa3dcc-528c-4b91-8385-5087731a8354 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:42.943555 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542bd608-f1fb-49d9-8ca6-27aef138e93f None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:42.980237 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5cec97-a428-4a7c-af77-74c623db4f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:42.980841 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5cec97-a428-4a7c-af77-74c623db4f65 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:42.981113 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5cec97-a428-4a7c-af77-74c623db4f65 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:42.981926 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5cec97-a428-4a7c-af77-74c623db4f65 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:42.982640 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5cec97-a428-4a7c-af77-74c623db4f65 None admin] RBAC: Adding query filter params (role.id=3bbece89f99a4c658f63f212839b21ff, scope.project.id=6f1d8fd250c84c5887cb3173053ea2dd, user.id=f3325a7111d447f4a9cf00c672d5420f) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:42.982942 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5cec97-a428-4a7c-af77-74c623db4f65 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:42.984352 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5cec97-a428-4a7c-af77-74c623db4f65 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:42.997570 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 533/1054] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Sep 29 01:59:42 2022] GET /identity/v3/role_assignments?user.id=f3325a7111d447f4a9cf00c672d5420f&scope.project.id=6f1d8fd250c84c5887cb3173053ea2dd&role.id=3bbece89f99a4c658f63f212839b21ff => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:59:43.027982 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaa3dcc-528c-4b91-8385-5087731a8354 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:43.066308 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747ff1a5-de91-41c2-b844-716bdda56c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:43.066929 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747ff1a5-de91-41c2-b844-716bdda56c94 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:43.067258 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747ff1a5-de91-41c2-b844-716bdda56c94 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:43.067534 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747ff1a5-de91-41c2-b844-716bdda56c94 None admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:43.068210 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747ff1a5-de91-41c2-b844-716bdda56c94 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:43.068511 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747ff1a5-de91-41c2-b844-716bdda56c94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:43.069992 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747ff1a5-de91-41c2-b844-716bdda56c94 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:43.085196 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 522/1055] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Sep 29 01:59:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:43.086817 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5cec97-a428-4a7c-af77-74c623db4f65 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:43.096920 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:43.198107 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5cec97-a428-4a7c-af77-74c623db4f65 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:43.234423 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3a35e1-4dc2-4d97-9a66-4efb2d94fb29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:43.235057 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a35e1-4dc2-4d97-9a66-4efb2d94fb29 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:43.235337 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a35e1-4dc2-4d97-9a66-4efb2d94fb29 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:43.235612 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a35e1-4dc2-4d97-9a66-4efb2d94fb29 None admin] PATH_INFO: `/v3/users/a47f8771d0404af9a20931af6bdff7c7` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:43.249400 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3a35e1-4dc2-4d97-9a66-4efb2d94fb29 None admin] RBAC: Authorizing `identity:get_user(user_id=a47f8771d0404af9a20931af6bdff7c7)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:43.250843 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3a35e1-4dc2-4d97-9a66-4efb2d94fb29 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:43.252509 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 534/1056] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Sep 29 01:59:43 2022] GET /identity/v3/users/a47f8771d0404af9a20931af6bdff7c7 => generated 285 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:43.258447 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747ff1a5-de91-41c2-b844-716bdda56c94 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:43.281626 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:43.361968 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747ff1a5-de91-41c2-b844-716bdda56c94 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:43.395835 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9683750-cdcf-493b-99ad-285d04b31174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:43.396451 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9683750-cdcf-493b-99ad-285d04b31174 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:43.396734 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9683750-cdcf-493b-99ad-285d04b31174 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:43.397009 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9683750-cdcf-493b-99ad-285d04b31174 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:43.466823 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9683750-cdcf-493b-99ad-285d04b31174 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:43.468337 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9683750-cdcf-493b-99ad-285d04b31174 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:43.489874 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:43.576697 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 523/1057] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Sep 29 01:59:43 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 29 01:59:43.577968 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3a35e1-4dc2-4d97-9a66-4efb2d94fb29 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:43.646285 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:43.686241 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3a35e1-4dc2-4d97-9a66-4efb2d94fb29 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:43.720793 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2dceee-fd26-4447-aa9a-b06936e76f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:43.721370 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2dceee-fd26-4447-aa9a-b06936e76f91 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:43.721654 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2dceee-fd26-4447-aa9a-b06936e76f91 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:43.721929 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2dceee-fd26-4447-aa9a-b06936e76f91 None admin] PATH_INFO: `/v3/projects/b4fd31add918446baf9c7868e4288d60` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:43.723050 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2dceee-fd26-4447-aa9a-b06936e76f91 None admin] RBAC: Authorizing `identity:get_project(project_id=b4fd31add918446baf9c7868e4288d60)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:43.724480 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2dceee-fd26-4447-aa9a-b06936e76f91 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:43.726283 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 535/1058] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Sep 29 01:59:43 2022] GET /identity/v3/projects/b4fd31add918446baf9c7868e4288d60 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:59:43.732697 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9683750-cdcf-493b-99ad-285d04b31174 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:43.832733 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9683750-cdcf-493b-99ad-285d04b31174 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:43.853263 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:43.870168 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82145566-136b-4581-8788-0863123da56d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:43.870790 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82145566-136b-4581-8788-0863123da56d None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:43.871069 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82145566-136b-4581-8788-0863123da56d None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:43.871340 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82145566-136b-4581-8788-0863123da56d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:43.872135 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82145566-136b-4581-8788-0863123da56d None admin] RBAC: Adding query filter params (role.id=fe9bbc67742f4f5893f39b18eb31d59a, scope.project.id=b4fd31add918446baf9c7868e4288d60, user.id=a47f8771d0404af9a20931af6bdff7c7) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:43.872441 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82145566-136b-4581-8788-0863123da56d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:43.873917 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82145566-136b-4581-8788-0863123da56d None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:43.880019 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 524/1059] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Sep 29 01:59:43 2022] GET /identity/v3/role_assignments?user.id=a47f8771d0404af9a20931af6bdff7c7&scope.project.id=b4fd31add918446baf9c7868e4288d60&role.id=fe9bbc67742f4f5893f39b18eb31d59a => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:59:44.863950 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12630df-210b-4b97-bd45-4ba8e08dcb20 None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:44.864473 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12630df-210b-4b97-bd45-4ba8e08dcb20 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:44.864473 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12630df-210b-4b97-bd45-4ba8e08dcb20 None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:44.865996 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 536/1060] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:59:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:59:44.870922 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a4507-86e5-4ef7-a26b-f8bde79548ad None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:44.871316 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a4507-86e5-4ef7-a26b-f8bde79548ad None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:44.871484 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a4507-86e5-4ef7-a26b-f8bde79548ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:44.890213 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-c42a4507-86e5-4ef7-a26b-f8bde79548ad None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:59:44.891400 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-c42a4507-86e5-4ef7-a26b-f8bde79548ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:59:44.963331 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 525/1061] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:59:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 29 01:59:45.186155 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cef6eb-df85-44d2-94c7-1c1d8395275a None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:45.186459 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cef6eb-df85-44d2-94c7-1c1d8395275a None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:45.188047 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cef6eb-df85-44d2-94c7-1c1d8395275a None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:45.189919 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 537/1062] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:59:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:59:45.195037 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c7024f-73ea-4936-b1f0-0d6b545ae89c None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:45.195326 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c7024f-73ea-4936-b1f0-0d6b545ae89c None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:45.195598 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c7024f-73ea-4936-b1f0-0d6b545ae89c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:45.218187 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-13c7024f-73ea-4936-b1f0-0d6b545ae89c None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:59:45.219393 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-13c7024f-73ea-4936-b1f0-0d6b545ae89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:59:45.248710 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cef6eb-df85-44d2-94c7-1c1d8395275a None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:45.295684 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 526/1063] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:59:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 29 01:59:45.370361 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cef6eb-df85-44d2-94c7-1c1d8395275a None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:45.402601 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:45.409086 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca007426-51b2-4774-ba2f-2a7e2e6cd1db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:45.409727 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca007426-51b2-4774-ba2f-2a7e2e6cd1db None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:45.410009 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca007426-51b2-4774-ba2f-2a7e2e6cd1db None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:45.410282 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca007426-51b2-4774-ba2f-2a7e2e6cd1db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:45.485253 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca007426-51b2-4774-ba2f-2a7e2e6cd1db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:45.486782 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca007426-51b2-4774-ba2f-2a7e2e6cd1db None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:45.571282 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c7024f-73ea-4936-b1f0-0d6b545ae89c None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:45.599429 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 538/1064] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Sep 29 01:59:45 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 29 01:59:45.606257 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca007426-51b2-4774-ba2f-2a7e2e6cd1db None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:45.636798 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:45.653254 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:45.698734 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c7024f-73ea-4936-b1f0-0d6b545ae89c None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:45.724713 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca007426-51b2-4774-ba2f-2a7e2e6cd1db None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:45.736202 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cb1d3a-269e-48b4-b954-d05e4e9f7f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:45.737056 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cb1d3a-269e-48b4-b954-d05e4e9f7f4a None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:45.737358 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cb1d3a-269e-48b4-b954-d05e4e9f7f4a None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:45.737626 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cb1d3a-269e-48b4-b954-d05e4e9f7f4a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:45.750297 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cb1d3a-269e-48b4-b954-d05e4e9f7f4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:59:45.755980 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-d7cb1d3a-269e-48b4-b954-d05e4e9f7f4a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 29 01:59:45.755980 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:45.755980 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:45.755980 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:45.755980 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:45.755980 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:45.755980 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:45.755980 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:45.755980 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:45.755980 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:45.755980 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:45.755980 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:45.755980 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:59:45.755980 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:59:45.755980 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:59:45.755980 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:59:45.756932 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:59:45.756932 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:59:45.756932 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:59:45.756932 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:59:45.756932 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:45.756932 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:45.756932 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:45.756932 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:45.756932 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:45.756932 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:45.756932 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:45.756932 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:45.756932 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:45.756932 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:45.756932 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:45.756932 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:45.757821 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:45.757821 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:45.757821 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:45.757821 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:45.757821 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:59:45.757821 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:59:45.757821 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:59:45.757821 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:59:45.757821 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:59:45.757821 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:59:45.757821 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 29 01:59:45.757821 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:59:45.757821 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 527/1065] 10.222.0.49 () {56 vars in 1120 bytes} [Thu Sep 29 01:59:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 01:59:45.763151 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cb1d3a-269e-48b4-b954-d05e4e9f7f4a None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:45.764276 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b247cc-7e9a-467d-bef2-4e3ab35b90a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:45.764909 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b247cc-7e9a-467d-bef2-4e3ab35b90a1 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:45.765183 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b247cc-7e9a-467d-bef2-4e3ab35b90a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:45.765481 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b247cc-7e9a-467d-bef2-4e3ab35b90a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:45.775731 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b247cc-7e9a-467d-bef2-4e3ab35b90a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:45.777162 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b247cc-7e9a-467d-bef2-4e3ab35b90a1 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:45.792751 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-f9b247cc-7e9a-467d-bef2-4e3ab35b90a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:45.792751 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:45.792751 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:45.792751 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:45.792751 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:45.792751 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:45.792751 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:45.792751 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:45.792751 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:45.792751 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:45.792751 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:45.792751 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:45.792751 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:59:45.792751 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:59:45.792751 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:59:45.792751 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:59:45.794317 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:45.794317 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:45.794317 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:45.794317 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:45.794317 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:45.794317 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:45.794317 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:45.794317 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:45.794317 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:45.794317 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:45.794317 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:45.794317 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:45.794317 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:45.794317 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:45.794317 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:45.794317 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:45.794317 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:59:45.795234 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:59:45.795234 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:45.795234 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:59:45.799603 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 539/1066] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 01:59:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:45.800421 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b247cc-7e9a-467d-bef2-4e3ab35b90a1 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:45.873296 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cb1d3a-269e-48b4-b954-d05e4e9f7f4a None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:45.876644 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:45.893267 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:45.917648 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b247cc-7e9a-467d-bef2-4e3ab35b90a1 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:45.918205 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de9806a-9b68-4b0f-a853-f4549c0f49da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:45.919379 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de9806a-9b68-4b0f-a853-f4549c0f49da None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:45.919697 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de9806a-9b68-4b0f-a853-f4549c0f49da None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:45.920031 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de9806a-9b68-4b0f-a853-f4549c0f49da None admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:45.920720 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de9806a-9b68-4b0f-a853-f4549c0f49da None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:45.921021 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de9806a-9b68-4b0f-a853-f4549c0f49da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:45.922452 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de9806a-9b68-4b0f-a853-f4549c0f49da None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:45.931400 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 528/1067] 10.222.0.49 () {56 vars in 1115 bytes} [Thu Sep 29 01:59:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:59:45.937629 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de9806a-9b68-4b0f-a853-f4549c0f49da None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:45.959280 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3046d74c-0779-43ac-b827-07bb6172eff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:45.959884 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046d74c-0779-43ac-b827-07bb6172eff5 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:45.960160 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046d74c-0779-43ac-b827-07bb6172eff5 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:45.960426 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046d74c-0779-43ac-b827-07bb6172eff5 None admin] PATH_INFO: `/v3/domains` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:45.961062 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3046d74c-0779-43ac-b827-07bb6172eff5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:45.961386 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3046d74c-0779-43ac-b827-07bb6172eff5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:45.962742 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3046d74c-0779-43ac-b827-07bb6172eff5 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:45.974713 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 540/1068] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Sep 29 01:59:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:59:46.010408 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ac7907-1569-424f-ac83-174f7ca44fb5 None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:46.010592 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ac7907-1569-424f-ac83-174f7ca44fb5 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:46.010867 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ac7907-1569-424f-ac83-174f7ca44fb5 None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:46.013355 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 541/1069] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:59:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 29 01:59:46.018299 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f82fbe-48a7-4d80-b101-112342149c61 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:46.018649 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f82fbe-48a7-4d80-b101-112342149c61 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:46.018925 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f82fbe-48a7-4d80-b101-112342149c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:46.037988 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-66f82fbe-48a7-4d80-b101-112342149c61 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:59:46.039220 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-66f82fbe-48a7-4d80-b101-112342149c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:59:46.067391 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de9806a-9b68-4b0f-a853-f4549c0f49da None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:46.109126 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8c9584-38e5-4446-85d9-2bfacfb18a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:46.109806 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8c9584-38e5-4446-85d9-2bfacfb18a7a None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:46.110079 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8c9584-38e5-4446-85d9-2bfacfb18a7a None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:46.110346 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8c9584-38e5-4446-85d9-2bfacfb18a7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:46.115038 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 542/1070] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:59:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 29 01:59:46.125944 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8c9584-38e5-4446-85d9-2bfacfb18a7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:46.127414 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8c9584-38e5-4446-85d9-2bfacfb18a7a None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:46.143171 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-ff8c9584-38e5-4446-85d9-2bfacfb18a7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:46.143171 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:46.143171 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:46.143171 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:46.143171 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:46.143171 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:46.143171 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:46.143171 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:46.143171 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:46.143171 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:46.143171 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:46.143171 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:46.143171 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:59:46.143171 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:59:46.143171 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:59:46.143171 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:59:46.144175 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:46.144175 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:46.144175 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:46.144175 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:46.144175 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:46.144175 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:46.144175 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:46.144175 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:46.144175 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:46.144175 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:46.144175 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:46.144175 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:46.144175 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:46.144175 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:46.144175 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:46.144175 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:46.144175 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:59:46.150047 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:59:46.150047 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:46.150047 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:59:46.150047 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 529/1071] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 01:59:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 01:59:46.150468 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f82fbe-48a7-4d80-b101-112342149c61 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:46.232694 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:46.259962 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f82fbe-48a7-4d80-b101-112342149c61 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:46.297659 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf733431-bdba-4617-8a68-b8d3e8b80f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:46.298199 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf733431-bdba-4617-8a68-b8d3e8b80f39 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:46.298477 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf733431-bdba-4617-8a68-b8d3e8b80f39 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:46.298747 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf733431-bdba-4617-8a68-b8d3e8b80f39 None admin] PATH_INFO: `/v3/domains` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:46.299383 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf733431-bdba-4617-8a68-b8d3e8b80f39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:46.299684 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf733431-bdba-4617-8a68-b8d3e8b80f39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:46.301065 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf733431-bdba-4617-8a68-b8d3e8b80f39 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:46.313207 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 543/1072] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Sep 29 01:59:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:46.319119 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8c9584-38e5-4446-85d9-2bfacfb18a7a None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:46.338056 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:46.388620 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf733431-bdba-4617-8a68-b8d3e8b80f39 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:46.417761 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8c9584-38e5-4446-85d9-2bfacfb18a7a None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:46.450852 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcee38b0-e69e-456e-8971-8e819b8feb70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:46.451469 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcee38b0-e69e-456e-8971-8e819b8feb70 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:46.451746 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcee38b0-e69e-456e-8971-8e819b8feb70 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:46.452014 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcee38b0-e69e-456e-8971-8e819b8feb70 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:46.459298 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcee38b0-e69e-456e-8971-8e819b8feb70 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:46.460711 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcee38b0-e69e-456e-8971-8e819b8feb70 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:46.472184 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-fcee38b0-e69e-456e-8971-8e819b8feb70 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 29 01:59:46.472184 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:46.472184 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:46.472184 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:46.472184 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:46.472184 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:46.472184 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:46.472184 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:46.472184 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:46.472184 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:46.472184 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:46.472184 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:46.472184 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 29 01:59:46.472184 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 29 01:59:46.472184 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 29 01:59:46.472184 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 29 01:59:46.473340 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:46.473340 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:46.473340 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 29 01:59:46.473340 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:59:46.473340 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 29 01:59:46.473340 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:59:46.473340 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:46.473340 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:46.473340 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:46.473340 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:46.473340 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:46.473340 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:46.473340 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:46.473340 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:46.473340 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:46.473340 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:46.473340 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:46.473340 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:46.474520 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:46.474520 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:46.474520 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 29 01:59:46.474520 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 29 01:59:46.474520 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 29 01:59:46.474520 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 29 01:59:46.474520 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 29 01:59:46.474520 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 29 01:59:46.474520 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 29 01:59:46.474520 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:59:46.477462 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 530/1073] 10.222.0.49 () {56 vars in 1093 bytes} [Thu Sep 29 01:59:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:46.479382 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcee38b0-e69e-456e-8971-8e819b8feb70 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:46.487916 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf733431-bdba-4617-8a68-b8d3e8b80f39 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:46.527615 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e6aedb-2be7-4edc-8e9d-4565a568fe5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:46.528390 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e6aedb-2be7-4edc-8e9d-4565a568fe5c None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:46.528669 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e6aedb-2be7-4edc-8e9d-4565a568fe5c None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:46.528941 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e6aedb-2be7-4edc-8e9d-4565a568fe5c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:46.531025 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:46.541531 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e6aedb-2be7-4edc-8e9d-4565a568fe5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:59:46.546903 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-99e6aedb-2be7-4edc-8e9d-4565a568fe5c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 01:59:46.546903 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:46.546903 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:46.546903 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:46.546903 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:46.546903 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:46.546903 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:46.546903 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:46.546903 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:46.546903 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:46.546903 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:46.546903 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:46.546903 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:59:46.546903 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:59:46.546903 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:59:46.546903 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:59:46.548155 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:59:46.548155 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:59:46.548155 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:59:46.548155 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:59:46.548155 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:46.548155 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:46.548155 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:46.548155 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:46.548155 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:46.548155 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:46.548155 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:46.548155 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:46.548155 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:46.548155 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:46.548155 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:46.548155 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:46.549206 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:46.549206 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:46.549206 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:46.549206 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:46.549206 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:59:46.549206 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:59:46.549206 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:59:46.549206 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:59:46.549206 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:59:46.549206 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:59:46.549206 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 01:59:46.549206 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:59:46.549206 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 544/1074] 10.222.0.49 () {56 vars in 1096 bytes} [Thu Sep 29 01:59:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 01:59:46.560648 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e6aedb-2be7-4edc-8e9d-4565a568fe5c None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:46.561999 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:46.583696 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcee38b0-e69e-456e-8971-8e819b8feb70 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:46.616536 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fceb72d-54be-41ca-9fdd-3d6bc41ef08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:46.617132 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fceb72d-54be-41ca-9fdd-3d6bc41ef08e None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:46.617442 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fceb72d-54be-41ca-9fdd-3d6bc41ef08e None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:46.617712 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fceb72d-54be-41ca-9fdd-3d6bc41ef08e None admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:46.618424 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fceb72d-54be-41ca-9fdd-3d6bc41ef08e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:46.618718 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fceb72d-54be-41ca-9fdd-3d6bc41ef08e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:46.620117 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fceb72d-54be-41ca-9fdd-3d6bc41ef08e None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:46.637729 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 531/1075] 10.222.0.49 () {56 vars in 1133 bytes} [Thu Sep 29 01:59:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:59:46.643622 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fceb72d-54be-41ca-9fdd-3d6bc41ef08e None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:46.659848 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e6aedb-2be7-4edc-8e9d-4565a568fe5c None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:46.694636 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b116c63a-c7e0-422c-b6c9-c24222459d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:46.695242 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b116c63a-c7e0-422c-b6c9-c24222459d8b None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:46.695520 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b116c63a-c7e0-422c-b6c9-c24222459d8b None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:46.695793 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b116c63a-c7e0-422c-b6c9-c24222459d8b None admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:46.696449 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b116c63a-c7e0-422c-b6c9-c24222459d8b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:46.696748 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b116c63a-c7e0-422c-b6c9-c24222459d8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:46.698150 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b116c63a-c7e0-422c-b6c9-c24222459d8b None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:46.706855 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 545/1076] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Sep 29 01:59:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:46.712677 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b116c63a-c7e0-422c-b6c9-c24222459d8b None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:46.740316 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fceb72d-54be-41ca-9fdd-3d6bc41ef08e None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:46.768743 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:46.774066 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fe09d2-1921-40a0-9b16-a1b9ef2cc665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:46.774685 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fe09d2-1921-40a0-9b16-a1b9ef2cc665 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:46.774959 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fe09d2-1921-40a0-9b16-a1b9ef2cc665 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:46.775226 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fe09d2-1921-40a0-9b16-a1b9ef2cc665 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:46.777855 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:46.786518 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fe09d2-1921-40a0-9b16-a1b9ef2cc665 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:46.787954 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fe09d2-1921-40a0-9b16-a1b9ef2cc665 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:46.803154 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-14fe09d2-1921-40a0-9b16-a1b9ef2cc665 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:46.803154 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:46.803154 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:46.803154 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:46.803154 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:46.803154 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:46.803154 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:46.803154 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:46.803154 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:46.803154 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:46.803154 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:46.803154 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:46.803154 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:59:46.803154 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:59:46.803154 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:59:46.803154 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:59:46.804126 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:46.804126 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:46.804126 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:46.804126 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:46.804126 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:46.804126 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:46.804126 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:46.804126 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:46.804126 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:46.804126 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:46.804126 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:46.804126 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:46.804126 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:46.804126 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:46.804126 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:46.804126 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:46.804126 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:59:46.805017 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:59:46.805017 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:46.805017 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:59:46.805017 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 532/1077] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 01:59:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 01:59:46.810996 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fe09d2-1921-40a0-9b16-a1b9ef2cc665 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:46.812510 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b116c63a-c7e0-422c-b6c9-c24222459d8b None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:46.847566 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47d74fd-01fd-43a7-94c9-4185cc8f5e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:46.848188 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d74fd-01fd-43a7-94c9-4185cc8f5e8f None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:46.848462 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d74fd-01fd-43a7-94c9-4185cc8f5e8f None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:46.848729 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d74fd-01fd-43a7-94c9-4185cc8f5e8f None admin] PATH_INFO: `/v3/users/a47f8771d0404af9a20931af6bdff7c7` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:46.849864 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47d74fd-01fd-43a7-94c9-4185cc8f5e8f None admin] RBAC: Authorizing `identity:get_user(user_id=a47f8771d0404af9a20931af6bdff7c7)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:46.851281 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47d74fd-01fd-43a7-94c9-4185cc8f5e8f None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:46.852828 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 546/1078] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Sep 29 01:59:46 2022] GET /identity/v3/users/a47f8771d0404af9a20931af6bdff7c7 => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:59:46.859328 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47d74fd-01fd-43a7-94c9-4185cc8f5e8f None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:46.911456 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fe09d2-1921-40a0-9b16-a1b9ef2cc665 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:46.947807 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c19124-9bf9-490a-ac01-3d9cc5924d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:46.948392 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c19124-9bf9-490a-ac01-3d9cc5924d58 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:46.948670 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c19124-9bf9-490a-ac01-3d9cc5924d58 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:46.948930 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c19124-9bf9-490a-ac01-3d9cc5924d58 None admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:46.949574 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c19124-9bf9-490a-ac01-3d9cc5924d58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:46.950016 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c19124-9bf9-490a-ac01-3d9cc5924d58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:46.951485 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c19124-9bf9-490a-ac01-3d9cc5924d58 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:46.960103 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47d74fd-01fd-43a7-94c9-4185cc8f5e8f None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:46.962806 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 533/1079] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Sep 29 01:59:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:46.968982 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c19124-9bf9-490a-ac01-3d9cc5924d58 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:46.984270 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:46.996025 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343a65d0-c484-4475-a893-c233b4b287d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:46.997168 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343a65d0-c484-4475-a893-c233b4b287d1 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:46.997480 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343a65d0-c484-4475-a893-c233b4b287d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:46.997749 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343a65d0-c484-4475-a893-c233b4b287d1 None admin] PATH_INFO: `/v3/projects/b4fd31add918446baf9c7868e4288d60` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:46.998866 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343a65d0-c484-4475-a893-c233b4b287d1 None admin] RBAC: Authorizing `identity:get_project(project_id=b4fd31add918446baf9c7868e4288d60)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:47.000278 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343a65d0-c484-4475-a893-c233b4b287d1 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:47.001917 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 547/1080] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Sep 29 01:59:46 2022] GET /identity/v3/projects/b4fd31add918446baf9c7868e4288d60 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:59:47.007774 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343a65d0-c484-4475-a893-c233b4b287d1 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:47.019151 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:47.069090 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c19124-9bf9-490a-ac01-3d9cc5924d58 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:47.102205 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b784c42-666c-4b8b-a5e3-40020f0f169f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:47.102821 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b784c42-666c-4b8b-a5e3-40020f0f169f None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:47.103094 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b784c42-666c-4b8b-a5e3-40020f0f169f None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:47.103353 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b784c42-666c-4b8b-a5e3-40020f0f169f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:47.107102 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343a65d0-c484-4475-a893-c233b4b287d1 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:47.110535 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b784c42-666c-4b8b-a5e3-40020f0f169f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:47.111953 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b784c42-666c-4b8b-a5e3-40020f0f169f None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:47.123454 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-5b784c42-666c-4b8b-a5e3-40020f0f169f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:59:47.123454 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:47.123454 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:47.123454 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:47.123454 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:47.123454 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:47.123454 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:47.123454 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:47.123454 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:47.123454 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:47.123454 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:47.123454 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:47.123454 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 29 01:59:47.123454 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 29 01:59:47.123454 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 29 01:59:47.124572 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 29 01:59:47.124572 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:47.124572 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:47.124572 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:47.124572 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:47.124572 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:47.124572 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:47.124572 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:47.124572 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:47.124572 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:47.124572 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:47.124572 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:47.124572 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:47.124572 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:47.124572 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:47.124572 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:47.124572 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:47.125701 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 29 01:59:47.125701 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 29 01:59:47.125701 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 29 01:59:47.125701 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 29 01:59:47.125701 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 29 01:59:47.125701 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 29 01:59:47.125701 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:59:47.125701 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:59:47.125701 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 534/1081] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Sep 29 01:59:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 01:59:47.130207 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b784c42-666c-4b8b-a5e3-40020f0f169f None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:47.144018 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95549eb9-63da-4d0b-9a78-c9f51d042ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:47.144668 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95549eb9-63da-4d0b-9a78-c9f51d042ee6 None admin] REQUEST_METHOD: `PUT` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:47.144953 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95549eb9-63da-4d0b-9a78-c9f51d042ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:47.145222 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95549eb9-63da-4d0b-9a78-c9f51d042ee6 None admin] PATH_INFO: `/v3/projects/b4fd31add918446baf9c7868e4288d60/users/a47f8771d0404af9a20931af6bdff7c7/roles/fe9bbc67742f4f5893f39b18eb31d59a` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:47.147149 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95549eb9-63da-4d0b-9a78-c9f51d042ee6 None admin] RBAC: Authorizing `identity:create_grant(project_id=b4fd31add918446baf9c7868e4288d60, user_id=a47f8771d0404af9a20931af6bdff7c7, role_id=fe9bbc67742f4f5893f39b18eb31d59a)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:47.148559 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95549eb9-63da-4d0b-9a78-c9f51d042ee6 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:47.161774 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 548/1082] 10.222.0.49 () {58 vars in 1439 bytes} [Thu Sep 29 01:59:47 2022] PUT /identity/v3/projects/b4fd31add918446baf9c7868e4288d60/users/a47f8771d0404af9a20931af6bdff7c7/roles/fe9bbc67742f4f5893f39b18eb31d59a => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 01:59:47.235524 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b784c42-666c-4b8b-a5e3-40020f0f169f None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:47.245425 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:47.271860 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3afe2bd-9e88-4a26-952f-9b6b8900572b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:47.272481 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3afe2bd-9e88-4a26-952f-9b6b8900572b None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:47.272763 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3afe2bd-9e88-4a26-952f-9b6b8900572b None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:47.273037 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3afe2bd-9e88-4a26-952f-9b6b8900572b None admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:47.273781 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3afe2bd-9e88-4a26-952f-9b6b8900572b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:47.274086 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3afe2bd-9e88-4a26-952f-9b6b8900572b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:47.275527 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3afe2bd-9e88-4a26-952f-9b6b8900572b None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:47.294501 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 535/1083] 10.222.0.49 () {56 vars in 1148 bytes} [Thu Sep 29 01:59:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:59:47.295863 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95549eb9-63da-4d0b-9a78-c9f51d042ee6 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:47.353549 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:47.402805 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95549eb9-63da-4d0b-9a78-c9f51d042ee6 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:47.438047 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fad898-e260-4a51-bd55-eb9ba1d39072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:47.438707 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fad898-e260-4a51-bd55-eb9ba1d39072 None admin] REQUEST_METHOD: `PUT` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:47.438989 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fad898-e260-4a51-bd55-eb9ba1d39072 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:47.439262 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fad898-e260-4a51-bd55-eb9ba1d39072 None admin] PATH_INFO: `/v3/projects/6f1d8fd250c84c5887cb3173053ea2dd/users/f3325a7111d447f4a9cf00c672d5420f/roles/3bbece89f99a4c658f63f212839b21ff` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:47.441396 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fad898-e260-4a51-bd55-eb9ba1d39072 None admin] RBAC: Authorizing `identity:create_grant(project_id=6f1d8fd250c84c5887cb3173053ea2dd, user_id=f3325a7111d447f4a9cf00c672d5420f, role_id=3bbece89f99a4c658f63f212839b21ff)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:47.442832 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fad898-e260-4a51-bd55-eb9ba1d39072 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:47.455599 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 549/1084] 10.222.0.49 () {58 vars in 1439 bytes} [Thu Sep 29 01:59:47 2022] PUT /identity/v3/projects/6f1d8fd250c84c5887cb3173053ea2dd/users/f3325a7111d447f4a9cf00c672d5420f/roles/3bbece89f99a4c658f63f212839b21ff => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 01:59:49.284183 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5166c791-dc1e-4cbe-aea9-57c9ea0594fb None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:49.286652 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5166c791-dc1e-4cbe-aea9-57c9ea0594fb None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:49.286652 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5166c791-dc1e-4cbe-aea9-57c9ea0594fb None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:49.286652 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 536/1085] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:59:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:59:49.291634 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9271e446-1927-4aed-9414-500158c7ff0a None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:49.292074 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9271e446-1927-4aed-9414-500158c7ff0a None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:49.292175 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9271e446-1927-4aed-9414-500158c7ff0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:49.310616 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-9271e446-1927-4aed-9414-500158c7ff0a None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:59:49.311830 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-9271e446-1927-4aed-9414-500158c7ff0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:59:49.377183 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 550/1086] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:59:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 29 01:59:49.604105 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d26f44-4c76-4997-87bf-200ce4660af6 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:49.604649 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d26f44-4c76-4997-87bf-200ce4660af6 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:49.605053 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d26f44-4c76-4997-87bf-200ce4660af6 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:49.607243 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 537/1087] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:59:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:59:49.613634 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d8cd2-1df4-439c-bc87-ec23595eaa09 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:49.613926 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d8cd2-1df4-439c-bc87-ec23595eaa09 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:49.614203 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d8cd2-1df4-439c-bc87-ec23595eaa09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:49.632020 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-bc4d8cd2-1df4-439c-bc87-ec23595eaa09 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:59:49.633199 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-bc4d8cd2-1df4-439c-bc87-ec23595eaa09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:59:49.646966 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d26f44-4c76-4997-87bf-200ce4660af6 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:49.671427 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:49.704779 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 551/1088] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:59:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 29 01:59:49.750569 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d26f44-4c76-4997-87bf-200ce4660af6 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:49.785869 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06972f79-ef21-4c09-9121-23864bd00480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:49.786492 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06972f79-ef21-4c09-9121-23864bd00480 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:49.786768 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06972f79-ef21-4c09-9121-23864bd00480 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:49.787044 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06972f79-ef21-4c09-9121-23864bd00480 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:49.797705 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06972f79-ef21-4c09-9121-23864bd00480 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:59:49.802522 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-06972f79-ef21-4c09-9121-23864bd00480 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 01:59:49.802522 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:49.802522 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:49.802522 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:49.802522 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:49.802522 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:49.802522 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:49.802522 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:49.802522 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:49.802522 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:49.802522 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:49.802522 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:49.802522 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:59:49.802522 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:59:49.802522 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:59:49.802522 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:59:49.803678 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:59:49.803678 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:59:49.803678 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:59:49.803678 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:59:49.803678 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:49.803678 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:49.803678 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:49.803678 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:49.803678 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:49.803678 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:49.803678 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:49.803678 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:49.803678 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:49.803678 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:49.803678 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:49.803678 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:49.804735 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:49.804735 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:49.804735 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:49.804735 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:49.804735 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:59:49.804735 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:59:49.804735 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:59:49.804735 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:59:49.804735 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:59:49.804735 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:59:49.804735 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 01:59:49.804735 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:59:49.804735 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 538/1089] 10.222.0.49 () {56 vars in 1096 bytes} [Thu Sep 29 01:59:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 01:59:49.809700 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4d8cd2-1df4-439c-bc87-ec23595eaa09 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:49.907203 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4d8cd2-1df4-439c-bc87-ec23595eaa09 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:49.940862 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ada7ed5-6a97-4e45-a2c3-df5f714d092d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:49.941499 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ada7ed5-6a97-4e45-a2c3-df5f714d092d None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:49.941777 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ada7ed5-6a97-4e45-a2c3-df5f714d092d None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:49.942048 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ada7ed5-6a97-4e45-a2c3-df5f714d092d None admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:49.942705 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ada7ed5-6a97-4e45-a2c3-df5f714d092d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:49.943006 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ada7ed5-6a97-4e45-a2c3-df5f714d092d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:49.944368 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ada7ed5-6a97-4e45-a2c3-df5f714d092d None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:49.952912 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 552/1090] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Sep 29 01:59:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:49.959335 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06972f79-ef21-4c09-9121-23864bd00480 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:49.971928 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ada7ed5-6a97-4e45-a2c3-df5f714d092d None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:49.987002 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:50.006457 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:50.059809 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06972f79-ef21-4c09-9121-23864bd00480 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:50.071740 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ada7ed5-6a97-4e45-a2c3-df5f714d092d None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:50.094484 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e977e256-e400-4bcc-9b21-04e4226a0f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:50.095107 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e977e256-e400-4bcc-9b21-04e4226a0f3d None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:50.095388 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e977e256-e400-4bcc-9b21-04e4226a0f3d None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:50.095661 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e977e256-e400-4bcc-9b21-04e4226a0f3d None admin] PATH_INFO: `/v3/users/a47f8771d0404af9a20931af6bdff7c7` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:50.096775 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e977e256-e400-4bcc-9b21-04e4226a0f3d None admin] RBAC: Authorizing `identity:get_user(user_id=a47f8771d0404af9a20931af6bdff7c7)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:50.098230 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e977e256-e400-4bcc-9b21-04e4226a0f3d None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:50.099795 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 539/1091] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Sep 29 01:59:49 2022] GET /identity/v3/users/a47f8771d0404af9a20931af6bdff7c7 => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:50.104524 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0144d57-80e6-47d3-afc0-69da460442b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:50.105152 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0144d57-80e6-47d3-afc0-69da460442b3 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:50.105414 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e977e256-e400-4bcc-9b21-04e4226a0f3d None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:50.105536 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0144d57-80e6-47d3-afc0-69da460442b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:50.106310 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0144d57-80e6-47d3-afc0-69da460442b3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:50.117141 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0144d57-80e6-47d3-afc0-69da460442b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 01:59:50.122157 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-b0144d57-80e6-47d3-afc0-69da460442b3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 29 01:59:50.122157 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:50.122157 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:50.122157 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:50.122157 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:50.122157 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:50.122157 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:50.122157 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:50.122157 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:50.122157 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:50.122157 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:50.122157 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:50.122157 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 01:59:50.122157 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 01:59:50.122157 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 01:59:50.122157 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 01:59:50.123234 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 01:59:50.123234 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 01:59:50.123234 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 01:59:50.123234 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 01:59:50.123234 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:50.123234 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:50.123234 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:50.123234 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:50.123234 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:50.123234 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:50.123234 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:50.123234 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:50.123234 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:50.123234 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:50.123234 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:50.123234 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:50.124078 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:50.124078 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:50.124078 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:50.124078 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:50.124078 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 01:59:50.124078 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 01:59:50.124078 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 01:59:50.124078 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 01:59:50.124078 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 01:59:50.124078 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 01:59:50.124078 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 29 01:59:50.124078 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:59:50.124078 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 553/1092] 10.222.0.49 () {56 vars in 1120 bytes} [Thu Sep 29 01:59:49 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 01:59:50.129100 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0144d57-80e6-47d3-afc0-69da460442b3 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:50.197852 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:50.205052 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e977e256-e400-4bcc-9b21-04e4226a0f3d None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:50.222320 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:50.229527 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0144d57-80e6-47d3-afc0-69da460442b3 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:50.240615 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3073c92-7401-4774-86f9-6af90207000c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:50.241219 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3073c92-7401-4774-86f9-6af90207000c None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:50.241527 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3073c92-7401-4774-86f9-6af90207000c None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:50.241801 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3073c92-7401-4774-86f9-6af90207000c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:50.263164 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62fee96-1354-4cfc-b044-8adf6b8836d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:50.263768 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62fee96-1354-4cfc-b044-8adf6b8836d6 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:50.264047 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62fee96-1354-4cfc-b044-8adf6b8836d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:50.264319 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62fee96-1354-4cfc-b044-8adf6b8836d6 None admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:50.264974 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62fee96-1354-4cfc-b044-8adf6b8836d6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:50.265272 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62fee96-1354-4cfc-b044-8adf6b8836d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:50.266657 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62fee96-1354-4cfc-b044-8adf6b8836d6 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:50.275112 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 554/1093] 10.222.0.49 () {56 vars in 1115 bytes} [Thu Sep 29 01:59:50 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:59:50.281336 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62fee96-1354-4cfc-b044-8adf6b8836d6 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:50.309388 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3073c92-7401-4774-86f9-6af90207000c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:50.310937 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3073c92-7401-4774-86f9-6af90207000c None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:50.377755 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62fee96-1354-4cfc-b044-8adf6b8836d6 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:50.401093 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:50.408460 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 540/1094] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Sep 29 01:59:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 29 01:59:50.414528 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3073c92-7401-4774-86f9-6af90207000c None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:50.415953 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9630444-86c6-4905-add2-440c3fc67122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:50.416576 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9630444-86c6-4905-add2-440c3fc67122 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:50.416849 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9630444-86c6-4905-add2-440c3fc67122 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:50.417113 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9630444-86c6-4905-add2-440c3fc67122 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:50.427180 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9630444-86c6-4905-add2-440c3fc67122 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:50.428598 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9630444-86c6-4905-add2-440c3fc67122 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:50.443004 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-b9630444-86c6-4905-add2-440c3fc67122 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:50.443004 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:50.443004 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:50.443004 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:50.443004 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:50.443004 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:50.443004 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:50.443004 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:50.443004 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:50.443004 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:50.443004 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:50.443004 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:50.443004 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:59:50.443004 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:59:50.443004 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:59:50.443004 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:59:50.444079 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:50.444079 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:50.444079 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:50.444079 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:50.444079 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:50.444079 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:50.444079 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:50.444079 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:50.444079 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:50.444079 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:50.444079 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:50.444079 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:50.444079 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:50.444079 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:50.444079 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:50.444079 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:50.444079 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:59:50.444979 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:59:50.444979 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:50.444979 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:59:50.448789 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 555/1095] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 01:59:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 01:59:50.450127 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9630444-86c6-4905-add2-440c3fc67122 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:50.461010 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:50.513818 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3073c92-7401-4774-86f9-6af90207000c None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:50.548098 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98cd428-14b0-4af1-b6c4-801ddb2843c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:50.548720 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98cd428-14b0-4af1-b6c4-801ddb2843c1 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:50.548995 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98cd428-14b0-4af1-b6c4-801ddb2843c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:50.549264 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98cd428-14b0-4af1-b6c4-801ddb2843c1 None admin] PATH_INFO: `/v3/projects/b4fd31add918446baf9c7868e4288d60` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:50.549412 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9630444-86c6-4905-add2-440c3fc67122 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:50.550772 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98cd428-14b0-4af1-b6c4-801ddb2843c1 None admin] RBAC: Authorizing `identity:get_project(project_id=b4fd31add918446baf9c7868e4288d60)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:50.552197 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98cd428-14b0-4af1-b6c4-801ddb2843c1 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:50.553846 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 541/1096] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Sep 29 01:59:50 2022] GET /identity/v3/projects/b4fd31add918446baf9c7868e4288d60 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:59:50.560686 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98cd428-14b0-4af1-b6c4-801ddb2843c1 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:50.593140 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc152fc-4a73-4c26-ae36-3d6364d2d0d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:50.593779 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc152fc-4a73-4c26-ae36-3d6364d2d0d0 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:50.594060 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc152fc-4a73-4c26-ae36-3d6364d2d0d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:50.594329 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc152fc-4a73-4c26-ae36-3d6364d2d0d0 None admin] PATH_INFO: `/v3/domains` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:50.594998 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc152fc-4a73-4c26-ae36-3d6364d2d0d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:50.595297 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc152fc-4a73-4c26-ae36-3d6364d2d0d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:50.596656 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc152fc-4a73-4c26-ae36-3d6364d2d0d0 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:50.609254 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 556/1097] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Sep 29 01:59:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 01:59:50.614738 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc152fc-4a73-4c26-ae36-3d6364d2d0d0 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:50.622280 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:50.661328 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98cd428-14b0-4af1-b6c4-801ddb2843c1 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:50.682717 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:50.695508 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ed0237-1615-4933-88bc-ad425ba34cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:50.696112 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ed0237-1615-4933-88bc-ad425ba34cce None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:50.696391 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ed0237-1615-4933-88bc-ad425ba34cce None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:50.696665 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ed0237-1615-4933-88bc-ad425ba34cce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:50.697420 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ed0237-1615-4933-88bc-ad425ba34cce None admin] RBAC: Adding query filter params (role.id=fe9bbc67742f4f5893f39b18eb31d59a, scope.project.id=b4fd31add918446baf9c7868e4288d60, user.id=a47f8771d0404af9a20931af6bdff7c7) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:50.697728 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ed0237-1615-4933-88bc-ad425ba34cce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:50.699197 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ed0237-1615-4933-88bc-ad425ba34cce None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:50.705750 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 542/1098] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Sep 29 01:59:50 2022] GET /identity/v3/role_assignments?user.id=a47f8771d0404af9a20931af6bdff7c7&scope.project.id=b4fd31add918446baf9c7868e4288d60&role.id=fe9bbc67742f4f5893f39b18eb31d59a => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:50.716953 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc152fc-4a73-4c26-ae36-3d6364d2d0d0 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:50.753842 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202119d7-175b-4203-9c0c-ab7848b6dded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:50.754481 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202119d7-175b-4203-9c0c-ab7848b6dded None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:50.754756 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202119d7-175b-4203-9c0c-ab7848b6dded None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:50.755027 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202119d7-175b-4203-9c0c-ab7848b6dded None admin] PATH_INFO: `/v3/users/nova` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:50.763775 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202119d7-175b-4203-9c0c-ab7848b6dded None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:50.765235 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202119d7-175b-4203-9c0c-ab7848b6dded None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:50.778067 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-202119d7-175b-4203-9c0c-ab7848b6dded None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 29 01:59:50.778067 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:50.778067 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:50.778067 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:50.778067 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:50.778067 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:50.778067 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:50.778067 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:50.778067 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:50.778067 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:50.778067 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:50.778067 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:50.778067 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 29 01:59:50.778067 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 29 01:59:50.778067 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 29 01:59:50.778067 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 29 01:59:50.779218 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:50.779218 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:50.779218 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 29 01:59:50.779218 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:59:50.779218 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 29 01:59:50.779218 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 01:59:50.779218 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:50.779218 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:50.779218 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:50.779218 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:50.779218 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:50.779218 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:50.779218 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:50.779218 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:50.779218 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:50.779218 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:50.779218 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:50.779218 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:50.780159 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:50.780159 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:50.780159 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 29 01:59:50.780159 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 29 01:59:50.780159 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 29 01:59:50.780159 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 29 01:59:50.780159 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 29 01:59:50.780159 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 29 01:59:50.780159 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 29 01:59:50.780159 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 01:59:50.780159 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 557/1099] 10.222.0.49 () {56 vars in 1093 bytes} [Thu Sep 29 01:59:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 01:59:50.785439 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ed0237-1615-4933-88bc-ad425ba34cce None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:50.890093 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ed0237-1615-4933-88bc-ad425ba34cce None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:50.926577 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:50.936550 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cd89bd-98b1-4548-933b-cc10dd8bbb1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:50.937174 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd89bd-98b1-4548-933b-cc10dd8bbb1d None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:50.937482 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd89bd-98b1-4548-933b-cc10dd8bbb1d None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:50.937749 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd89bd-98b1-4548-933b-cc10dd8bbb1d None admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:50.938487 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cd89bd-98b1-4548-933b-cc10dd8bbb1d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:50.938786 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cd89bd-98b1-4548-933b-cc10dd8bbb1d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:50.940205 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cd89bd-98b1-4548-933b-cc10dd8bbb1d None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:50.959002 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 543/1100] 10.222.0.49 () {56 vars in 1133 bytes} [Thu Sep 29 01:59:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:50.964786 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202119d7-175b-4203-9c0c-ab7848b6dded None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:51.063928 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202119d7-175b-4203-9c0c-ab7848b6dded None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:51.089495 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:51.098474 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cd6206-c3b3-4f59-8f3a-c083c5c03bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:51.099077 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd6206-c3b3-4f59-8f3a-c083c5c03bc8 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:51.099355 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd6206-c3b3-4f59-8f3a-c083c5c03bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:51.099620 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd6206-c3b3-4f59-8f3a-c083c5c03bc8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:51.165795 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cd6206-c3b3-4f59-8f3a-c083c5c03bc8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:51.167237 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cd6206-c3b3-4f59-8f3a-c083c5c03bc8 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:51.263390 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 558/1101] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Sep 29 01:59:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 29 01:59:51.269199 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cd89bd-98b1-4548-933b-cc10dd8bbb1d None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:51.366064 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cd89bd-98b1-4548-933b-cc10dd8bbb1d None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:51.399208 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12ebebf-47c7-480c-8ba9-a9443478f07c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:51.399819 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12ebebf-47c7-480c-8ba9-a9443478f07c None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:51.400092 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12ebebf-47c7-480c-8ba9-a9443478f07c None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:51.400355 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12ebebf-47c7-480c-8ba9-a9443478f07c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:51.410097 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12ebebf-47c7-480c-8ba9-a9443478f07c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:51.411511 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12ebebf-47c7-480c-8ba9-a9443478f07c None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:51.426026 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-b12ebebf-47c7-480c-8ba9-a9443478f07c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:51.426026 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:51.426026 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:51.426026 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:51.426026 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:51.426026 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:51.426026 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:51.426026 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:51.426026 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:51.426026 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:51.426026 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:51.426026 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:51.426026 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 01:59:51.426026 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 01:59:51.426026 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 01:59:51.426026 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 01:59:51.427179 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:51.427179 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:51.427179 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:51.427179 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:51.427179 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:51.427179 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:51.427179 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:51.427179 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:51.427179 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:51.427179 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:51.427179 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:51.427179 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:51.427179 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:51.427179 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:51.427179 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:51.427179 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:51.427179 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 01:59:51.428212 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 01:59:51.428212 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 01:59:51.428212 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:59:51.428212 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 544/1102] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 01:59:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:51.432790 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cd6206-c3b3-4f59-8f3a-c083c5c03bc8 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:51.460732 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:51.531105 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cd6206-c3b3-4f59-8f3a-c083c5c03bc8 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:51.564017 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d2c1ba-15b7-4def-bf83-b064a1df0f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:51.564614 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d2c1ba-15b7-4def-bf83-b064a1df0f8b None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:51.564888 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d2c1ba-15b7-4def-bf83-b064a1df0f8b None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:51.565154 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d2c1ba-15b7-4def-bf83-b064a1df0f8b None admin] PATH_INFO: `/v3/domains` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:51.565883 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d2c1ba-15b7-4def-bf83-b064a1df0f8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:51.566180 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d2c1ba-15b7-4def-bf83-b064a1df0f8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:51.567530 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d2c1ba-15b7-4def-bf83-b064a1df0f8b None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:51.581525 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 559/1103] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Sep 29 01:59:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:51.587068 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12ebebf-47c7-480c-8ba9-a9443478f07c None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:51.629669 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:51.691850 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12ebebf-47c7-480c-8ba9-a9443478f07c None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:51.724813 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c76b96-4a50-412f-8628-6f2a015e5b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:51.725529 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c76b96-4a50-412f-8628-6f2a015e5b0a None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:51.725804 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c76b96-4a50-412f-8628-6f2a015e5b0a None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:51.726071 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c76b96-4a50-412f-8628-6f2a015e5b0a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:51.733164 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c76b96-4a50-412f-8628-6f2a015e5b0a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:51.734603 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c76b96-4a50-412f-8628-6f2a015e5b0a None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:51.745538 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-76c76b96-4a50-412f-8628-6f2a015e5b0a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:59:51.745538 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 01:59:51.745538 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 01:59:51.745538 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 01:59:51.745538 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 01:59:51.745538 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 01:59:51.745538 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 01:59:51.745538 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 01:59:51.745538 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 01:59:51.745538 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 01:59:51.745538 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 01:59:51.745538 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 01:59:51.745538 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 29 01:59:51.745538 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 29 01:59:51.745538 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 29 01:59:51.747544 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 29 01:59:51.747544 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 01:59:51.747544 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 01:59:51.747544 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 01:59:51.747544 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 01:59:51.747544 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 01:59:51.747544 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 01:59:51.747544 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 01:59:51.747544 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 01:59:51.747544 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 01:59:51.747544 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 01:59:51.747544 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 01:59:51.747544 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 01:59:51.747544 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 01:59:51.747544 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 01:59:51.747544 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 01:59:51.747544 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 01:59:51.749376 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 29 01:59:51.749376 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 29 01:59:51.749376 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 29 01:59:51.749376 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 29 01:59:51.749376 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 29 01:59:51.749376 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 29 01:59:51.749376 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 01:59:51.749376 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 01:59:51.751919 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 545/1104] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Sep 29 01:59:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 01:59:51.753180 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d2c1ba-15b7-4def-bf83-b064a1df0f8b None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:51.840208 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:51.852347 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d2c1ba-15b7-4def-bf83-b064a1df0f8b None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:51.885466 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485d1c6e-cf02-46a2-a799-fa47a33dd522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:51.886067 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d1c6e-cf02-46a2-a799-fa47a33dd522 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:51.886345 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d1c6e-cf02-46a2-a799-fa47a33dd522 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:51.886616 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d1c6e-cf02-46a2-a799-fa47a33dd522 None admin] PATH_INFO: `/v3/projects` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:51.887483 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485d1c6e-cf02-46a2-a799-fa47a33dd522 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:51.887714 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485d1c6e-cf02-46a2-a799-fa47a33dd522 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:51.889129 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485d1c6e-cf02-46a2-a799-fa47a33dd522 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:51.901068 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 560/1105] 10.222.0.49 () {56 vars in 1148 bytes} [Thu Sep 29 01:59:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:51.907100 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c76b96-4a50-412f-8628-6f2a015e5b0a None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:52.016339 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:52.020355 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c76b96-4a50-412f-8628-6f2a015e5b0a None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:52.053188 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81dea81-d4a5-44b5-a1c6-43976304ad92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:52.053804 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81dea81-d4a5-44b5-a1c6-43976304ad92 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:52.054077 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81dea81-d4a5-44b5-a1c6-43976304ad92 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:52.054343 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81dea81-d4a5-44b5-a1c6-43976304ad92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:52.055050 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81dea81-d4a5-44b5-a1c6-43976304ad92 None admin] RBAC: Adding query filter params (role.id=3bbece89f99a4c658f63f212839b21ff, scope.project.id=6f1d8fd250c84c5887cb3173053ea2dd, user.id=f3325a7111d447f4a9cf00c672d5420f) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:52.055352 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81dea81-d4a5-44b5-a1c6-43976304ad92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:52.056760 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81dea81-d4a5-44b5-a1c6-43976304ad92 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:52.063063 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 546/1106] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Sep 29 01:59:51 2022] GET /identity/v3/role_assignments?user.id=f3325a7111d447f4a9cf00c672d5420f&scope.project.id=6f1d8fd250c84c5887cb3173053ea2dd&role.id=3bbece89f99a4c658f63f212839b21ff => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:52.895468 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1489c18e-4abd-455e-adfe-031e668c6f0e None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:52.895974 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1489c18e-4abd-455e-adfe-031e668c6f0e None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:52.896059 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1489c18e-4abd-455e-adfe-031e668c6f0e None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:52.897545 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 561/1107] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:59:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:59:52.902972 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d15203e-bdc2-48cd-9b7d-d980d83c2d80 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:52.903435 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d15203e-bdc2-48cd-9b7d-d980d83c2d80 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:52.903548 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d15203e-bdc2-48cd-9b7d-d980d83c2d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:52.922261 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-2d15203e-bdc2-48cd-9b7d-d980d83c2d80 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:59:52.923441 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-2d15203e-bdc2-48cd-9b7d-d980d83c2d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:59:52.989172 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 547/1108] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:59:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 29 01:59:53.259159 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1489c18e-4abd-455e-adfe-031e668c6f0e None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:53.358993 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1489c18e-4abd-455e-adfe-031e668c6f0e None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:53.391577 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a3eb85-c5b9-4544-bb3a-9470198e3871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:53.392189 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3eb85-c5b9-4544-bb3a-9470198e3871 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:53.392464 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3eb85-c5b9-4544-bb3a-9470198e3871 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:53.392731 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3eb85-c5b9-4544-bb3a-9470198e3871 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:53.393835 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a3eb85-c5b9-4544-bb3a-9470198e3871 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:53.395246 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a3eb85-c5b9-4544-bb3a-9470198e3871 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:53.396773 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 562/1109] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 01:59:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:53.403077 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d15203e-bdc2-48cd-9b7d-d980d83c2d80 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:53.490258 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:53.498851 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d15203e-bdc2-48cd-9b7d-d980d83c2d80 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:53.532824 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a200b2-ed2e-461e-9a98-2e57e6cca006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:53.533378 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a200b2-ed2e-461e-9a98-2e57e6cca006 None admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:53.533658 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a200b2-ed2e-461e-9a98-2e57e6cca006 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:53.533927 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a200b2-ed2e-461e-9a98-2e57e6cca006 None admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:53.534582 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a200b2-ed2e-461e-9a98-2e57e6cca006 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:53.535986 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a200b2-ed2e-461e-9a98-2e57e6cca006 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:53.555763 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 548/1110] 10.222.0.49 () {60 vars in 1132 bytes} [Thu Sep 29 01:59:53 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 01:59:55.737641 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e963577b-4dee-4dfa-ac17-80a123061f24 None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:55.738173 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e963577b-4dee-4dfa-ac17-80a123061f24 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:55.738291 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e963577b-4dee-4dfa-ac17-80a123061f24 None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:55.739531 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 563/1111] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:59:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:59:55.744702 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332019f2-e885-49a0-8dff-9c3900fb6f33 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:55.745139 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332019f2-e885-49a0-8dff-9c3900fb6f33 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:55.745236 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332019f2-e885-49a0-8dff-9c3900fb6f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:55.763646 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-332019f2-e885-49a0-8dff-9c3900fb6f33 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:59:55.764852 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-332019f2-e885-49a0-8dff-9c3900fb6f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:59:55.828835 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 549/1112] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:59:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 29 01:59:56.096937 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e963577b-4dee-4dfa-ac17-80a123061f24 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:56.114546 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:56.196237 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e963577b-4dee-4dfa-ac17-80a123061f24 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:56.228377 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad79866-5744-4fb9-9378-df7930f7771e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:56.228984 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad79866-5744-4fb9-9378-df7930f7771e None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:56.229255 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad79866-5744-4fb9-9378-df7930f7771e None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:56.229547 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad79866-5744-4fb9-9378-df7930f7771e None admin] PATH_INFO: `/v3/roles/8de931d79c9d4c8daf717aaea348dda9` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:56.231448 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad79866-5744-4fb9-9378-df7930f7771e None admin] RBAC: Authorizing `identity:get_role(role_id=8de931d79c9d4c8daf717aaea348dda9)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:56.232777 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad79866-5744-4fb9-9378-df7930f7771e None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:56.234098 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 564/1113] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Sep 29 01:59:56 2022] GET /identity/v3/roles/8de931d79c9d4c8daf717aaea348dda9 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:56.239785 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332019f2-e885-49a0-8dff-9c3900fb6f33 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:56.314573 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:56.336769 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332019f2-e885-49a0-8dff-9c3900fb6f33 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:56.369134 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ba6675-98fb-41d3-be0f-48ba4f0b09c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:56.369715 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba6675-98fb-41d3-be0f-48ba4f0b09c4 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:56.369989 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba6675-98fb-41d3-be0f-48ba4f0b09c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:56.370255 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba6675-98fb-41d3-be0f-48ba4f0b09c4 None admin] PATH_INFO: `/v3/users/6dc82bab5e704a5aa4a586de17c95907` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:56.382532 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ba6675-98fb-41d3-be0f-48ba4f0b09c4 None admin] RBAC: Authorizing `identity:get_user(user_id=6dc82bab5e704a5aa4a586de17c95907)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:56.383945 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ba6675-98fb-41d3-be0f-48ba4f0b09c4 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:56.385516 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 550/1114] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Sep 29 01:59:56 2022] GET /identity/v3/users/6dc82bab5e704a5aa4a586de17c95907 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:56.391787 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad79866-5744-4fb9-9378-df7930f7771e None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:56.473319 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:56.488953 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad79866-5744-4fb9-9378-df7930f7771e None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:56.521785 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f051f3-536a-4cba-be2c-6a4b5b26b60f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:56.522378 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f051f3-536a-4cba-be2c-6a4b5b26b60f None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:56.522656 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f051f3-536a-4cba-be2c-6a4b5b26b60f None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:56.522923 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f051f3-536a-4cba-be2c-6a4b5b26b60f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:56.587945 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f051f3-536a-4cba-be2c-6a4b5b26b60f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:56.589406 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f051f3-536a-4cba-be2c-6a4b5b26b60f None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:56.671038 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:56.687587 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 565/1115] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Sep 29 01:59:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 29 01:59:56.693568 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ba6675-98fb-41d3-be0f-48ba4f0b09c4 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:56.791444 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ba6675-98fb-41d3-be0f-48ba4f0b09c4 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:56.824697 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfd9d6e-2087-42bb-a15f-e6eeeae5d558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:56.825332 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd9d6e-2087-42bb-a15f-e6eeeae5d558 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:56.825616 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd9d6e-2087-42bb-a15f-e6eeeae5d558 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:56.825889 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd9d6e-2087-42bb-a15f-e6eeeae5d558 None admin] PATH_INFO: `/v3/projects/b4fd31add918446baf9c7868e4288d60` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:56.827004 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfd9d6e-2087-42bb-a15f-e6eeeae5d558 None admin] RBAC: Authorizing `identity:get_project(project_id=b4fd31add918446baf9c7868e4288d60)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:56.828425 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfd9d6e-2087-42bb-a15f-e6eeeae5d558 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:56.830055 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 551/1116] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Sep 29 01:59:56 2022] GET /identity/v3/projects/b4fd31add918446baf9c7868e4288d60 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:56.836104 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f051f3-536a-4cba-be2c-6a4b5b26b60f None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:56.935259 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f051f3-536a-4cba-be2c-6a4b5b26b60f None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:56.967804 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6e7072-9487-4d28-8fc4-f186bd40b8a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:56.968390 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e7072-9487-4d28-8fc4-f186bd40b8a3 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:56.968665 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e7072-9487-4d28-8fc4-f186bd40b8a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:56.968933 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e7072-9487-4d28-8fc4-f186bd40b8a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:56.969664 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6e7072-9487-4d28-8fc4-f186bd40b8a3 None admin] RBAC: Adding query filter params (role.id=8de931d79c9d4c8daf717aaea348dda9, scope.project.id=b4fd31add918446baf9c7868e4288d60, user.id=6dc82bab5e704a5aa4a586de17c95907) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 01:59:56.969965 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6e7072-9487-4d28-8fc4-f186bd40b8a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:56.971361 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6e7072-9487-4d28-8fc4-f186bd40b8a3 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:56.976514 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 566/1117] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Sep 29 01:59:56 2022] GET /identity/v3/role_assignments?user.id=6dc82bab5e704a5aa4a586de17c95907&scope.project.id=b4fd31add918446baf9c7868e4288d60&role.id=8de931d79c9d4c8daf717aaea348dda9 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:59.100295 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ae07c8-ed33-4c44-8c8d-af4dce139b78 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:59.100811 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ae07c8-ed33-4c44-8c8d-af4dce139b78 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:59.100811 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ae07c8-ed33-4c44-8c8d-af4dce139b78 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:59.102186 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 552/1118] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 01:59:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 01:59:59.107318 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d7110-5b7c-4bc2-ad04-89086634c6a7 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:59.107733 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d7110-5b7c-4bc2-ad04-89086634c6a7 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:59.107859 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d7110-5b7c-4bc2-ad04-89086634c6a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:59.126384 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-eb3d7110-5b7c-4bc2-ad04-89086634c6a7 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 01:59:59.127564 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-eb3d7110-5b7c-4bc2-ad04-89086634c6a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 01:59:59.169868 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:59.192816 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 567/1119] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 01:59:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 29 01:59:59.460390 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ae07c8-ed33-4c44-8c8d-af4dce139b78 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:59.464143 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:59.557526 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ae07c8-ed33-4c44-8c8d-af4dce139b78 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:59.590785 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9898603b-67db-465b-8252-f739ab4dd574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:59.591395 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9898603b-67db-465b-8252-f739ab4dd574 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:59.591669 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9898603b-67db-465b-8252-f739ab4dd574 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:59.591935 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9898603b-67db-465b-8252-f739ab4dd574 None admin] PATH_INFO: `/v3/roles/8de931d79c9d4c8daf717aaea348dda9` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:59.593301 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9898603b-67db-465b-8252-f739ab4dd574 None admin] RBAC: Authorizing `identity:get_role(role_id=8de931d79c9d4c8daf717aaea348dda9)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:59.594678 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9898603b-67db-465b-8252-f739ab4dd574 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:59.595954 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 553/1120] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Sep 29 01:59:59 2022] GET /identity/v3/roles/8de931d79c9d4c8daf717aaea348dda9 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:59.601704 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3d7110-5b7c-4bc2-ad04-89086634c6a7 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:59.700510 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3d7110-5b7c-4bc2-ad04-89086634c6a7 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:59.733443 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c943496f-c1bb-4dc3-aa70-70b05332878c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:59.734002 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c943496f-c1bb-4dc3-aa70-70b05332878c None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:59.734280 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c943496f-c1bb-4dc3-aa70-70b05332878c None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:59.734550 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c943496f-c1bb-4dc3-aa70-70b05332878c None admin] PATH_INFO: `/v3/users/6dc82bab5e704a5aa4a586de17c95907` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:59.735650 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c943496f-c1bb-4dc3-aa70-70b05332878c None admin] RBAC: Authorizing `identity:get_user(user_id=6dc82bab5e704a5aa4a586de17c95907)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:59.737080 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c943496f-c1bb-4dc3-aa70-70b05332878c None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:59.738655 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 568/1121] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Sep 29 01:59:59 2022] GET /identity/v3/users/6dc82bab5e704a5aa4a586de17c95907 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:59.744413 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9898603b-67db-465b-8252-f739ab4dd574 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:59.811816 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:59.839883 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9898603b-67db-465b-8252-f739ab4dd574 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 01:59:59.871870 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa53dcbb-01e8-476f-a17e-b89665de27b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 01:59:59.872470 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa53dcbb-01e8-476f-a17e-b89665de27b9 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 01:59:59.872743 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa53dcbb-01e8-476f-a17e-b89665de27b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 01:59:59.873009 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa53dcbb-01e8-476f-a17e-b89665de27b9 None admin] PATH_INFO: `/v3/projects/b4fd31add918446baf9c7868e4288d60` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 01:59:59.874121 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa53dcbb-01e8-476f-a17e-b89665de27b9 None admin] RBAC: Authorizing `identity:get_project(project_id=b4fd31add918446baf9c7868e4288d60)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 01:59:59.875527 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa53dcbb-01e8-476f-a17e-b89665de27b9 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 01:59:59.877111 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 554/1122] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Sep 29 01:59:59 2022] GET /identity/v3/projects/b4fd31add918446baf9c7868e4288d60 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 01:59:59.882999 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c943496f-c1bb-4dc3-aa70-70b05332878c None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 01:59:59.929220 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 01:59:59.980937 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c943496f-c1bb-4dc3-aa70-70b05332878c None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:00.013072 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb131218-8c84-48cb-aec3-0095dea4860a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:00.013680 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb131218-8c84-48cb-aec3-0095dea4860a None admin] REQUEST_METHOD: `PUT` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:00.013954 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb131218-8c84-48cb-aec3-0095dea4860a None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:00.014219 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb131218-8c84-48cb-aec3-0095dea4860a None admin] PATH_INFO: `/v3/projects/b4fd31add918446baf9c7868e4288d60/users/6dc82bab5e704a5aa4a586de17c95907/roles/8de931d79c9d4c8daf717aaea348dda9` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:00.016282 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb131218-8c84-48cb-aec3-0095dea4860a None admin] RBAC: Authorizing `identity:create_grant(project_id=b4fd31add918446baf9c7868e4288d60, user_id=6dc82bab5e704a5aa4a586de17c95907, role_id=8de931d79c9d4c8daf717aaea348dda9)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:00:00.017720 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb131218-8c84-48cb-aec3-0095dea4860a None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:00:00.030289 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 569/1123] 10.222.0.49 () {58 vars in 1439 bytes} [Thu Sep 29 01:59:59 2022] PUT /identity/v3/projects/b4fd31add918446baf9c7868e4288d60/users/6dc82bab5e704a5aa4a586de17c95907/roles/8de931d79c9d4c8daf717aaea348dda9 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:00:02.120576 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fd824c-0268-49f6-8f62-6bf991eabcbb None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:02.121133 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fd824c-0268-49f6-8f62-6bf991eabcbb None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:02.121133 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fd824c-0268-49f6-8f62-6bf991eabcbb None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:02.122453 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 555/1124] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 02:00:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:00:02.127587 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb2b6f4-bf76-4f84-bb6f-df2c1b02d4cb None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:02.127994 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb2b6f4-bf76-4f84-bb6f-df2c1b02d4cb None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:02.128150 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb2b6f4-bf76-4f84-bb6f-df2c1b02d4cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:02.146092 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-1fb2b6f4-bf76-4f84-bb6f-df2c1b02d4cb None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:00:02.147280 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-1fb2b6f4-bf76-4f84-bb6f-df2c1b02d4cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:00:02.211776 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 570/1125] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 02:00:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 29 02:00:02.479441 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fd824c-0268-49f6-8f62-6bf991eabcbb None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:02.578699 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fd824c-0268-49f6-8f62-6bf991eabcbb None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:02.612169 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0436ab5e-0067-478a-bf36-4435363321ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:02.612780 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0436ab5e-0067-478a-bf36-4435363321ea None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:02.613053 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0436ab5e-0067-478a-bf36-4435363321ea None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:02.613330 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0436ab5e-0067-478a-bf36-4435363321ea None admin] PATH_INFO: `/v3/roles/8de931d79c9d4c8daf717aaea348dda9` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:02.614754 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0436ab5e-0067-478a-bf36-4435363321ea None admin] RBAC: Authorizing `identity:get_role(role_id=8de931d79c9d4c8daf717aaea348dda9)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:00:02.616096 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0436ab5e-0067-478a-bf36-4435363321ea None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:00:02.617419 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 556/1126] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Sep 29 02:00:02 2022] GET /identity/v3/roles/8de931d79c9d4c8daf717aaea348dda9 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:00:02.623328 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb2b6f4-bf76-4f84-bb6f-df2c1b02d4cb None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:02.657589 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:00:02.721286 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb2b6f4-bf76-4f84-bb6f-df2c1b02d4cb None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:02.753703 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c02075-b083-4ee0-875a-09790dbd7545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:02.754254 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c02075-b083-4ee0-875a-09790dbd7545 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:02.754529 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c02075-b083-4ee0-875a-09790dbd7545 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:02.754797 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c02075-b083-4ee0-875a-09790dbd7545 None admin] PATH_INFO: `/v3/users/6dc82bab5e704a5aa4a586de17c95907` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:02.755892 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c02075-b083-4ee0-875a-09790dbd7545 None admin] RBAC: Authorizing `identity:get_user(user_id=6dc82bab5e704a5aa4a586de17c95907)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:00:02.757323 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c02075-b083-4ee0-875a-09790dbd7545 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:00:02.758871 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 571/1127] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Sep 29 02:00:02 2022] GET /identity/v3/users/6dc82bab5e704a5aa4a586de17c95907 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:00:02.765332 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0436ab5e-0067-478a-bf36-4435363321ea None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:02.775915 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:00:02.861409 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0436ab5e-0067-478a-bf36-4435363321ea None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:02.894447 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444dc2fa-8aaa-43da-8dbf-4621ba9836f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:02.895033 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444dc2fa-8aaa-43da-8dbf-4621ba9836f4 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:02.895311 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444dc2fa-8aaa-43da-8dbf-4621ba9836f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:02.895579 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444dc2fa-8aaa-43da-8dbf-4621ba9836f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:02.960990 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444dc2fa-8aaa-43da-8dbf-4621ba9836f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:00:02.962456 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444dc2fa-8aaa-43da-8dbf-4621ba9836f4 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:00:02.972158 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:00:03.057691 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 557/1128] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Sep 29 02:00:02 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 29 02:00:03.063714 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c02075-b083-4ee0-875a-09790dbd7545 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:03.161160 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c02075-b083-4ee0-875a-09790dbd7545 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:03.163465 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:00:03.194667 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8160efa6-ea89-44ce-a1cb-a46b7342e6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:03.195284 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8160efa6-ea89-44ce-a1cb-a46b7342e6c9 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:03.195559 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8160efa6-ea89-44ce-a1cb-a46b7342e6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:03.195828 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8160efa6-ea89-44ce-a1cb-a46b7342e6c9 None admin] PATH_INFO: `/v3/projects/b4fd31add918446baf9c7868e4288d60` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:03.196927 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8160efa6-ea89-44ce-a1cb-a46b7342e6c9 None admin] RBAC: Authorizing `identity:get_project(project_id=b4fd31add918446baf9c7868e4288d60)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:00:03.198901 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8160efa6-ea89-44ce-a1cb-a46b7342e6c9 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:00:03.200581 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 572/1129] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Sep 29 02:00:03 2022] GET /identity/v3/projects/b4fd31add918446baf9c7868e4288d60 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:00:03.206655 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444dc2fa-8aaa-43da-8dbf-4621ba9836f4 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:03.301935 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444dc2fa-8aaa-43da-8dbf-4621ba9836f4 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:03.310826 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:00:03.335297 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941f85d7-9634-41c3-a9fb-e5587651d59e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:03.335883 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f85d7-9634-41c3-a9fb-e5587651d59e None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:03.336155 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f85d7-9634-41c3-a9fb-e5587651d59e None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:03.336421 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f85d7-9634-41c3-a9fb-e5587651d59e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:03.337128 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941f85d7-9634-41c3-a9fb-e5587651d59e None admin] RBAC: Adding query filter params (role.id=8de931d79c9d4c8daf717aaea348dda9, scope.project.id=b4fd31add918446baf9c7868e4288d60, user.id=6dc82bab5e704a5aa4a586de17c95907) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:00:03.337456 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941f85d7-9634-41c3-a9fb-e5587651d59e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:00:03.338849 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941f85d7-9634-41c3-a9fb-e5587651d59e None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:00:03.345229 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 558/1130] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Sep 29 02:00:03 2022] GET /identity/v3/role_assignments?user.id=6dc82bab5e704a5aa4a586de17c95907&scope.project.id=b4fd31add918446baf9c7868e4288d60&role.id=8de931d79c9d4c8daf717aaea348dda9 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:00:05.479176 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b35bd7-9431-4396-b891-4533710910b1 None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:05.480299 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b35bd7-9431-4396-b891-4533710910b1 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:05.480550 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b35bd7-9431-4396-b891-4533710910b1 None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:05.481999 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 573/1131] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 02:00:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:00:05.487153 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921155c0-91e0-45f0-a6b6-88fbf19020cf None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:05.487562 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921155c0-91e0-45f0-a6b6-88fbf19020cf None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:05.487697 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921155c0-91e0-45f0-a6b6-88fbf19020cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:05.505899 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-921155c0-91e0-45f0-a6b6-88fbf19020cf None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:00:05.507098 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-921155c0-91e0-45f0-a6b6-88fbf19020cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:00:05.571230 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 559/1132] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 02:00:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 29 02:00:05.838107 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b35bd7-9431-4396-b891-4533710910b1 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:05.938753 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b35bd7-9431-4396-b891-4533710910b1 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:05.970739 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24e4b1c-718b-4992-96aa-1b9b8d3b747c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:05.971353 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e4b1c-718b-4992-96aa-1b9b8d3b747c None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:05.971627 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e4b1c-718b-4992-96aa-1b9b8d3b747c None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:05.971891 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e4b1c-718b-4992-96aa-1b9b8d3b747c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:05.972968 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24e4b1c-718b-4992-96aa-1b9b8d3b747c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:00:05.974413 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24e4b1c-718b-4992-96aa-1b9b8d3b747c None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:00:05.975948 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 574/1133] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 02:00:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:00:05.982383 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921155c0-91e0-45f0-a6b6-88fbf19020cf None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:06.076585 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921155c0-91e0-45f0-a6b6-88fbf19020cf None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:06.078117 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:00:06.111209 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cc3140-69fd-442d-b652-9d51b60489b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:06.111739 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc3140-69fd-442d-b652-9d51b60489b7 None admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:06.112015 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc3140-69fd-442d-b652-9d51b60489b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:06.112284 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc3140-69fd-442d-b652-9d51b60489b7 None admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:06.112931 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cc3140-69fd-442d-b652-9d51b60489b7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:00:06.114375 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cc3140-69fd-442d-b652-9d51b60489b7 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:00:06.139717 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 560/1134] 10.222.0.49 () {60 vars in 1141 bytes} [Thu Sep 29 02:00:05 2022] POST /identity/v3/projects => generated 311 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:00:08.309010 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238df7f9-d5b4-40c5-bc51-c54bb6ca15db None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:08.309586 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238df7f9-d5b4-40c5-bc51-c54bb6ca15db None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:08.309586 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238df7f9-d5b4-40c5-bc51-c54bb6ca15db None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:08.310915 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 575/1135] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 02:00:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:00:08.316093 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd007118-2366-4ed6-9bd2-bee9e81542e6 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:08.316513 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd007118-2366-4ed6-9bd2-bee9e81542e6 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:08.316649 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd007118-2366-4ed6-9bd2-bee9e81542e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:08.336897 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-dd007118-2366-4ed6-9bd2-bee9e81542e6 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:00:08.338125 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-dd007118-2366-4ed6-9bd2-bee9e81542e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:00:08.404555 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 561/1136] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 02:00:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 29 02:00:08.703352 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238df7f9-d5b4-40c5-bc51-c54bb6ca15db None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:08.746000 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:00:08.803812 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238df7f9-d5b4-40c5-bc51-c54bb6ca15db None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:08.836769 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631684cb-cc5e-4966-8831-e3301b687099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:08.837428 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631684cb-cc5e-4966-8831-e3301b687099 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:08.837704 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631684cb-cc5e-4966-8831-e3301b687099 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:08.837970 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631684cb-cc5e-4966-8831-e3301b687099 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:08.839111 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631684cb-cc5e-4966-8831-e3301b687099 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:00:08.840519 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631684cb-cc5e-4966-8831-e3301b687099 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:00:08.842075 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 576/1137] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 02:00:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:00:08.847952 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd007118-2366-4ed6-9bd2-bee9e81542e6 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:08.928608 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:00:08.945955 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd007118-2366-4ed6-9bd2-bee9e81542e6 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:08.978841 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cccfd4e-79c7-4d65-947c-389cbb058d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:08.979886 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cccfd4e-79c7-4d65-947c-389cbb058d10 None admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:08.980179 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cccfd4e-79c7-4d65-947c-389cbb058d10 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:08.980446 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cccfd4e-79c7-4d65-947c-389cbb058d10 None admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:08.981082 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cccfd4e-79c7-4d65-947c-389cbb058d10 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:00:08.982538 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cccfd4e-79c7-4d65-947c-389cbb058d10 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:00:09.003264 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 562/1138] 10.222.0.49 () {60 vars in 1132 bytes} [Thu Sep 29 02:00:08 2022] POST /identity/v3/users => generated 286 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:00:11.152069 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05879ad5-6010-4b7d-95cd-37907367978b None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:11.152591 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05879ad5-6010-4b7d-95cd-37907367978b None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:11.152591 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05879ad5-6010-4b7d-95cd-37907367978b None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:11.154000 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 577/1139] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 02:00:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:00:11.159096 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffbb3fd-b337-40af-ac72-f5ccfe9099f2 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:11.159527 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffbb3fd-b337-40af-ac72-f5ccfe9099f2 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:11.159621 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffbb3fd-b337-40af-ac72-f5ccfe9099f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:11.178302 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-1ffbb3fd-b337-40af-ac72-f5ccfe9099f2 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:00:11.179503 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-1ffbb3fd-b337-40af-ac72-f5ccfe9099f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:00:11.243187 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 563/1140] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 02:00:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 29 02:00:11.507495 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05879ad5-6010-4b7d-95cd-37907367978b None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:11.608883 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05879ad5-6010-4b7d-95cd-37907367978b None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:11.617797 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:00:11.642126 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a405153a-ccb4-4748-9d33-b3cf3821d977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:11.642830 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a405153a-ccb4-4748-9d33-b3cf3821d977 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:11.643110 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a405153a-ccb4-4748-9d33-b3cf3821d977 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:11.643377 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a405153a-ccb4-4748-9d33-b3cf3821d977 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:11.653773 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a405153a-ccb4-4748-9d33-b3cf3821d977 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 02:00:11.658539 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-a405153a-ccb4-4748-9d33-b3cf3821d977 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 02:00:11.658539 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 02:00:11.658539 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 02:00:11.658539 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 02:00:11.658539 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 02:00:11.658539 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 02:00:11.658539 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 02:00:11.658539 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 02:00:11.658539 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 02:00:11.658539 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 02:00:11.658539 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 02:00:11.658539 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 02:00:11.658539 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 02:00:11.658539 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 02:00:11.658539 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 02:00:11.658539 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 02:00:11.659606 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 02:00:11.659606 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 02:00:11.659606 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 02:00:11.659606 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 02:00:11.659606 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 02:00:11.659606 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 02:00:11.659606 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 02:00:11.659606 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 02:00:11.659606 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 02:00:11.659606 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 02:00:11.659606 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 02:00:11.659606 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 02:00:11.659606 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 02:00:11.659606 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 02:00:11.659606 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 02:00:11.659606 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 02:00:11.660557 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 02:00:11.660557 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 02:00:11.660557 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 02:00:11.660557 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 02:00:11.660557 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 02:00:11.660557 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 02:00:11.660557 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 02:00:11.660557 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 02:00:11.660557 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 02:00:11.660557 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 02:00:11.660557 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 02:00:11.660557 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 02:00:11.660557 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 578/1141] 10.222.0.49 () {56 vars in 1096 bytes} [Thu Sep 29 02:00:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 02:00:11.665868 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffbb3fd-b337-40af-ac72-f5ccfe9099f2 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:11.731737 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:00:11.762571 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffbb3fd-b337-40af-ac72-f5ccfe9099f2 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:11.795399 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7da111-0062-4b75-b239-792e1630f571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:11.795990 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7da111-0062-4b75-b239-792e1630f571 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:11.796262 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7da111-0062-4b75-b239-792e1630f571 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:11.796524 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7da111-0062-4b75-b239-792e1630f571 None admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:11.797168 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7da111-0062-4b75-b239-792e1630f571 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:00:11.797490 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7da111-0062-4b75-b239-792e1630f571 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:00:11.798827 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7da111-0062-4b75-b239-792e1630f571 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:00:11.806537 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 564/1142] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Sep 29 02:00:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:00:11.812595 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a405153a-ccb4-4748-9d33-b3cf3821d977 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:11.910197 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a405153a-ccb4-4748-9d33-b3cf3821d977 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:11.942904 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb7670f-0e2d-400f-afea-ade5fe5613f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:11.943520 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7670f-0e2d-400f-afea-ade5fe5613f8 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:11.943801 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7670f-0e2d-400f-afea-ade5fe5613f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:11.944071 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7670f-0e2d-400f-afea-ade5fe5613f8 None admin] PATH_INFO: `/v3/users/04ec22d7591444c381b0be24112c9592` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:11.957054 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb7670f-0e2d-400f-afea-ade5fe5613f8 None admin] RBAC: Authorizing `identity:get_user(user_id=04ec22d7591444c381b0be24112c9592)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:00:11.958521 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb7670f-0e2d-400f-afea-ade5fe5613f8 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:00:11.960108 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 579/1143] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Sep 29 02:00:11 2022] GET /identity/v3/users/04ec22d7591444c381b0be24112c9592 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:00:11.966525 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7da111-0062-4b75-b239-792e1630f571 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:12.062347 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7da111-0062-4b75-b239-792e1630f571 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:12.090604 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:00:12.095872 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d4acfc-814d-4b14-8642-3da815915959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:12.096464 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d4acfc-814d-4b14-8642-3da815915959 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:12.096741 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d4acfc-814d-4b14-8642-3da815915959 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:12.097007 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d4acfc-814d-4b14-8642-3da815915959 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:12.161397 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d4acfc-814d-4b14-8642-3da815915959 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:00:12.162861 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d4acfc-814d-4b14-8642-3da815915959 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:00:12.258393 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 565/1144] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Sep 29 02:00:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 29 02:00:12.265004 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb7670f-0e2d-400f-afea-ade5fe5613f8 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:12.291217 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:00:12.361031 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb7670f-0e2d-400f-afea-ade5fe5613f8 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:12.394936 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e739c9e9-58f8-4450-b1e8-7a2968fc8454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:12.395558 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e739c9e9-58f8-4450-b1e8-7a2968fc8454 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:12.395837 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e739c9e9-58f8-4450-b1e8-7a2968fc8454 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:12.396108 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e739c9e9-58f8-4450-b1e8-7a2968fc8454 None admin] PATH_INFO: `/v3/projects/caeaa1be2922433b8e72ff00438397d0` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:12.397206 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e739c9e9-58f8-4450-b1e8-7a2968fc8454 None admin] RBAC: Authorizing `identity:get_project(project_id=caeaa1be2922433b8e72ff00438397d0)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:00:12.398651 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e739c9e9-58f8-4450-b1e8-7a2968fc8454 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:00:12.400279 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 580/1145] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Sep 29 02:00:12 2022] GET /identity/v3/projects/caeaa1be2922433b8e72ff00438397d0 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:00:12.406708 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d4acfc-814d-4b14-8642-3da815915959 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:12.437118 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:00:12.503160 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d4acfc-814d-4b14-8642-3da815915959 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:12.535957 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ac6d4a-3fe8-4de5-854a-1c144a2cc1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:12.536549 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac6d4a-3fe8-4de5-854a-1c144a2cc1a8 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:12.536826 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac6d4a-3fe8-4de5-854a-1c144a2cc1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:12.537098 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac6d4a-3fe8-4de5-854a-1c144a2cc1a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:12.537842 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ac6d4a-3fe8-4de5-854a-1c144a2cc1a8 None admin] RBAC: Adding query filter params (role.id=fe9bbc67742f4f5893f39b18eb31d59a, scope.project.id=caeaa1be2922433b8e72ff00438397d0, user.id=04ec22d7591444c381b0be24112c9592) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:00:12.538149 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ac6d4a-3fe8-4de5-854a-1c144a2cc1a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:00:12.539819 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ac6d4a-3fe8-4de5-854a-1c144a2cc1a8 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:00:12.545492 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 566/1146] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Sep 29 02:00:12 2022] GET /identity/v3/role_assignments?user.id=04ec22d7591444c381b0be24112c9592&scope.project.id=caeaa1be2922433b8e72ff00438397d0&role.id=fe9bbc67742f4f5893f39b18eb31d59a => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:00:14.677270 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75934ca-16b4-456f-b4e0-c3aacda2fcf8 None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:14.677815 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75934ca-16b4-456f-b4e0-c3aacda2fcf8 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:14.677815 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75934ca-16b4-456f-b4e0-c3aacda2fcf8 None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:14.679143 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 581/1147] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 02:00:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:00:14.684501 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb0291-77c6-49c6-926e-b961de8d68d7 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:14.684917 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb0291-77c6-49c6-926e-b961de8d68d7 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:14.685031 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb0291-77c6-49c6-926e-b961de8d68d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:14.703145 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-a2bb0291-77c6-49c6-926e-b961de8d68d7 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:00:14.704324 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-a2bb0291-77c6-49c6-926e-b961de8d68d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:00:14.768878 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 567/1148] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 02:00:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 29 02:00:15.036312 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75934ca-16b4-456f-b4e0-c3aacda2fcf8 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:15.129969 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:00:15.138596 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75934ca-16b4-456f-b4e0-c3aacda2fcf8 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:15.171004 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3decffd-b45b-4dc9-bdf4-342a58c52f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:15.171608 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3decffd-b45b-4dc9-bdf4-342a58c52f5f None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:15.171884 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3decffd-b45b-4dc9-bdf4-342a58c52f5f None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:15.172148 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3decffd-b45b-4dc9-bdf4-342a58c52f5f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:15.181761 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3decffd-b45b-4dc9-bdf4-342a58c52f5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 02:00:15.187030 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-d3decffd-b45b-4dc9-bdf4-342a58c52f5f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 02:00:15.187030 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 02:00:15.187030 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 02:00:15.187030 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 02:00:15.187030 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 02:00:15.187030 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 02:00:15.187030 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 02:00:15.187030 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 02:00:15.187030 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 02:00:15.187030 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 02:00:15.187030 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 02:00:15.187030 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 02:00:15.187030 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 02:00:15.187030 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 02:00:15.187030 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 02:00:15.187030 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 02:00:15.188142 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 02:00:15.188142 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 02:00:15.188142 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 02:00:15.188142 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 02:00:15.188142 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 02:00:15.188142 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 02:00:15.188142 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 02:00:15.188142 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 02:00:15.188142 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 02:00:15.188142 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 02:00:15.188142 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 02:00:15.188142 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 02:00:15.188142 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 02:00:15.188142 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 02:00:15.188142 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 02:00:15.188142 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 02:00:15.189002 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 02:00:15.189002 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 02:00:15.189002 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 02:00:15.189002 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 02:00:15.189002 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 02:00:15.189002 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 02:00:15.189002 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 02:00:15.189002 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 02:00:15.189002 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 02:00:15.189002 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 02:00:15.189002 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 02:00:15.189002 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 02:00:15.189002 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 582/1149] 10.222.0.49 () {56 vars in 1096 bytes} [Thu Sep 29 02:00:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 02:00:15.194153 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bb0291-77c6-49c6-926e-b961de8d68d7 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:15.220442 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:00:15.290659 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bb0291-77c6-49c6-926e-b961de8d68d7 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:15.323687 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a050d0b-d7e5-4a9b-acf4-3787ebd8cdec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:15.324278 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a050d0b-d7e5-4a9b-acf4-3787ebd8cdec None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:15.324555 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a050d0b-d7e5-4a9b-acf4-3787ebd8cdec None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:15.324822 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a050d0b-d7e5-4a9b-acf4-3787ebd8cdec None admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:15.325496 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a050d0b-d7e5-4a9b-acf4-3787ebd8cdec None admin] RBAC: Adding query filter params (name=admin) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:00:15.325794 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a050d0b-d7e5-4a9b-acf4-3787ebd8cdec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:00:15.327133 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a050d0b-d7e5-4a9b-acf4-3787ebd8cdec None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:00:15.334816 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 568/1150] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Sep 29 02:00:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:00:15.340531 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3decffd-b45b-4dc9-bdf4-342a58c52f5f None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:15.437303 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3decffd-b45b-4dc9-bdf4-342a58c52f5f None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:15.469964 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc602235-3a5a-499b-8e34-ddd1894db302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:15.470572 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc602235-3a5a-499b-8e34-ddd1894db302 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:15.470851 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc602235-3a5a-499b-8e34-ddd1894db302 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:15.471121 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc602235-3a5a-499b-8e34-ddd1894db302 None admin] PATH_INFO: `/v3/users/04ec22d7591444c381b0be24112c9592` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:15.472218 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc602235-3a5a-499b-8e34-ddd1894db302 None admin] RBAC: Authorizing `identity:get_user(user_id=04ec22d7591444c381b0be24112c9592)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:00:15.473652 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc602235-3a5a-499b-8e34-ddd1894db302 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:00:15.475186 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 583/1151] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Sep 29 02:00:15 2022] GET /identity/v3/users/04ec22d7591444c381b0be24112c9592 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:00:15.481012 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a050d0b-d7e5-4a9b-acf4-3787ebd8cdec None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:15.566636 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:00:15.579120 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a050d0b-d7e5-4a9b-acf4-3787ebd8cdec None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:15.611239 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e11e81-b710-4743-bc12-3d32f86896bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:15.611859 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e11e81-b710-4743-bc12-3d32f86896bc None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:15.612135 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e11e81-b710-4743-bc12-3d32f86896bc None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:15.612402 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e11e81-b710-4743-bc12-3d32f86896bc None admin] PATH_INFO: `/v3/projects/caeaa1be2922433b8e72ff00438397d0` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:15.613532 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e11e81-b710-4743-bc12-3d32f86896bc None admin] RBAC: Authorizing `identity:get_project(project_id=caeaa1be2922433b8e72ff00438397d0)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:00:15.614942 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e11e81-b710-4743-bc12-3d32f86896bc None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:00:15.616540 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 569/1152] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Sep 29 02:00:15 2022] GET /identity/v3/projects/caeaa1be2922433b8e72ff00438397d0 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:00:15.623268 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc602235-3a5a-499b-8e34-ddd1894db302 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:15.647407 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:00:15.721397 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc602235-3a5a-499b-8e34-ddd1894db302 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:15.754686 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe798f2-6999-4039-b6e8-595ea51f1c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:15.755333 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe798f2-6999-4039-b6e8-595ea51f1c8e None admin] REQUEST_METHOD: `PUT` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:15.755614 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe798f2-6999-4039-b6e8-595ea51f1c8e None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:15.755889 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe798f2-6999-4039-b6e8-595ea51f1c8e None admin] PATH_INFO: `/v3/projects/caeaa1be2922433b8e72ff00438397d0/users/04ec22d7591444c381b0be24112c9592/roles/fe9bbc67742f4f5893f39b18eb31d59a` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:15.757802 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe798f2-6999-4039-b6e8-595ea51f1c8e None admin] RBAC: Authorizing `identity:create_grant(project_id=caeaa1be2922433b8e72ff00438397d0, user_id=04ec22d7591444c381b0be24112c9592, role_id=fe9bbc67742f4f5893f39b18eb31d59a)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:00:15.759222 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe798f2-6999-4039-b6e8-595ea51f1c8e None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:00:15.771910 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 584/1153] 10.222.0.49 () {58 vars in 1439 bytes} [Thu Sep 29 02:00:15 2022] PUT /identity/v3/projects/caeaa1be2922433b8e72ff00438397d0/users/04ec22d7591444c381b0be24112c9592/roles/fe9bbc67742f4f5893f39b18eb31d59a => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:00:17.876785 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c477d42-b756-40e3-bdf9-35d27e5ddca7 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:17.877384 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c477d42-b756-40e3-bdf9-35d27e5ddca7 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:17.877384 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c477d42-b756-40e3-bdf9-35d27e5ddca7 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:17.878675 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 570/1154] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 02:00:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:00:17.883924 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3fb2a2-3937-4b92-a05b-32a0e0641e8d None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:17.884328 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3fb2a2-3937-4b92-a05b-32a0e0641e8d None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:17.884464 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3fb2a2-3937-4b92-a05b-32a0e0641e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:17.903191 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-bd3fb2a2-3937-4b92-a05b-32a0e0641e8d None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:00:17.904371 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-bd3fb2a2-3937-4b92-a05b-32a0e0641e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:00:17.968548 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 585/1155] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 02:00:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 29 02:00:18.236608 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c477d42-b756-40e3-bdf9-35d27e5ddca7 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:18.336030 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c477d42-b756-40e3-bdf9-35d27e5ddca7 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:18.367755 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0bbc89-3e2d-4749-8346-e87e7ecac918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:18.368360 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0bbc89-3e2d-4749-8346-e87e7ecac918 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:18.368638 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0bbc89-3e2d-4749-8346-e87e7ecac918 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:18.368907 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0bbc89-3e2d-4749-8346-e87e7ecac918 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:18.380352 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0bbc89-3e2d-4749-8346-e87e7ecac918 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 02:00:18.385173 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-6e0bbc89-3e2d-4749-8346-e87e7ecac918 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 02:00:18.385173 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 02:00:18.385173 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 02:00:18.385173 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 02:00:18.385173 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 02:00:18.385173 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 02:00:18.385173 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 02:00:18.385173 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 02:00:18.385173 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 02:00:18.385173 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 02:00:18.385173 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 02:00:18.385173 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 02:00:18.385173 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 02:00:18.385173 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 02:00:18.385173 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 02:00:18.385173 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 02:00:18.386317 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 02:00:18.386317 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 02:00:18.386317 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 02:00:18.386317 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 02:00:18.386317 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 02:00:18.386317 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 02:00:18.386317 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 02:00:18.386317 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 02:00:18.386317 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 02:00:18.386317 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 02:00:18.386317 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 02:00:18.386317 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 02:00:18.386317 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 02:00:18.386317 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 02:00:18.386317 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 02:00:18.386317 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 02:00:18.387325 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 02:00:18.387325 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 02:00:18.387325 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 02:00:18.387325 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 02:00:18.387325 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 02:00:18.387325 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 02:00:18.387325 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 02:00:18.387325 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 02:00:18.387325 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 02:00:18.387325 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 02:00:18.387325 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 02:00:18.387325 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 02:00:18.387325 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 571/1156] 10.222.0.49 () {56 vars in 1096 bytes} [Thu Sep 29 02:00:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 02:00:18.392473 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3fb2a2-3937-4b92-a05b-32a0e0641e8d None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:18.406874 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:00:18.492086 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3fb2a2-3937-4b92-a05b-32a0e0641e8d None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:18.525891 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a62df5a-66a5-43e7-ae52-8c1644853335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:18.526749 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a62df5a-66a5-43e7-ae52-8c1644853335 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:18.527025 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a62df5a-66a5-43e7-ae52-8c1644853335 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:18.527295 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a62df5a-66a5-43e7-ae52-8c1644853335 None admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:18.527956 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a62df5a-66a5-43e7-ae52-8c1644853335 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:00:18.528259 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a62df5a-66a5-43e7-ae52-8c1644853335 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:00:18.529648 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a62df5a-66a5-43e7-ae52-8c1644853335 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:00:18.537493 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 586/1157] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Sep 29 02:00:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:00:18.543632 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0bbc89-3e2d-4749-8346-e87e7ecac918 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:18.561480 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:00:18.643075 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0bbc89-3e2d-4749-8346-e87e7ecac918 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:18.680824 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26471c45-b9bf-461b-b960-11bb1e91c0a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:18.681485 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26471c45-b9bf-461b-b960-11bb1e91c0a6 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:18.681892 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26471c45-b9bf-461b-b960-11bb1e91c0a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:18.682172 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26471c45-b9bf-461b-b960-11bb1e91c0a6 None admin] PATH_INFO: `/v3/users/04ec22d7591444c381b0be24112c9592` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:18.683295 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26471c45-b9bf-461b-b960-11bb1e91c0a6 None admin] RBAC: Authorizing `identity:get_user(user_id=04ec22d7591444c381b0be24112c9592)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:00:18.684719 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26471c45-b9bf-461b-b960-11bb1e91c0a6 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:00:18.686311 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 572/1158] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Sep 29 02:00:18 2022] GET /identity/v3/users/04ec22d7591444c381b0be24112c9592 => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:00:18.692043 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a62df5a-66a5-43e7-ae52-8c1644853335 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:18.767071 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:00:18.792134 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a62df5a-66a5-43e7-ae52-8c1644853335 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:18.824470 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5785da-a0a3-4461-9750-958a5cf8936f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:18.825061 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5785da-a0a3-4461-9750-958a5cf8936f None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:18.825372 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5785da-a0a3-4461-9750-958a5cf8936f None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:18.825644 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5785da-a0a3-4461-9750-958a5cf8936f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:18.890929 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5785da-a0a3-4461-9750-958a5cf8936f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:00:18.892355 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5785da-a0a3-4461-9750-958a5cf8936f None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:00:18.963060 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:00:18.987223 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 587/1159] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Sep 29 02:00:18 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 29 02:00:18.993168 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26471c45-b9bf-461b-b960-11bb1e91c0a6 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:19.074676 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:00:19.090029 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26471c45-b9bf-461b-b960-11bb1e91c0a6 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:19.122156 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498063d9-f258-4240-a163-456b33b0d69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:19.122770 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498063d9-f258-4240-a163-456b33b0d69f None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:19.123047 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498063d9-f258-4240-a163-456b33b0d69f None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:19.123319 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498063d9-f258-4240-a163-456b33b0d69f None admin] PATH_INFO: `/v3/projects/caeaa1be2922433b8e72ff00438397d0` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:19.124418 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498063d9-f258-4240-a163-456b33b0d69f None admin] RBAC: Authorizing `identity:get_project(project_id=caeaa1be2922433b8e72ff00438397d0)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:00:19.125872 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498063d9-f258-4240-a163-456b33b0d69f None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:00:19.127459 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 573/1160] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Sep 29 02:00:18 2022] GET /identity/v3/projects/caeaa1be2922433b8e72ff00438397d0 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:00:19.133658 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5785da-a0a3-4461-9750-958a5cf8936f None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:19.230029 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5785da-a0a3-4461-9750-958a5cf8936f None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:19.263758 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1652413b-a32f-4b38-bf41-fbed8bf3054a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:19.264356 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1652413b-a32f-4b38-bf41-fbed8bf3054a None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:19.264637 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1652413b-a32f-4b38-bf41-fbed8bf3054a None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:19.264910 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1652413b-a32f-4b38-bf41-fbed8bf3054a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:19.265656 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1652413b-a32f-4b38-bf41-fbed8bf3054a None admin] RBAC: Adding query filter params (role.id=fe9bbc67742f4f5893f39b18eb31d59a, scope.project.id=caeaa1be2922433b8e72ff00438397d0, user.id=04ec22d7591444c381b0be24112c9592) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:00:19.265964 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1652413b-a32f-4b38-bf41-fbed8bf3054a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:00:19.267381 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1652413b-a32f-4b38-bf41-fbed8bf3054a None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:00:19.272945 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 588/1161] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Sep 29 02:00:19 2022] GET /identity/v3/role_assignments?user.id=04ec22d7591444c381b0be24112c9592&scope.project.id=caeaa1be2922433b8e72ff00438397d0&role.id=fe9bbc67742f4f5893f39b18eb31d59a => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:00:21.399132 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee4f04-84d7-4a20-becb-0e45d0a9dc9b None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:21.399692 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee4f04-84d7-4a20-becb-0e45d0a9dc9b None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:21.399692 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee4f04-84d7-4a20-becb-0e45d0a9dc9b None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:21.401637 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 574/1162] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 02:00:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:00:21.406797 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c99a851-6ba8-487c-b8a9-d36f8a16e7f0 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:21.407199 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c99a851-6ba8-487c-b8a9-d36f8a16e7f0 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:21.407342 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c99a851-6ba8-487c-b8a9-d36f8a16e7f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:21.425797 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-8c99a851-6ba8-487c-b8a9-d36f8a16e7f0 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:00:21.426971 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-8c99a851-6ba8-487c-b8a9-d36f8a16e7f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:00:21.454790 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:00:21.492764 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 589/1163] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 02:00:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 29 02:00:21.755968 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ee4f04-84d7-4a20-becb-0e45d0a9dc9b None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:21.856073 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ee4f04-84d7-4a20-becb-0e45d0a9dc9b None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:21.889150 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f705711-5096-4976-b907-e54756dfb070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:21.889778 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f705711-5096-4976-b907-e54756dfb070 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:21.890060 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f705711-5096-4976-b907-e54756dfb070 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:21.890333 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f705711-5096-4976-b907-e54756dfb070 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:21.912298 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:00:21.957789 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f705711-5096-4976-b907-e54756dfb070 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:00:21.959228 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f705711-5096-4976-b907-e54756dfb070 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:00:22.052603 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 575/1164] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Sep 29 02:00:21 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 29 02:00:22.059036 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c99a851-6ba8-487c-b8a9-d36f8a16e7f0 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:22.153377 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c99a851-6ba8-487c-b8a9-d36f8a16e7f0 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:22.185888 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1260d7ea-cf13-4131-acb0-69426a1ff68f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:22.186492 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1260d7ea-cf13-4131-acb0-69426a1ff68f None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:22.186765 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1260d7ea-cf13-4131-acb0-69426a1ff68f None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:22.187028 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1260d7ea-cf13-4131-acb0-69426a1ff68f None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:22.193403 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1260d7ea-cf13-4131-acb0-69426a1ff68f None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:00:22.194829 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1260d7ea-cf13-4131-acb0-69426a1ff68f None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:00:22.206604 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-1260d7ea-cf13-4131-acb0-69426a1ff68f None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 29 02:00:22.206604 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 02:00:22.206604 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 29 02:00:22.206604 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 29 02:00:22.206604 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 29 02:00:22.206604 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 29 02:00:22.206604 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 29 02:00:22.206604 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 29 02:00:22.206604 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 29 02:00:22.206604 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 02:00:22.206604 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 29 02:00:22.206604 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 02:00:22.206604 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 02:00:22.206604 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 02:00:22.206604 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 02:00:22.206604 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 02:00:22.206604 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 02:00:22.207854 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 02:00:22.207854 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 02:00:22.207854 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 02:00:22.207854 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 02:00:22.207854 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 02:00:22.207854 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 02:00:22.207854 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 02:00:22.207854 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 02:00:22.207854 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 02:00:22.207854 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 02:00:22.207854 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 02:00:22.207854 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 02:00:22.207854 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 02:00:22.207854 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 02:00:22.207854 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 02:00:22.207854 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 02:00:22.208793 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 02:00:22.208793 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 02:00:22.208793 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 02:00:22.208793 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 02:00:22.208793 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 02:00:22.208793 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 02:00:22.208793 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 02:00:22.208793 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 02:00:22.208793 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 02:00:22.208793 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 02:00:22.208793 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 29 02:00:22.208793 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 02:00:22.208793 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 29 02:00:22.208793 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 02:00:22.208793 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 590/1165] 10.222.0.49 () {56 vars in 1117 bytes} [Thu Sep 29 02:00:22 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 02:00:22.213661 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f705711-5096-4976-b907-e54756dfb070 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:22.264022 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:00:22.309059 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f705711-5096-4976-b907-e54756dfb070 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:22.340380 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fb6101-c49e-483c-b049-e24642f982a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:22.340968 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb6101-c49e-483c-b049-e24642f982a7 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:22.341243 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb6101-c49e-483c-b049-e24642f982a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:22.341541 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb6101-c49e-483c-b049-e24642f982a7 None admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:22.342166 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fb6101-c49e-483c-b049-e24642f982a7 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:00:22.342462 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fb6101-c49e-483c-b049-e24642f982a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:00:22.343797 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fb6101-c49e-483c-b049-e24642f982a7 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:00:22.350594 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 576/1166] 10.222.0.49 () {56 vars in 1115 bytes} [Thu Sep 29 02:00:22 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:00:24.479266 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc533f0-65a7-4ccf-ac6f-5c07ef960611 None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:24.479795 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc533f0-65a7-4ccf-ac6f-5c07ef960611 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:24.479795 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc533f0-65a7-4ccf-ac6f-5c07ef960611 None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:24.481227 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 591/1167] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 02:00:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:00:24.486352 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33960608-bcaf-4bb8-b350-da4d554acca2 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:24.486770 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33960608-bcaf-4bb8-b350-da4d554acca2 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:24.486903 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33960608-bcaf-4bb8-b350-da4d554acca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:24.505960 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-33960608-bcaf-4bb8-b350-da4d554acca2 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:00:24.507141 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-33960608-bcaf-4bb8-b350-da4d554acca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:00:24.571779 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 577/1168] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 02:00:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 29 02:00:24.855390 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc533f0-65a7-4ccf-ac6f-5c07ef960611 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:24.883455 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:00:24.965238 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc533f0-65a7-4ccf-ac6f-5c07ef960611 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:24.997688 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de360408-6ed4-480a-b953-f6f875e762d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:24.998278 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de360408-6ed4-480a-b953-f6f875e762d4 None admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:24.998551 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de360408-6ed4-480a-b953-f6f875e762d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:24.998816 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de360408-6ed4-480a-b953-f6f875e762d4 None admin] PATH_INFO: `/v3/domains` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:24.999477 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de360408-6ed4-480a-b953-f6f875e762d4 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:00:25.000816 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de360408-6ed4-480a-b953-f6f875e762d4 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:00:25.015820 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 592/1169] 10.222.0.49 () {60 vars in 1138 bytes} [Thu Sep 29 02:00:24 2022] POST /identity/v3/domains => generated 267 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:00:27.191682 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b920b-9573-4503-bd26-ee1e35a60141 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:27.192192 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b920b-9573-4503-bd26-ee1e35a60141 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:27.192192 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b920b-9573-4503-bd26-ee1e35a60141 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:27.193498 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 578/1170] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 02:00:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:00:27.198880 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e1af64-b927-4703-bd98-7b7fdd8c54e8 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:27.199291 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e1af64-b927-4703-bd98-7b7fdd8c54e8 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:27.199425 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e1af64-b927-4703-bd98-7b7fdd8c54e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:27.218486 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-b3e1af64-b927-4703-bd98-7b7fdd8c54e8 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:00:27.219660 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-b3e1af64-b927-4703-bd98-7b7fdd8c54e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:00:27.283682 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 593/1171] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 02:00:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 29 02:00:27.550913 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7b920b-9573-4503-bd26-ee1e35a60141 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:27.598009 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:00:27.648878 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7b920b-9573-4503-bd26-ee1e35a60141 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:27.682226 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533cd75a-4147-4ffc-ac48-8e9d44a01084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:27.682836 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533cd75a-4147-4ffc-ac48-8e9d44a01084 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:27.683110 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533cd75a-4147-4ffc-ac48-8e9d44a01084 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:27.683377 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533cd75a-4147-4ffc-ac48-8e9d44a01084 None admin] PATH_INFO: `/v3/domains/73de9972831749129d7295d4ec93b1b4` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:27.693282 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533cd75a-4147-4ffc-ac48-8e9d44a01084 None admin] RBAC: Authorizing `identity:get_domain(domain_id=73de9972831749129d7295d4ec93b1b4)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:00:27.694728 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533cd75a-4147-4ffc-ac48-8e9d44a01084 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:00:27.696252 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 579/1172] 10.222.0.49 () {56 vars in 1183 bytes} [Thu Sep 29 02:00:27 2022] GET /identity/v3/domains/73de9972831749129d7295d4ec93b1b4 => generated 267 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:00:27.702094 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e1af64-b927-4703-bd98-7b7fdd8c54e8 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:27.719721 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:00:27.798465 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e1af64-b927-4703-bd98-7b7fdd8c54e8 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:27.830958 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8120763f-67f7-4f9e-b397-1e43f29a29fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:27.831556 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8120763f-67f7-4f9e-b397-1e43f29a29fa None admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:27.831836 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8120763f-67f7-4f9e-b397-1e43f29a29fa None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:27.832105 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8120763f-67f7-4f9e-b397-1e43f29a29fa None admin] PATH_INFO: `/v3/projects` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:27.832749 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8120763f-67f7-4f9e-b397-1e43f29a29fa None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:00:27.834180 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8120763f-67f7-4f9e-b397-1e43f29a29fa None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:00:27.859460 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 594/1173] 10.222.0.49 () {60 vars in 1141 bytes} [Thu Sep 29 02:00:27 2022] POST /identity/v3/projects => generated 361 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:00:30.012844 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007569c2-a65d-4943-8633-8b9290042df9 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:30.013445 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007569c2-a65d-4943-8633-8b9290042df9 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:30.013445 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007569c2-a65d-4943-8633-8b9290042df9 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:30.014776 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 580/1174] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 02:00:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:00:30.020120 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd106b0a-05a1-4570-8532-f504d4b0dbd2 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:30.020511 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd106b0a-05a1-4570-8532-f504d4b0dbd2 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:30.020670 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd106b0a-05a1-4570-8532-f504d4b0dbd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:30.039300 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-cd106b0a-05a1-4570-8532-f504d4b0dbd2 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:00:30.040694 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-cd106b0a-05a1-4570-8532-f504d4b0dbd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:00:30.105791 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:00:30.111782 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 595/1175] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 02:00:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 29 02:00:30.388594 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007569c2-a65d-4943-8633-8b9290042df9 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:30.486308 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007569c2-a65d-4943-8633-8b9290042df9 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:30.492843 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:00:30.519821 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9516b8-1864-472b-b3b1-8d5b26f86964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:30.520433 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9516b8-1864-472b-b3b1-8d5b26f86964 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:30.520709 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9516b8-1864-472b-b3b1-8d5b26f86964 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:30.520978 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9516b8-1864-472b-b3b1-8d5b26f86964 None admin] PATH_INFO: `/v3/domains/73de9972831749129d7295d4ec93b1b4` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:30.522118 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9516b8-1864-472b-b3b1-8d5b26f86964 None admin] RBAC: Authorizing `identity:get_domain(domain_id=73de9972831749129d7295d4ec93b1b4)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:00:30.523525 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9516b8-1864-472b-b3b1-8d5b26f86964 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:00:30.525079 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 581/1176] 10.222.0.49 () {56 vars in 1183 bytes} [Thu Sep 29 02:00:30 2022] GET /identity/v3/domains/73de9972831749129d7295d4ec93b1b4 => generated 267 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:00:30.530807 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd106b0a-05a1-4570-8532-f504d4b0dbd2 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:30.627692 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd106b0a-05a1-4570-8532-f504d4b0dbd2 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:30.660923 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a427443-fe3d-4c17-9727-eec5effa55b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:30.661490 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a427443-fe3d-4c17-9727-eec5effa55b5 None admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:30.661771 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a427443-fe3d-4c17-9727-eec5effa55b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:30.662044 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a427443-fe3d-4c17-9727-eec5effa55b5 None admin] PATH_INFO: `/v3/users` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:30.662682 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a427443-fe3d-4c17-9727-eec5effa55b5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:00:30.664364 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a427443-fe3d-4c17-9727-eec5effa55b5 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:00:30.684649 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 596/1177] 10.222.0.49 () {60 vars in 1132 bytes} [Thu Sep 29 02:00:30 2022] POST /identity/v3/users => generated 311 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:00:32.864183 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f191b70c-de98-4da8-ac5e-988bef2c9ee3 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:32.864716 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f191b70c-de98-4da8-ac5e-988bef2c9ee3 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:32.864716 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f191b70c-de98-4da8-ac5e-988bef2c9ee3 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:32.866064 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 582/1178] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 02:00:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:00:32.871393 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f73437-c355-4c60-8f79-0d2a664d911a None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:32.871763 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f73437-c355-4c60-8f79-0d2a664d911a None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:32.871947 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f73437-c355-4c60-8f79-0d2a664d911a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:32.890606 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-13f73437-c355-4c60-8f79-0d2a664d911a None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:00:32.891793 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-13f73437-c355-4c60-8f79-0d2a664d911a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:00:32.941021 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:00:32.958492 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 597/1179] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 02:00:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 29 02:00:33.229936 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f191b70c-de98-4da8-ac5e-988bef2c9ee3 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:33.327949 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f191b70c-de98-4da8-ac5e-988bef2c9ee3 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:33.360817 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a035b18a-b31d-4fb5-b5dd-fece4771e12d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:33.361453 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a035b18a-b31d-4fb5-b5dd-fece4771e12d None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:33.361728 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a035b18a-b31d-4fb5-b5dd-fece4771e12d None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:33.361992 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a035b18a-b31d-4fb5-b5dd-fece4771e12d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:33.371621 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a035b18a-b31d-4fb5-b5dd-fece4771e12d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 02:00:33.376376 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-a035b18a-b31d-4fb5-b5dd-fece4771e12d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 02:00:33.376376 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 02:00:33.376376 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 02:00:33.376376 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 02:00:33.376376 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 02:00:33.376376 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 02:00:33.376376 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 02:00:33.376376 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 02:00:33.376376 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 02:00:33.376376 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 02:00:33.376376 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 02:00:33.376376 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 02:00:33.376376 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 02:00:33.376376 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 02:00:33.376376 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 02:00:33.376376 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 02:00:33.377524 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 02:00:33.377524 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 02:00:33.377524 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 02:00:33.377524 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 02:00:33.377524 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 02:00:33.377524 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 02:00:33.377524 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 02:00:33.377524 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 02:00:33.377524 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 02:00:33.377524 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 02:00:33.377524 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 02:00:33.377524 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 02:00:33.377524 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 02:00:33.377524 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 02:00:33.377524 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 02:00:33.377524 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 02:00:33.378388 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 02:00:33.378388 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 02:00:33.378388 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 02:00:33.378388 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 02:00:33.378388 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 02:00:33.378388 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 02:00:33.378388 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 02:00:33.378388 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 02:00:33.378388 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 02:00:33.378388 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 02:00:33.378388 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 02:00:33.378388 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 02:00:33.378388 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 583/1180] 10.222.0.49 () {56 vars in 1096 bytes} [Thu Sep 29 02:00:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 02:00:33.383450 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f73437-c355-4c60-8f79-0d2a664d911a None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:33.478818 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f73437-c355-4c60-8f79-0d2a664d911a None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:33.511401 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2bd0c7-496a-4431-9369-c7a8369fa6c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:33.511936 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2bd0c7-496a-4431-9369-c7a8369fa6c1 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:33.512209 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2bd0c7-496a-4431-9369-c7a8369fa6c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:33.512499 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2bd0c7-496a-4431-9369-c7a8369fa6c1 None admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:33.513146 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2bd0c7-496a-4431-9369-c7a8369fa6c1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:00:33.513470 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2bd0c7-496a-4431-9369-c7a8369fa6c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:00:33.514830 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2bd0c7-496a-4431-9369-c7a8369fa6c1 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:00:33.522477 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 598/1181] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Sep 29 02:00:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:00:33.528946 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a035b18a-b31d-4fb5-b5dd-fece4771e12d None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:33.563357 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:00:33.629047 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a035b18a-b31d-4fb5-b5dd-fece4771e12d None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:33.661084 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fd1f23-8484-40b6-b562-708a990491d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:33.661722 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fd1f23-8484-40b6-b562-708a990491d0 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:33.661997 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fd1f23-8484-40b6-b562-708a990491d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:33.662269 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fd1f23-8484-40b6-b562-708a990491d0 None admin] PATH_INFO: `/v3/users/70c3acf40b72488495f2cd45a9f5528b` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:33.676161 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fd1f23-8484-40b6-b562-708a990491d0 None admin] RBAC: Authorizing `identity:get_user(user_id=70c3acf40b72488495f2cd45a9f5528b)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:00:33.677596 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fd1f23-8484-40b6-b562-708a990491d0 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:00:33.679135 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 584/1182] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Sep 29 02:00:33 2022] GET /identity/v3/users/70c3acf40b72488495f2cd45a9f5528b => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:00:33.685657 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2bd0c7-496a-4431-9369-c7a8369fa6c1 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:33.733373 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:00:33.782378 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2bd0c7-496a-4431-9369-c7a8369fa6c1 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:33.815487 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e793510-a2c7-4a2c-9fef-14356bcfde41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:33.816075 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e793510-a2c7-4a2c-9fef-14356bcfde41 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:33.816349 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e793510-a2c7-4a2c-9fef-14356bcfde41 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:33.816614 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e793510-a2c7-4a2c-9fef-14356bcfde41 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:33.880622 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e793510-a2c7-4a2c-9fef-14356bcfde41 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:00:33.882068 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e793510-a2c7-4a2c-9fef-14356bcfde41 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:00:33.930155 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:00:33.981030 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 599/1183] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Sep 29 02:00:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 29 02:00:33.986946 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fd1f23-8484-40b6-b562-708a990491d0 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:34.073778 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:00:34.082721 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fd1f23-8484-40b6-b562-708a990491d0 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:34.115895 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8233040-94b0-428e-aacb-49634b95a6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:34.116502 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8233040-94b0-428e-aacb-49634b95a6bb None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:34.116775 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8233040-94b0-428e-aacb-49634b95a6bb None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:34.117043 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8233040-94b0-428e-aacb-49634b95a6bb None admin] PATH_INFO: `/v3/projects/51bfa928a2ca46a9b5161cb8129747f9` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:34.118281 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8233040-94b0-428e-aacb-49634b95a6bb None admin] RBAC: Authorizing `identity:get_project(project_id=51bfa928a2ca46a9b5161cb8129747f9)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:00:34.119719 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8233040-94b0-428e-aacb-49634b95a6bb None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:00:34.121297 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 585/1184] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Sep 29 02:00:33 2022] GET /identity/v3/projects/51bfa928a2ca46a9b5161cb8129747f9 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:00:34.127366 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e793510-a2c7-4a2c-9fef-14356bcfde41 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:34.221422 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e793510-a2c7-4a2c-9fef-14356bcfde41 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:34.253782 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fcbb70-2d3c-4283-91cc-d01a27963d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:34.254364 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fcbb70-2d3c-4283-91cc-d01a27963d66 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:34.254640 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fcbb70-2d3c-4283-91cc-d01a27963d66 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:34.254907 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fcbb70-2d3c-4283-91cc-d01a27963d66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:34.255609 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fcbb70-2d3c-4283-91cc-d01a27963d66 None admin] RBAC: Adding query filter params (role.id=fe9bbc67742f4f5893f39b18eb31d59a, scope.project.id=51bfa928a2ca46a9b5161cb8129747f9, user.id=70c3acf40b72488495f2cd45a9f5528b) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:00:34.255910 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fcbb70-2d3c-4283-91cc-d01a27963d66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:00:34.257341 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fcbb70-2d3c-4283-91cc-d01a27963d66 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:00:34.262940 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 600/1185] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Sep 29 02:00:34 2022] GET /identity/v3/role_assignments?user.id=70c3acf40b72488495f2cd45a9f5528b&scope.project.id=51bfa928a2ca46a9b5161cb8129747f9&role.id=fe9bbc67742f4f5893f39b18eb31d59a => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:00:36.415801 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86df139-9fb4-4a13-9dd8-77eee06ecc4a None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:36.416331 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86df139-9fb4-4a13-9dd8-77eee06ecc4a None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:36.416331 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86df139-9fb4-4a13-9dd8-77eee06ecc4a None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:36.417718 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 586/1186] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 02:00:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:00:36.422976 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee004ce-c277-4d3b-8ebf-656cdc2b1d59 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:36.423388 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee004ce-c277-4d3b-8ebf-656cdc2b1d59 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:36.423515 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee004ce-c277-4d3b-8ebf-656cdc2b1d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:36.441254 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-dee004ce-c277-4d3b-8ebf-656cdc2b1d59 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:00:36.442469 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-dee004ce-c277-4d3b-8ebf-656cdc2b1d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:00:36.449709 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:00:36.507365 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 601/1187] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 02:00:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 29 02:00:36.785665 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86df139-9fb4-4a13-9dd8-77eee06ecc4a None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:36.914709 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86df139-9fb4-4a13-9dd8-77eee06ecc4a None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:36.953636 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da4515d-977d-4314-b065-6dad7655cb20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:36.954255 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4515d-977d-4314-b065-6dad7655cb20 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:36.954529 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4515d-977d-4314-b065-6dad7655cb20 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:36.954798 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4515d-977d-4314-b065-6dad7655cb20 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:36.966889 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da4515d-977d-4314-b065-6dad7655cb20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 02:00:36.971870 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-2da4515d-977d-4314-b065-6dad7655cb20 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 02:00:36.971870 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 02:00:36.971870 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 02:00:36.971870 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 02:00:36.971870 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 02:00:36.971870 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 02:00:36.971870 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 02:00:36.971870 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 02:00:36.971870 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 02:00:36.971870 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 02:00:36.971870 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 02:00:36.971870 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 02:00:36.971870 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 02:00:36.971870 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 02:00:36.971870 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 02:00:36.971870 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 02:00:36.973124 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 02:00:36.973124 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 02:00:36.973124 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 02:00:36.973124 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 02:00:36.973124 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 02:00:36.973124 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 02:00:36.973124 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 02:00:36.973124 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 02:00:36.973124 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 02:00:36.973124 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 02:00:36.973124 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 02:00:36.973124 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 02:00:36.973124 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 02:00:36.973124 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 02:00:36.973124 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 02:00:36.973124 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 02:00:36.974011 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 02:00:36.974011 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 02:00:36.974011 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 02:00:36.974011 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 02:00:36.974011 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 02:00:36.974011 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 02:00:36.974011 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 02:00:36.974011 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 02:00:36.974011 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 02:00:36.974011 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 02:00:36.974011 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 02:00:36.974011 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 02:00:36.974011 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 587/1188] 10.222.0.49 () {56 vars in 1096 bytes} [Thu Sep 29 02:00:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 02:00:36.979526 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee004ce-c277-4d3b-8ebf-656cdc2b1d59 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:37.120017 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee004ce-c277-4d3b-8ebf-656cdc2b1d59 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:37.157831 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0ec670-2389-48e1-89d7-cec8abd7c76e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:37.158445 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ec670-2389-48e1-89d7-cec8abd7c76e None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:37.158725 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ec670-2389-48e1-89d7-cec8abd7c76e None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:37.158998 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ec670-2389-48e1-89d7-cec8abd7c76e None admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:37.159658 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0ec670-2389-48e1-89d7-cec8abd7c76e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:00:37.159960 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0ec670-2389-48e1-89d7-cec8abd7c76e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:00:37.161361 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0ec670-2389-48e1-89d7-cec8abd7c76e None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:00:37.170290 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 602/1189] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Sep 29 02:00:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:00:37.176265 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da4515d-977d-4314-b065-6dad7655cb20 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:37.202891 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:00:37.288594 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da4515d-977d-4314-b065-6dad7655cb20 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:37.325539 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47872f3a-83e6-4e04-b495-cdd3c703fe31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:37.326431 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47872f3a-83e6-4e04-b495-cdd3c703fe31 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:37.326707 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47872f3a-83e6-4e04-b495-cdd3c703fe31 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:37.326973 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47872f3a-83e6-4e04-b495-cdd3c703fe31 None admin] PATH_INFO: `/v3/users/70c3acf40b72488495f2cd45a9f5528b` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:37.328095 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47872f3a-83e6-4e04-b495-cdd3c703fe31 None admin] RBAC: Authorizing `identity:get_user(user_id=70c3acf40b72488495f2cd45a9f5528b)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:00:37.329743 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47872f3a-83e6-4e04-b495-cdd3c703fe31 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:00:37.331322 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 588/1190] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Sep 29 02:00:37 2022] GET /identity/v3/users/70c3acf40b72488495f2cd45a9f5528b => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:00:37.338052 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0ec670-2389-48e1-89d7-cec8abd7c76e None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:37.342121 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:00:37.457982 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0ec670-2389-48e1-89d7-cec8abd7c76e None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:37.493744 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b188b7b1-a1b6-43c3-a44d-560c8b1ea602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:37.494366 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b188b7b1-a1b6-43c3-a44d-560c8b1ea602 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:37.494642 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b188b7b1-a1b6-43c3-a44d-560c8b1ea602 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:37.494905 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b188b7b1-a1b6-43c3-a44d-560c8b1ea602 None admin] PATH_INFO: `/v3/projects/51bfa928a2ca46a9b5161cb8129747f9` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:37.496006 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b188b7b1-a1b6-43c3-a44d-560c8b1ea602 None admin] RBAC: Authorizing `identity:get_project(project_id=51bfa928a2ca46a9b5161cb8129747f9)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:00:37.497450 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b188b7b1-a1b6-43c3-a44d-560c8b1ea602 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:00:37.499065 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 603/1191] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Sep 29 02:00:37 2022] GET /identity/v3/projects/51bfa928a2ca46a9b5161cb8129747f9 => generated 361 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:00:37.505145 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47872f3a-83e6-4e04-b495-cdd3c703fe31 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:37.589729 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:00:37.601400 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47872f3a-83e6-4e04-b495-cdd3c703fe31 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:37.634520 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed8f258-63c7-48e4-bed8-e514e7970499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:37.635155 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8f258-63c7-48e4-bed8-e514e7970499 None admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:37.635426 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8f258-63c7-48e4-bed8-e514e7970499 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:37.635691 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8f258-63c7-48e4-bed8-e514e7970499 None admin] PATH_INFO: `/v3/projects/51bfa928a2ca46a9b5161cb8129747f9/users/70c3acf40b72488495f2cd45a9f5528b/roles/fe9bbc67742f4f5893f39b18eb31d59a` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:37.637582 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed8f258-63c7-48e4-bed8-e514e7970499 None admin] RBAC: Authorizing `identity:create_grant(project_id=51bfa928a2ca46a9b5161cb8129747f9, user_id=70c3acf40b72488495f2cd45a9f5528b, role_id=fe9bbc67742f4f5893f39b18eb31d59a)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:00:37.638987 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed8f258-63c7-48e4-bed8-e514e7970499 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:00:37.651887 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 589/1192] 10.222.0.49 () {58 vars in 1439 bytes} [Thu Sep 29 02:00:37 2022] PUT /identity/v3/projects/51bfa928a2ca46a9b5161cb8129747f9/users/70c3acf40b72488495f2cd45a9f5528b/roles/fe9bbc67742f4f5893f39b18eb31d59a => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:00:39.761211 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4c50b-94a1-4edc-a952-bfeb11272066 None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:39.761903 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4c50b-94a1-4edc-a952-bfeb11272066 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:39.761903 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4c50b-94a1-4edc-a952-bfeb11272066 None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:39.763104 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 604/1193] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 02:00:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:00:39.768189 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba8fe4-199d-44f1-b75c-f5fa236deec1 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:39.768630 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba8fe4-199d-44f1-b75c-f5fa236deec1 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:39.768726 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba8fe4-199d-44f1-b75c-f5fa236deec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:39.787138 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-84ba8fe4-199d-44f1-b75c-f5fa236deec1 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:00:39.788599 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-84ba8fe4-199d-44f1-b75c-f5fa236deec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:00:39.852674 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 590/1194] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 02:00:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 29 02:00:40.122554 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d4c50b-94a1-4edc-a952-bfeb11272066 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:40.192094 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:00:40.221914 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d4c50b-94a1-4edc-a952-bfeb11272066 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:40.254728 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31482be8-e784-4c48-ab7f-f5c3e46340be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:40.255344 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31482be8-e784-4c48-ab7f-f5c3e46340be None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:40.255626 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31482be8-e784-4c48-ab7f-f5c3e46340be None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:40.255899 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31482be8-e784-4c48-ab7f-f5c3e46340be None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:40.265837 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31482be8-e784-4c48-ab7f-f5c3e46340be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 02:00:40.270639 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-31482be8-e784-4c48-ab7f-f5c3e46340be None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 02:00:40.270639 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 02:00:40.270639 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 02:00:40.270639 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 02:00:40.270639 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 02:00:40.270639 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 02:00:40.270639 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 02:00:40.270639 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 02:00:40.270639 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 02:00:40.270639 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 02:00:40.270639 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 02:00:40.270639 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 02:00:40.270639 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 02:00:40.270639 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 02:00:40.270639 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 02:00:40.270639 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 02:00:40.271720 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 02:00:40.271720 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 02:00:40.271720 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 02:00:40.271720 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 02:00:40.271720 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 02:00:40.271720 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 02:00:40.271720 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 02:00:40.271720 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 02:00:40.271720 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 02:00:40.271720 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 02:00:40.271720 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 02:00:40.271720 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 02:00:40.271720 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 02:00:40.271720 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 02:00:40.271720 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 02:00:40.271720 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 02:00:40.272671 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 02:00:40.272671 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 02:00:40.272671 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 02:00:40.272671 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 02:00:40.272671 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 02:00:40.272671 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 02:00:40.272671 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 02:00:40.272671 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 02:00:40.272671 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 02:00:40.272671 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 02:00:40.272671 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 02:00:40.272671 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 02:00:40.272671 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 605/1195] 10.222.0.49 () {56 vars in 1096 bytes} [Thu Sep 29 02:00:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 02:00:40.277774 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ba8fe4-199d-44f1-b75c-f5fa236deec1 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:40.352918 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:00:40.375761 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ba8fe4-199d-44f1-b75c-f5fa236deec1 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:40.407649 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d37dbb5-6470-4d55-9c51-00a354c7d675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:40.408240 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d37dbb5-6470-4d55-9c51-00a354c7d675 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:40.408516 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d37dbb5-6470-4d55-9c51-00a354c7d675 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:40.408783 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d37dbb5-6470-4d55-9c51-00a354c7d675 None admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:40.409461 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d37dbb5-6470-4d55-9c51-00a354c7d675 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:00:40.409761 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d37dbb5-6470-4d55-9c51-00a354c7d675 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:00:40.411097 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d37dbb5-6470-4d55-9c51-00a354c7d675 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:00:40.419703 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 591/1196] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Sep 29 02:00:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:00:40.425497 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31482be8-e784-4c48-ab7f-f5c3e46340be None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:40.521411 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31482be8-e784-4c48-ab7f-f5c3e46340be None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:40.549887 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:00:40.555313 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efc5842-f572-4e53-aeb2-bf711acabfa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:40.555928 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc5842-f572-4e53-aeb2-bf711acabfa9 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:40.556206 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc5842-f572-4e53-aeb2-bf711acabfa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:40.556477 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc5842-f572-4e53-aeb2-bf711acabfa9 None admin] PATH_INFO: `/v3/users/70c3acf40b72488495f2cd45a9f5528b` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:40.557612 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efc5842-f572-4e53-aeb2-bf711acabfa9 None admin] RBAC: Authorizing `identity:get_user(user_id=70c3acf40b72488495f2cd45a9f5528b)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:00:40.559042 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efc5842-f572-4e53-aeb2-bf711acabfa9 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:00:40.560594 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 606/1197] 10.222.0.49 () {56 vars in 1177 bytes} [Thu Sep 29 02:00:40 2022] GET /identity/v3/users/70c3acf40b72488495f2cd45a9f5528b => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:00:40.566231 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d37dbb5-6470-4d55-9c51-00a354c7d675 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:40.663525 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d37dbb5-6470-4d55-9c51-00a354c7d675 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:40.696937 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040728b9-7a9d-4168-acdc-6a97d196f549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:40.697557 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040728b9-7a9d-4168-acdc-6a97d196f549 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:40.697837 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040728b9-7a9d-4168-acdc-6a97d196f549 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:40.698103 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040728b9-7a9d-4168-acdc-6a97d196f549 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:40.708099 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:00:40.763805 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040728b9-7a9d-4168-acdc-6a97d196f549 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:00:40.765223 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040728b9-7a9d-4168-acdc-6a97d196f549 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:00:40.860988 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 592/1198] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Sep 29 02:00:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 29 02:00:40.866891 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efc5842-f572-4e53-aeb2-bf711acabfa9 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:40.963515 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efc5842-f572-4e53-aeb2-bf711acabfa9 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:40.995433 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d701a8-5da9-4981-9820-bd243e29d6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:40.996042 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d701a8-5da9-4981-9820-bd243e29d6cc None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:40.996316 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d701a8-5da9-4981-9820-bd243e29d6cc None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:40.996583 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d701a8-5da9-4981-9820-bd243e29d6cc None admin] PATH_INFO: `/v3/projects/51bfa928a2ca46a9b5161cb8129747f9` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:40.997690 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d701a8-5da9-4981-9820-bd243e29d6cc None admin] RBAC: Authorizing `identity:get_project(project_id=51bfa928a2ca46a9b5161cb8129747f9)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:00:40.999096 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d701a8-5da9-4981-9820-bd243e29d6cc None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:00:41.000677 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 607/1199] 10.222.0.49 () {56 vars in 1186 bytes} [Thu Sep 29 02:00:40 2022] GET /identity/v3/projects/51bfa928a2ca46a9b5161cb8129747f9 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:00:41.006909 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040728b9-7a9d-4168-acdc-6a97d196f549 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:00:41.047771 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:00:41.104102 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040728b9-7a9d-4168-acdc-6a97d196f549 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:00:41.136734 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee00d56-c3d8-49aa-a9b7-bbaac7c68c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:00:41.137351 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee00d56-c3d8-49aa-a9b7-bbaac7c68c71 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:00:41.137631 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee00d56-c3d8-49aa-a9b7-bbaac7c68c71 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:00:41.137904 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee00d56-c3d8-49aa-a9b7-bbaac7c68c71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:00:41.138617 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee00d56-c3d8-49aa-a9b7-bbaac7c68c71 None admin] RBAC: Adding query filter params (role.id=fe9bbc67742f4f5893f39b18eb31d59a, scope.project.id=51bfa928a2ca46a9b5161cb8129747f9, user.id=70c3acf40b72488495f2cd45a9f5528b) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:00:41.138921 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee00d56-c3d8-49aa-a9b7-bbaac7c68c71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:00:41.140323 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee00d56-c3d8-49aa-a9b7-bbaac7c68c71 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:00:41.145968 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 593/1200] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Sep 29 02:00:41 2022] GET /identity/v3/role_assignments?user.id=70c3acf40b72488495f2cd45a9f5528b&scope.project.id=51bfa928a2ca46a9b5161cb8129747f9&role.id=fe9bbc67742f4f5893f39b18eb31d59a => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:00:50.990832 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=66 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:00:51.143395 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=48 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:01:36.777739 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e46bdf-3a90-445d-a01a-ea8a4538ebb6 None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:36.778392 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e46bdf-3a90-445d-a01a-ea8a4538ebb6 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:36.778392 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e46bdf-3a90-445d-a01a-ea8a4538ebb6 None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:36.779716 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 608/1201] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 02:01:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:01:36.786320 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753bbece-7fb3-4fed-b829-a1338247a291 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:36.786850 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753bbece-7fb3-4fed-b829-a1338247a291 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:36.786850 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753bbece-7fb3-4fed-b829-a1338247a291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:36.807100 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-753bbece-7fb3-4fed-b829-a1338247a291 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:01:36.808467 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-753bbece-7fb3-4fed-b829-a1338247a291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:01:36.901069 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 594/1202] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 02:01:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 29 02:01:37.220648 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e46bdf-3a90-445d-a01a-ea8a4538ebb6 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:01:37.362316 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e46bdf-3a90-445d-a01a-ea8a4538ebb6 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:01:37.405388 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee2a847-f6f5-46fa-9eda-bfd9707e83fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:01:37.406113 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee2a847-f6f5-46fa-9eda-bfd9707e83fa None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:37.406416 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee2a847-f6f5-46fa-9eda-bfd9707e83fa None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:37.406662 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee2a847-f6f5-46fa-9eda-bfd9707e83fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:37.422061 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee2a847-f6f5-46fa-9eda-bfd9707e83fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:01:37.423738 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee2a847-f6f5-46fa-9eda-bfd9707e83fa None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:01:37.445055 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-9ee2a847-f6f5-46fa-9eda-bfd9707e83fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 02:01:37.445055 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 02:01:37.445055 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 02:01:37.445055 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 02:01:37.445055 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 02:01:37.445055 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 02:01:37.445055 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 02:01:37.445055 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 02:01:37.445055 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 02:01:37.445055 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 02:01:37.445055 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 02:01:37.445055 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 02:01:37.445055 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 02:01:37.445055 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 02:01:37.445055 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 02:01:37.445055 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 02:01:37.446299 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 02:01:37.446299 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 02:01:37.446299 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 02:01:37.446299 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 02:01:37.446299 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 02:01:37.446299 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 02:01:37.446299 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 02:01:37.446299 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 02:01:37.446299 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 02:01:37.446299 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 02:01:37.446299 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 02:01:37.446299 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 02:01:37.446299 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 02:01:37.446299 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 02:01:37.446299 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 02:01:37.446299 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 02:01:37.446299 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 02:01:37.447274 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 02:01:37.447274 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 02:01:37.447274 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 02:01:37.447274 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 609/1203] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 02:01:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 02:01:37.451352 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753bbece-7fb3-4fed-b829-a1338247a291 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:01:37.581512 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753bbece-7fb3-4fed-b829-a1338247a291 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:01:37.624273 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:01:37.631462 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99331586-0e25-43e0-b184-e834d49bf3c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:01:37.632617 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99331586-0e25-43e0-b184-e834d49bf3c1 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:37.632897 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99331586-0e25-43e0-b184-e834d49bf3c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:37.633168 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99331586-0e25-43e0-b184-e834d49bf3c1 None admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:37.633903 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99331586-0e25-43e0-b184-e834d49bf3c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:01:37.634255 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99331586-0e25-43e0-b184-e834d49bf3c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:01:37.635781 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99331586-0e25-43e0-b184-e834d49bf3c1 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:01:37.650318 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 595/1204] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Sep 29 02:01:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:01:37.656980 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee2a847-f6f5-46fa-9eda-bfd9707e83fa None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:01:37.729867 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:01:37.790432 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee2a847-f6f5-46fa-9eda-bfd9707e83fa None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:01:37.841442 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d34c973-d4a9-48c7-9e99-8c6f52547063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:01:37.841442 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d34c973-d4a9-48c7-9e99-8c6f52547063 None admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:37.841442 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d34c973-d4a9-48c7-9e99-8c6f52547063 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:37.841442 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d34c973-d4a9-48c7-9e99-8c6f52547063 None admin] PATH_INFO: `/v3/users` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:37.842053 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d34c973-d4a9-48c7-9e99-8c6f52547063 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:01:37.843546 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d34c973-d4a9-48c7-9e99-8c6f52547063 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:01:37.877685 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 610/1205] 10.222.0.49 () {60 vars in 1132 bytes} [Thu Sep 29 02:01:37 2022] POST /identity/v3/users => generated 251 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:01:40.524512 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8fdd73-810c-4e9f-b50c-bd27cf42ae50 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:40.525117 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8fdd73-810c-4e9f-b50c-bd27cf42ae50 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:40.525117 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8fdd73-810c-4e9f-b50c-bd27cf42ae50 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:40.526491 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 596/1206] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 02:01:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:01:40.532749 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835273e4-6982-4a8a-8e55-9bda4e472223 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:40.533211 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835273e4-6982-4a8a-8e55-9bda4e472223 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:40.533300 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835273e4-6982-4a8a-8e55-9bda4e472223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:40.554060 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-835273e4-6982-4a8a-8e55-9bda4e472223 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:01:40.555638 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-835273e4-6982-4a8a-8e55-9bda4e472223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:01:40.641681 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 611/1207] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 02:01:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 29 02:01:40.931761 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8fdd73-810c-4e9f-b50c-bd27cf42ae50 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:01:41.061363 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8fdd73-810c-4e9f-b50c-bd27cf42ae50 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:01:41.104246 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d28d90d-4a33-41ef-873f-8ad11ffbdb9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:01:41.104858 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d28d90d-4a33-41ef-873f-8ad11ffbdb9b None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:41.105145 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d28d90d-4a33-41ef-873f-8ad11ffbdb9b None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:41.105433 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d28d90d-4a33-41ef-873f-8ad11ffbdb9b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:41.122405 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d28d90d-4a33-41ef-873f-8ad11ffbdb9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 02:01:41.128535 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-2d28d90d-4a33-41ef-873f-8ad11ffbdb9b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 29 02:01:41.128535 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 02:01:41.128535 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 02:01:41.128535 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 02:01:41.128535 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 02:01:41.128535 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 02:01:41.128535 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 02:01:41.128535 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 02:01:41.128535 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 02:01:41.128535 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 02:01:41.128535 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 02:01:41.128535 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 02:01:41.128535 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 02:01:41.128535 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 02:01:41.128535 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 02:01:41.128535 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 02:01:41.129600 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 02:01:41.129600 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 02:01:41.129600 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 02:01:41.129600 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 02:01:41.129600 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 02:01:41.129600 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 02:01:41.129600 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 02:01:41.129600 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 02:01:41.129600 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 02:01:41.129600 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 02:01:41.129600 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 02:01:41.129600 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 02:01:41.129600 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 02:01:41.129600 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 02:01:41.129600 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 02:01:41.129600 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 02:01:41.130452 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 02:01:41.130452 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 02:01:41.130452 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 02:01:41.130452 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 02:01:41.130452 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 02:01:41.130452 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 02:01:41.130452 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 02:01:41.130452 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 02:01:41.130452 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 02:01:41.130452 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 02:01:41.130452 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 29 02:01:41.130452 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 02:01:41.130452 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 597/1208] 10.222.0.49 () {56 vars in 1102 bytes} [Thu Sep 29 02:01:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 02:01:41.138246 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835273e4-6982-4a8a-8e55-9bda4e472223 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:01:41.187438 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:01:41.275924 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835273e4-6982-4a8a-8e55-9bda4e472223 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:01:41.316044 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15514e00-a75c-4952-86bb-9898900f90e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:01:41.316044 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15514e00-a75c-4952-86bb-9898900f90e2 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:41.316362 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15514e00-a75c-4952-86bb-9898900f90e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:41.316617 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15514e00-a75c-4952-86bb-9898900f90e2 None admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:41.317163 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15514e00-a75c-4952-86bb-9898900f90e2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:01:41.317837 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15514e00-a75c-4952-86bb-9898900f90e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:01:41.318975 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15514e00-a75c-4952-86bb-9898900f90e2 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:01:41.329349 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 612/1209] 10.222.0.49 () {56 vars in 1103 bytes} [Thu Sep 29 02:01:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 02:01:41.336121 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d28d90d-4a33-41ef-873f-8ad11ffbdb9b None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:01:41.395949 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:01:41.456667 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d28d90d-4a33-41ef-873f-8ad11ffbdb9b None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:01:41.505545 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1a466a-5238-4b86-81f1-2babdfe48016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:01:41.506181 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a466a-5238-4b86-81f1-2babdfe48016 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:41.506457 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a466a-5238-4b86-81f1-2babdfe48016 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:41.506728 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a466a-5238-4b86-81f1-2babdfe48016 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:41.520109 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1a466a-5238-4b86-81f1-2babdfe48016 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:01:41.521883 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1a466a-5238-4b86-81f1-2babdfe48016 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:01:41.539117 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-2b1a466a-5238-4b86-81f1-2babdfe48016 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 02:01:41.539117 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 02:01:41.539117 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 02:01:41.539117 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 02:01:41.539117 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 02:01:41.539117 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 02:01:41.539117 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 02:01:41.539117 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 02:01:41.539117 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 02:01:41.539117 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 02:01:41.539117 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 02:01:41.539117 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 02:01:41.539117 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 02:01:41.539117 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 02:01:41.539117 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 02:01:41.539117 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 02:01:41.540908 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 02:01:41.540908 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 02:01:41.540908 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 02:01:41.540908 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 02:01:41.540908 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 02:01:41.540908 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 02:01:41.540908 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 02:01:41.540908 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 02:01:41.540908 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 02:01:41.540908 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 02:01:41.540908 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 02:01:41.540908 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 02:01:41.540908 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 02:01:41.540908 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 02:01:41.540908 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 02:01:41.540908 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 02:01:41.540908 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 02:01:41.541904 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 02:01:41.541904 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 02:01:41.541904 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 02:01:41.541904 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 598/1210] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 02:01:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 02:01:41.546841 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15514e00-a75c-4952-86bb-9898900f90e2 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:01:41.669460 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:01:41.673343 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15514e00-a75c-4952-86bb-9898900f90e2 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:01:41.713713 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470a2aea-f36a-48ad-a844-8f946b48ce87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:01:41.714415 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a2aea-f36a-48ad-a844-8f946b48ce87 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:41.714783 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a2aea-f36a-48ad-a844-8f946b48ce87 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:41.715204 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a2aea-f36a-48ad-a844-8f946b48ce87 None admin] PATH_INFO: `/v3/domains` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:41.716014 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470a2aea-f36a-48ad-a844-8f946b48ce87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:01:41.716417 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470a2aea-f36a-48ad-a844-8f946b48ce87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:01:41.718063 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470a2aea-f36a-48ad-a844-8f946b48ce87 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:01:41.731418 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 613/1211] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Sep 29 02:01:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:01:41.737920 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1a466a-5238-4b86-81f1-2babdfe48016 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:01:41.845832 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1a466a-5238-4b86-81f1-2babdfe48016 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:01:41.848223 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:01:41.882055 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aba66bc-a68e-44f6-9510-10e64a5ec956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:01:41.882780 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba66bc-a68e-44f6-9510-10e64a5ec956 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:41.883129 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba66bc-a68e-44f6-9510-10e64a5ec956 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:41.883474 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba66bc-a68e-44f6-9510-10e64a5ec956 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:41.891901 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aba66bc-a68e-44f6-9510-10e64a5ec956 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:01:41.893691 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aba66bc-a68e-44f6-9510-10e64a5ec956 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:01:41.905806 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-3aba66bc-a68e-44f6-9510-10e64a5ec956 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 29 02:01:41.905806 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 02:01:41.905806 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 02:01:41.905806 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 02:01:41.905806 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 02:01:41.905806 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 02:01:41.905806 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 02:01:41.905806 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 02:01:41.905806 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 02:01:41.905806 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 02:01:41.905806 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 02:01:41.905806 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 02:01:41.905806 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 29 02:01:41.905806 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 29 02:01:41.905806 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 29 02:01:41.905806 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 29 02:01:41.906999 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 02:01:41.906999 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 02:01:41.906999 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 29 02:01:41.906999 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 02:01:41.906999 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 29 02:01:41.906999 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 02:01:41.906999 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 02:01:41.906999 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 02:01:41.906999 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 02:01:41.906999 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 02:01:41.906999 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 02:01:41.906999 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 02:01:41.906999 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 02:01:41.906999 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 02:01:41.906999 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 02:01:41.906999 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 02:01:41.906999 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 02:01:41.906999 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 02:01:41.908193 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 02:01:41.908193 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 02:01:41.908193 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 29 02:01:41.908193 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 29 02:01:41.908193 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 29 02:01:41.908193 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 29 02:01:41.908193 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 29 02:01:41.908193 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 29 02:01:41.908193 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 29 02:01:41.908193 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 02:01:41.913809 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 599/1212] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 02:01:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 02:01:41.915758 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470a2aea-f36a-48ad-a844-8f946b48ce87 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:01:42.032488 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470a2aea-f36a-48ad-a844-8f946b48ce87 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:01:42.070830 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecca37c6-e68f-4689-ae0a-c0df1d7dfd0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:01:42.071631 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca37c6-e68f-4689-ae0a-c0df1d7dfd0a None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:42.072008 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca37c6-e68f-4689-ae0a-c0df1d7dfd0a None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:42.072378 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca37c6-e68f-4689-ae0a-c0df1d7dfd0a None admin] PATH_INFO: `/v3/users` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:42.073201 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecca37c6-e68f-4689-ae0a-c0df1d7dfd0a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:01:42.073848 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecca37c6-e68f-4689-ae0a-c0df1d7dfd0a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:01:42.075791 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecca37c6-e68f-4689-ae0a-c0df1d7dfd0a None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:01:42.097640 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 614/1213] 10.222.0.49 () {56 vars in 1143 bytes} [Thu Sep 29 02:01:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:01:42.103975 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aba66bc-a68e-44f6-9510-10e64a5ec956 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:01:42.222422 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aba66bc-a68e-44f6-9510-10e64a5ec956 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:01:42.263395 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2c9848-1d32-4d92-aa3d-77f0beba2093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:01:42.264008 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c9848-1d32-4d92-aa3d-77f0beba2093 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:42.264302 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c9848-1d32-4d92-aa3d-77f0beba2093 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:42.264570 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c9848-1d32-4d92-aa3d-77f0beba2093 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:42.304469 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:01:42.352223 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2c9848-1d32-4d92-aa3d-77f0beba2093 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:01:42.353927 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2c9848-1d32-4d92-aa3d-77f0beba2093 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:01:42.469539 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 600/1214] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Sep 29 02:01:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 29 02:01:42.474442 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecca37c6-e68f-4689-ae0a-c0df1d7dfd0a None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:01:42.496899 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:01:42.596189 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecca37c6-e68f-4689-ae0a-c0df1d7dfd0a None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:01:42.648100 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796ae13a-c8be-4f98-ae1d-b7d0b1880e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:01:42.648792 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ae13a-c8be-4f98-ae1d-b7d0b1880e29 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:42.649114 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ae13a-c8be-4f98-ae1d-b7d0b1880e29 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:42.649394 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ae13a-c8be-4f98-ae1d-b7d0b1880e29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:42.663063 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796ae13a-c8be-4f98-ae1d-b7d0b1880e29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:01:42.664524 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796ae13a-c8be-4f98-ae1d-b7d0b1880e29 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:01:42.682804 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-796ae13a-c8be-4f98-ae1d-b7d0b1880e29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 02:01:42.682804 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 02:01:42.682804 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 02:01:42.682804 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 02:01:42.682804 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 02:01:42.682804 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 02:01:42.682804 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 02:01:42.682804 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 02:01:42.682804 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 02:01:42.682804 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 02:01:42.682804 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 02:01:42.682804 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 02:01:42.682804 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 02:01:42.682804 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 02:01:42.682804 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 02:01:42.682804 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 02:01:42.684151 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 02:01:42.684151 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 02:01:42.684151 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 02:01:42.684151 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 02:01:42.684151 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 02:01:42.684151 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 02:01:42.684151 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 02:01:42.684151 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 02:01:42.684151 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 02:01:42.684151 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 02:01:42.684151 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 02:01:42.684151 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 02:01:42.684151 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 02:01:42.684151 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 02:01:42.684151 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 02:01:42.684151 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 02:01:42.684151 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 02:01:42.685218 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 02:01:42.685218 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 02:01:42.685218 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 02:01:42.685218 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 615/1215] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 02:01:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 02:01:42.691441 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2c9848-1d32-4d92-aa3d-77f0beba2093 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:01:42.770020 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:01:42.811842 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2c9848-1d32-4d92-aa3d-77f0beba2093 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:01:42.849106 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7238c9f-aa9a-4531-810a-4014d52b25a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:01:42.849644 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7238c9f-aa9a-4531-810a-4014d52b25a5 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:42.849926 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7238c9f-aa9a-4531-810a-4014d52b25a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:42.850205 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7238c9f-aa9a-4531-810a-4014d52b25a5 None admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:42.850927 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7238c9f-aa9a-4531-810a-4014d52b25a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:01:42.851227 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7238c9f-aa9a-4531-810a-4014d52b25a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:01:42.852725 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7238c9f-aa9a-4531-810a-4014d52b25a5 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:01:42.870744 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 601/1216] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Sep 29 02:01:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 02:01:42.872692 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796ae13a-c8be-4f98-ae1d-b7d0b1880e29 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:01:42.957149 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:01:42.993760 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796ae13a-c8be-4f98-ae1d-b7d0b1880e29 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:01:43.033111 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc4859d-d184-4721-b4ee-3ead95a61a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:01:43.034080 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc4859d-d184-4721-b4ee-3ead95a61a2a None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:43.034356 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc4859d-d184-4721-b4ee-3ead95a61a2a None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:43.034621 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc4859d-d184-4721-b4ee-3ead95a61a2a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:43.042369 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc4859d-d184-4721-b4ee-3ead95a61a2a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:01:43.043940 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc4859d-d184-4721-b4ee-3ead95a61a2a None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:01:43.056045 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-fcc4859d-d184-4721-b4ee-3ead95a61a2a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 02:01:43.056045 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 02:01:43.056045 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 02:01:43.056045 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 02:01:43.056045 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 02:01:43.056045 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 02:01:43.056045 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 02:01:43.056045 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 02:01:43.056045 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 02:01:43.056045 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 02:01:43.056045 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 02:01:43.056045 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 02:01:43.056045 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 29 02:01:43.056045 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 29 02:01:43.056045 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 29 02:01:43.057020 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 29 02:01:43.057020 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 02:01:43.057020 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 02:01:43.057020 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 02:01:43.057020 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 02:01:43.057020 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 02:01:43.057020 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 02:01:43.057020 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 02:01:43.057020 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 02:01:43.057020 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 02:01:43.057020 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 02:01:43.057020 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 02:01:43.057020 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 02:01:43.057020 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 02:01:43.057020 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 02:01:43.057020 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 02:01:43.057020 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 02:01:43.058184 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 29 02:01:43.058184 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 29 02:01:43.058184 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 29 02:01:43.058184 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 29 02:01:43.058184 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 29 02:01:43.058184 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 29 02:01:43.058184 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 02:01:43.058184 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 02:01:43.058184 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 616/1217] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Sep 29 02:01:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 02:01:43.063430 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7238c9f-aa9a-4531-810a-4014d52b25a5 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:01:43.180111 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7238c9f-aa9a-4531-810a-4014d52b25a5 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:01:43.206821 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:01:43.219257 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625af3f1-3f3f-4d29-98d3-f1abd2ec3d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:01:43.219860 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625af3f1-3f3f-4d29-98d3-f1abd2ec3d9b None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:43.220138 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625af3f1-3f3f-4d29-98d3-f1abd2ec3d9b None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:43.220406 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625af3f1-3f3f-4d29-98d3-f1abd2ec3d9b None admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:43.221094 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625af3f1-3f3f-4d29-98d3-f1abd2ec3d9b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:01:43.221426 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625af3f1-3f3f-4d29-98d3-f1abd2ec3d9b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:01:43.222834 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625af3f1-3f3f-4d29-98d3-f1abd2ec3d9b None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:01:43.235651 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 602/1218] 10.222.0.49 () {56 vars in 1148 bytes} [Thu Sep 29 02:01:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:01:43.242763 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc4859d-d184-4721-b4ee-3ead95a61a2a None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:01:43.356827 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc4859d-d184-4721-b4ee-3ead95a61a2a None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:01:43.387013 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:01:43.393339 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c60b5b7-7f4c-448e-a6f5-72498e7b4fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:01:43.394097 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c60b5b7-7f4c-448e-a6f5-72498e7b4fda None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:43.394645 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c60b5b7-7f4c-448e-a6f5-72498e7b4fda None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:43.394917 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c60b5b7-7f4c-448e-a6f5-72498e7b4fda None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:43.395635 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c60b5b7-7f4c-448e-a6f5-72498e7b4fda None admin] RBAC: Adding query filter params (role.id=393e6032e5cc4678b8351026fe4434f8, scope.project.id=6f1d8fd250c84c5887cb3173053ea2dd, user.id=3cbb39731a6b42e2a6647d6134b5c7cd) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:01:43.396036 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c60b5b7-7f4c-448e-a6f5-72498e7b4fda None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:01:43.397456 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c60b5b7-7f4c-448e-a6f5-72498e7b4fda None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:01:43.403426 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 617/1219] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Sep 29 02:01:43 2022] GET /identity/v3/role_assignments?user.id=3cbb39731a6b42e2a6647d6134b5c7cd&scope.project.id=6f1d8fd250c84c5887cb3173053ea2dd&role.id=393e6032e5cc4678b8351026fe4434f8 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:01:45.691328 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78ee846-dd44-4abb-b88f-ccd457a192c8 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:45.691945 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78ee846-dd44-4abb-b88f-ccd457a192c8 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:45.691945 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78ee846-dd44-4abb-b88f-ccd457a192c8 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:45.693696 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 603/1220] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 02:01:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 29 02:01:45.699972 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43200386-3e06-4d57-b197-ede5b4f5504f None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:45.700430 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43200386-3e06-4d57-b197-ede5b4f5504f None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:45.700592 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43200386-3e06-4d57-b197-ede5b4f5504f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:45.721468 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-43200386-3e06-4d57-b197-ede5b4f5504f None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:01:45.722860 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-43200386-3e06-4d57-b197-ede5b4f5504f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:01:45.795128 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 618/1221] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 02:01:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 29 02:01:46.104820 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78ee846-dd44-4abb-b88f-ccd457a192c8 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:01:46.217928 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78ee846-dd44-4abb-b88f-ccd457a192c8 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:01:46.257322 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac39b4b9-3513-4cbc-a492-e0e6124f6d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:01:46.258102 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac39b4b9-3513-4cbc-a492-e0e6124f6d19 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:46.258387 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac39b4b9-3513-4cbc-a492-e0e6124f6d19 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:46.258736 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac39b4b9-3513-4cbc-a492-e0e6124f6d19 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:46.272145 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac39b4b9-3513-4cbc-a492-e0e6124f6d19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 02:01:46.277855 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-ac39b4b9-3513-4cbc-a492-e0e6124f6d19 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 29 02:01:46.277855 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 02:01:46.277855 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 02:01:46.277855 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 02:01:46.277855 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 02:01:46.277855 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 02:01:46.277855 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 02:01:46.277855 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 02:01:46.277855 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 02:01:46.277855 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 02:01:46.277855 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 02:01:46.277855 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 02:01:46.277855 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 02:01:46.277855 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 02:01:46.277855 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 02:01:46.277855 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 02:01:46.279076 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 02:01:46.279076 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 02:01:46.279076 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 02:01:46.279076 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 02:01:46.279076 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 02:01:46.279076 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 02:01:46.279076 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 02:01:46.279076 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 02:01:46.279076 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 02:01:46.279076 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 02:01:46.279076 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 02:01:46.279076 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 02:01:46.279076 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 02:01:46.279076 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 02:01:46.279076 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 02:01:46.279076 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 02:01:46.279916 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 02:01:46.279916 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 02:01:46.279916 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 02:01:46.279916 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 02:01:46.279916 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 02:01:46.279916 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 02:01:46.279916 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 02:01:46.279916 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 02:01:46.279916 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 02:01:46.279916 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 02:01:46.279916 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 29 02:01:46.279916 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 02:01:46.279916 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 604/1222] 10.222.0.49 () {56 vars in 1102 bytes} [Thu Sep 29 02:01:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 02:01:46.286438 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43200386-3e06-4d57-b197-ede5b4f5504f None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:01:46.398880 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43200386-3e06-4d57-b197-ede5b4f5504f None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:01:46.423405 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:01:46.435169 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b8f6cc-7a81-467b-acf4-91403c050800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:01:46.435894 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8f6cc-7a81-467b-acf4-91403c050800 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:46.436131 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8f6cc-7a81-467b-acf4-91403c050800 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:46.436397 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8f6cc-7a81-467b-acf4-91403c050800 None admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:46.437153 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b8f6cc-7a81-467b-acf4-91403c050800 None admin] RBAC: Adding query filter params (name=service) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:01:46.437476 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b8f6cc-7a81-467b-acf4-91403c050800 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:01:46.438927 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b8f6cc-7a81-467b-acf4-91403c050800 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:01:46.449498 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 619/1223] 10.222.0.49 () {56 vars in 1103 bytes} [Thu Sep 29 02:01:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:01:46.455912 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac39b4b9-3513-4cbc-a492-e0e6124f6d19 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:01:46.506830 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:01:46.575629 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac39b4b9-3513-4cbc-a492-e0e6124f6d19 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:01:46.624494 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1ddfd4-cf02-46f4-a874-524b18c7cacc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:01:46.625126 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ddfd4-cf02-46f4-a874-524b18c7cacc None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:46.625434 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ddfd4-cf02-46f4-a874-524b18c7cacc None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:46.625731 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ddfd4-cf02-46f4-a874-524b18c7cacc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:46.639376 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1ddfd4-cf02-46f4-a874-524b18c7cacc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:01:46.641573 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1ddfd4-cf02-46f4-a874-524b18c7cacc None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:01:46.663570 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-5f1ddfd4-cf02-46f4-a874-524b18c7cacc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 02:01:46.663570 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 02:01:46.663570 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 02:01:46.663570 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 02:01:46.663570 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 02:01:46.663570 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 02:01:46.663570 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 02:01:46.663570 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 02:01:46.663570 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 02:01:46.663570 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 02:01:46.663570 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 02:01:46.663570 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 02:01:46.663570 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 02:01:46.663570 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 02:01:46.663570 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 02:01:46.663570 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 02:01:46.664725 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 02:01:46.664725 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 02:01:46.664725 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 02:01:46.664725 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 02:01:46.664725 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 02:01:46.664725 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 02:01:46.664725 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 02:01:46.664725 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 02:01:46.664725 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 02:01:46.664725 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 02:01:46.664725 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 02:01:46.664725 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 02:01:46.664725 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 02:01:46.664725 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 02:01:46.664725 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 02:01:46.664725 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 02:01:46.664725 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 02:01:46.666422 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 02:01:46.666422 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 02:01:46.666422 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 02:01:46.666422 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 605/1224] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 02:01:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 02:01:46.670887 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b8f6cc-7a81-467b-acf4-91403c050800 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:01:46.783521 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b8f6cc-7a81-467b-acf4-91403c050800 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:01:46.819451 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef53e785-4d61-40b0-862c-b19e79fd744b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:01:46.820218 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef53e785-4d61-40b0-862c-b19e79fd744b None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:46.820504 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef53e785-4d61-40b0-862c-b19e79fd744b None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:46.820783 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef53e785-4d61-40b0-862c-b19e79fd744b None admin] PATH_INFO: `/v3/domains` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:46.821467 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef53e785-4d61-40b0-862c-b19e79fd744b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:01:46.821773 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef53e785-4d61-40b0-862c-b19e79fd744b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:01:46.823144 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef53e785-4d61-40b0-862c-b19e79fd744b None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:01:46.837538 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 620/1225] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Sep 29 02:01:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:01:46.844228 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1ddfd4-cf02-46f4-a874-524b18c7cacc None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:01:46.948730 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:01:46.960206 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1ddfd4-cf02-46f4-a874-524b18c7cacc None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:01:46.996906 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab8830a-ac1f-4e00-acd4-27686c5f8332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:01:46.997553 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab8830a-ac1f-4e00-acd4-27686c5f8332 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:46.997832 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab8830a-ac1f-4e00-acd4-27686c5f8332 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:46.998106 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab8830a-ac1f-4e00-acd4-27686c5f8332 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:47.006886 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab8830a-ac1f-4e00-acd4-27686c5f8332 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:01:47.008325 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab8830a-ac1f-4e00-acd4-27686c5f8332 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:01:47.020177 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-0ab8830a-ac1f-4e00-acd4-27686c5f8332 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 29 02:01:47.020177 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 02:01:47.020177 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 02:01:47.020177 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 02:01:47.020177 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 02:01:47.020177 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 02:01:47.020177 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 02:01:47.020177 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 02:01:47.020177 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 02:01:47.020177 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 02:01:47.020177 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 02:01:47.020177 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 02:01:47.020177 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 29 02:01:47.020177 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 29 02:01:47.020177 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 29 02:01:47.020177 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 29 02:01:47.021339 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 02:01:47.021339 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 02:01:47.021339 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 29 02:01:47.021339 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 02:01:47.021339 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 29 02:01:47.021339 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 02:01:47.021339 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 02:01:47.021339 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 02:01:47.021339 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 02:01:47.021339 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 02:01:47.021339 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 02:01:47.021339 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 02:01:47.021339 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 02:01:47.021339 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 02:01:47.021339 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 02:01:47.021339 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 02:01:47.021339 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 02:01:47.021339 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 02:01:47.022448 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 02:01:47.022448 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 02:01:47.022448 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 29 02:01:47.022448 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 29 02:01:47.022448 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 29 02:01:47.022448 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 29 02:01:47.022448 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 29 02:01:47.022448 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 29 02:01:47.022448 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 29 02:01:47.022448 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 02:01:47.022448 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 606/1226] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 02:01:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 02:01:47.027476 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef53e785-4d61-40b0-862c-b19e79fd744b None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:01:47.081709 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:01:47.143896 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef53e785-4d61-40b0-862c-b19e79fd744b None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:01:47.181594 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fae476d-bb3b-4f18-adfe-5c707bac428a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:01:47.182215 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fae476d-bb3b-4f18-adfe-5c707bac428a None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:47.182490 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fae476d-bb3b-4f18-adfe-5c707bac428a None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:47.182756 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fae476d-bb3b-4f18-adfe-5c707bac428a None admin] PATH_INFO: `/v3/users` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:47.183478 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fae476d-bb3b-4f18-adfe-5c707bac428a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:01:47.183779 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fae476d-bb3b-4f18-adfe-5c707bac428a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:01:47.185190 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fae476d-bb3b-4f18-adfe-5c707bac428a None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:01:47.203000 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 621/1227] 10.222.0.49 () {56 vars in 1143 bytes} [Thu Sep 29 02:01:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:01:47.209250 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab8830a-ac1f-4e00-acd4-27686c5f8332 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:01:47.319943 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab8830a-ac1f-4e00-acd4-27686c5f8332 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:01:47.357496 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253166c8-cf6f-40a5-98eb-31031bcfe263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:01:47.358126 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253166c8-cf6f-40a5-98eb-31031bcfe263 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:47.358402 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253166c8-cf6f-40a5-98eb-31031bcfe263 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:47.358671 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253166c8-cf6f-40a5-98eb-31031bcfe263 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:47.370874 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253166c8-cf6f-40a5-98eb-31031bcfe263 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:01:47.372465 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253166c8-cf6f-40a5-98eb-31031bcfe263 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:01:47.388852 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-253166c8-cf6f-40a5-98eb-31031bcfe263 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 02:01:47.388852 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 02:01:47.388852 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 02:01:47.388852 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 02:01:47.388852 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 02:01:47.388852 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 02:01:47.388852 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 02:01:47.388852 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 02:01:47.388852 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 02:01:47.388852 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 02:01:47.388852 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 02:01:47.388852 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 02:01:47.388852 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 02:01:47.388852 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 02:01:47.388852 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 02:01:47.388852 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 02:01:47.390282 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 02:01:47.390282 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 02:01:47.390282 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 02:01:47.390282 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 02:01:47.390282 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 02:01:47.390282 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 02:01:47.390282 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 02:01:47.390282 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 02:01:47.390282 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 02:01:47.390282 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 02:01:47.390282 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 02:01:47.390282 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 02:01:47.390282 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 02:01:47.390282 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 02:01:47.390282 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 02:01:47.390282 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 02:01:47.390282 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 02:01:47.391267 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 02:01:47.391267 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 02:01:47.391267 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 02:01:47.391267 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 607/1228] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 02:01:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 02:01:47.396858 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fae476d-bb3b-4f18-adfe-5c707bac428a None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:01:47.507823 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fae476d-bb3b-4f18-adfe-5c707bac428a None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:01:47.510247 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:01:47.545293 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e51abb-3665-4ae9-9d47-44b44595e7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:01:47.546020 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e51abb-3665-4ae9-9d47-44b44595e7f6 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:47.546352 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e51abb-3665-4ae9-9d47-44b44595e7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:47.546704 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e51abb-3665-4ae9-9d47-44b44595e7f6 None admin] PATH_INFO: `/v3/domains` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:47.547365 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e51abb-3665-4ae9-9d47-44b44595e7f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:01:47.547663 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e51abb-3665-4ae9-9d47-44b44595e7f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:01:47.549590 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e51abb-3665-4ae9-9d47-44b44595e7f6 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:01:47.562502 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 622/1229] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Sep 29 02:01:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:01:47.569383 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253166c8-cf6f-40a5-98eb-31031bcfe263 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:01:47.579650 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:01:47.683207 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253166c8-cf6f-40a5-98eb-31031bcfe263 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:01:47.716612 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0df73f-40f2-45a7-afa0-d2f8fd760086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:01:47.717257 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0df73f-40f2-45a7-afa0-d2f8fd760086 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:47.717561 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0df73f-40f2-45a7-afa0-d2f8fd760086 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:47.717930 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0df73f-40f2-45a7-afa0-d2f8fd760086 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:47.725096 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0df73f-40f2-45a7-afa0-d2f8fd760086 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:01:47.726565 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0df73f-40f2-45a7-afa0-d2f8fd760086 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:01:47.738638 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-df0df73f-40f2-45a7-afa0-d2f8fd760086 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 02:01:47.738638 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 02:01:47.738638 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 02:01:47.738638 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 02:01:47.738638 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 02:01:47.738638 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 02:01:47.738638 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 02:01:47.738638 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 02:01:47.738638 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 02:01:47.738638 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 02:01:47.738638 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 02:01:47.738638 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 02:01:47.738638 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 29 02:01:47.738638 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 29 02:01:47.738638 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 29 02:01:47.739587 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 29 02:01:47.739587 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 02:01:47.739587 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 02:01:47.739587 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 02:01:47.739587 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 02:01:47.739587 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 02:01:47.739587 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 02:01:47.739587 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 02:01:47.739587 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 02:01:47.739587 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 02:01:47.739587 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 02:01:47.739587 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 02:01:47.739587 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 02:01:47.739587 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 02:01:47.739587 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 02:01:47.739587 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 02:01:47.739587 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 02:01:47.740496 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 29 02:01:47.740496 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 29 02:01:47.740496 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 29 02:01:47.740496 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 29 02:01:47.740496 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 29 02:01:47.740496 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 29 02:01:47.740496 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 02:01:47.740496 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 02:01:47.740496 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 608/1230] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Sep 29 02:01:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 02:01:47.746056 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e51abb-3665-4ae9-9d47-44b44595e7f6 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:01:47.854390 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e51abb-3665-4ae9-9d47-44b44595e7f6 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:01:47.893842 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd761d4-b584-45ef-80c4-41d68ef3d264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:01:47.894525 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd761d4-b584-45ef-80c4-41d68ef3d264 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:47.894871 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd761d4-b584-45ef-80c4-41d68ef3d264 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:47.895169 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd761d4-b584-45ef-80c4-41d68ef3d264 None admin] PATH_INFO: `/v3/projects` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:47.895945 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd761d4-b584-45ef-80c4-41d68ef3d264 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:01:47.896337 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd761d4-b584-45ef-80c4-41d68ef3d264 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:01:47.898111 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd761d4-b584-45ef-80c4-41d68ef3d264 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:01:47.912823 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 623/1231] 10.222.0.49 () {56 vars in 1148 bytes} [Thu Sep 29 02:01:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:01:47.919024 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0df73f-40f2-45a7-afa0-d2f8fd760086 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:01:47.993964 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:01:48.034372 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0df73f-40f2-45a7-afa0-d2f8fd760086 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:01:48.071035 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727378e2-716a-429c-b137-8b09144da69d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:01:48.071755 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727378e2-716a-429c-b137-8b09144da69d None admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:48.071954 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727378e2-716a-429c-b137-8b09144da69d None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:48.072223 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727378e2-716a-429c-b137-8b09144da69d None admin] PATH_INFO: `/v3/projects/6f1d8fd250c84c5887cb3173053ea2dd/users/3cbb39731a6b42e2a6647d6134b5c7cd/roles/393e6032e5cc4678b8351026fe4434f8` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:48.087372 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727378e2-716a-429c-b137-8b09144da69d None admin] RBAC: Authorizing `identity:create_grant(project_id=6f1d8fd250c84c5887cb3173053ea2dd, user_id=3cbb39731a6b42e2a6647d6134b5c7cd, role_id=393e6032e5cc4678b8351026fe4434f8)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:01:48.088847 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727378e2-716a-429c-b137-8b09144da69d None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:01:48.102467 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 609/1232] 10.222.0.49 () {58 vars in 1439 bytes} [Thu Sep 29 02:01:47 2022] PUT /identity/v3/projects/6f1d8fd250c84c5887cb3173053ea2dd/users/3cbb39731a6b42e2a6647d6134b5c7cd/roles/393e6032e5cc4678b8351026fe4434f8 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:01:50.450023 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ea8541-4651-4b2f-9506-b1e752845218 None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:50.450574 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ea8541-4651-4b2f-9506-b1e752845218 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:50.450574 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ea8541-4651-4b2f-9506-b1e752845218 None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:50.451906 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 624/1233] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 02:01:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:01:50.458230 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62669615-5e28-4464-93c4-fc706c4f5695 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:50.458675 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62669615-5e28-4464-93c4-fc706c4f5695 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:50.458873 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62669615-5e28-4464-93c4-fc706c4f5695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:50.479576 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-62669615-5e28-4464-93c4-fc706c4f5695 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:01:50.480877 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-62669615-5e28-4464-93c4-fc706c4f5695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:01:50.559842 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 610/1234] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 02:01:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 29 02:01:50.856733 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ea8541-4651-4b2f-9506-b1e752845218 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:01:50.884268 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:01:50.979334 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ea8541-4651-4b2f-9506-b1e752845218 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:01:51.019077 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7252e5a8-5bd6-4778-a6a3-c22868bc8fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:01:51.019854 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7252e5a8-5bd6-4778-a6a3-c22868bc8fe0 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:51.020133 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7252e5a8-5bd6-4778-a6a3-c22868bc8fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:51.020482 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7252e5a8-5bd6-4778-a6a3-c22868bc8fe0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:51.033897 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7252e5a8-5bd6-4778-a6a3-c22868bc8fe0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 02:01:51.039832 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-7252e5a8-5bd6-4778-a6a3-c22868bc8fe0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 29 02:01:51.039832 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 02:01:51.039832 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 02:01:51.039832 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 02:01:51.039832 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 02:01:51.039832 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 02:01:51.039832 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 02:01:51.039832 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 02:01:51.039832 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 02:01:51.039832 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 02:01:51.039832 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 02:01:51.039832 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 02:01:51.039832 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 02:01:51.039832 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 02:01:51.039832 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 02:01:51.039832 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 02:01:51.041057 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 02:01:51.041057 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 02:01:51.041057 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 02:01:51.041057 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 02:01:51.041057 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 02:01:51.041057 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 02:01:51.041057 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 02:01:51.041057 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 02:01:51.041057 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 02:01:51.041057 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 02:01:51.041057 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 02:01:51.041057 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 02:01:51.041057 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 02:01:51.041057 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 02:01:51.041057 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 02:01:51.041057 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 02:01:51.042224 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 02:01:51.042224 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 02:01:51.042224 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 02:01:51.042224 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 02:01:51.042224 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 02:01:51.042224 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 02:01:51.042224 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 02:01:51.042224 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 02:01:51.042224 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 02:01:51.042224 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 02:01:51.042224 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 29 02:01:51.042224 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 02:01:51.042224 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 625/1235] 10.222.0.49 () {56 vars in 1102 bytes} [Thu Sep 29 02:01:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 02:01:51.047295 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62669615-5e28-4464-93c4-fc706c4f5695 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:01:51.098944 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:01:51.157205 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62669615-5e28-4464-93c4-fc706c4f5695 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:01:51.198355 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a441f7e-d164-475d-82fa-40430638e27a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:01:51.199054 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a441f7e-d164-475d-82fa-40430638e27a None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:51.199399 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a441f7e-d164-475d-82fa-40430638e27a None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:51.199708 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a441f7e-d164-475d-82fa-40430638e27a None admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:51.200485 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a441f7e-d164-475d-82fa-40430638e27a None admin] RBAC: Adding query filter params (name=service) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:01:51.200841 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a441f7e-d164-475d-82fa-40430638e27a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:01:51.202465 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a441f7e-d164-475d-82fa-40430638e27a None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:01:51.211841 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 611/1236] 10.222.0.49 () {56 vars in 1103 bytes} [Thu Sep 29 02:01:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 02:01:51.218641 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7252e5a8-5bd6-4778-a6a3-c22868bc8fe0 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:01:51.320906 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:01:51.341564 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7252e5a8-5bd6-4778-a6a3-c22868bc8fe0 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:01:51.379553 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0370c2a3-60ec-46c6-8817-8b674b93a1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:01:51.380346 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0370c2a3-60ec-46c6-8817-8b674b93a1a0 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:51.380758 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0370c2a3-60ec-46c6-8817-8b674b93a1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:51.381048 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0370c2a3-60ec-46c6-8817-8b674b93a1a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:51.393077 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0370c2a3-60ec-46c6-8817-8b674b93a1a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:01:51.394775 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0370c2a3-60ec-46c6-8817-8b674b93a1a0 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:01:51.413030 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-0370c2a3-60ec-46c6-8817-8b674b93a1a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 02:01:51.413030 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 02:01:51.413030 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 02:01:51.413030 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 02:01:51.413030 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 02:01:51.413030 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 02:01:51.413030 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 02:01:51.413030 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 02:01:51.413030 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 02:01:51.413030 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 02:01:51.413030 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 02:01:51.413030 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 02:01:51.413030 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 02:01:51.413030 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 02:01:51.413030 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 02:01:51.413030 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 02:01:51.414416 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 02:01:51.414416 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 02:01:51.414416 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 02:01:51.414416 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 02:01:51.414416 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 02:01:51.414416 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 02:01:51.414416 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 02:01:51.414416 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 02:01:51.414416 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 02:01:51.414416 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 02:01:51.414416 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 02:01:51.414416 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 02:01:51.414416 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 02:01:51.414416 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 02:01:51.414416 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 02:01:51.414416 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 02:01:51.414416 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 02:01:51.415559 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 02:01:51.415559 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 02:01:51.415559 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 02:01:51.417374 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 626/1237] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 02:01:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 02:01:51.421816 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a441f7e-d164-475d-82fa-40430638e27a None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:01:51.525949 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a441f7e-d164-475d-82fa-40430638e27a None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:01:51.536229 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:01:51.564740 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e39ae9-5538-45a3-b1a6-04f889b4261a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:01:51.565382 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e39ae9-5538-45a3-b1a6-04f889b4261a None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:51.565685 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e39ae9-5538-45a3-b1a6-04f889b4261a None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:51.565930 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e39ae9-5538-45a3-b1a6-04f889b4261a None admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:51.566562 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e39ae9-5538-45a3-b1a6-04f889b4261a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:01:51.566861 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e39ae9-5538-45a3-b1a6-04f889b4261a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:01:51.568212 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e39ae9-5538-45a3-b1a6-04f889b4261a None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:01:51.581101 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 612/1238] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Sep 29 02:01:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:01:51.587573 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0370c2a3-60ec-46c6-8817-8b674b93a1a0 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:01:51.712551 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0370c2a3-60ec-46c6-8817-8b674b93a1a0 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:01:51.748890 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acac59ab-815b-4fe4-ad84-a16467ca8c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:01:51.749606 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac59ab-815b-4fe4-ad84-a16467ca8c39 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:51.749903 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac59ab-815b-4fe4-ad84-a16467ca8c39 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:51.750183 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac59ab-815b-4fe4-ad84-a16467ca8c39 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:51.753475 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:01:51.759719 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acac59ab-815b-4fe4-ad84-a16467ca8c39 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:01:51.761734 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acac59ab-815b-4fe4-ad84-a16467ca8c39 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:01:51.775982 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-acac59ab-815b-4fe4-ad84-a16467ca8c39 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 29 02:01:51.775982 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 02:01:51.775982 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 02:01:51.775982 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 02:01:51.775982 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 02:01:51.775982 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 02:01:51.775982 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 02:01:51.775982 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 02:01:51.775982 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 02:01:51.775982 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 02:01:51.775982 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 02:01:51.775982 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 02:01:51.775982 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 29 02:01:51.775982 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 29 02:01:51.775982 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 29 02:01:51.775982 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 29 02:01:51.777189 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 02:01:51.777189 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 02:01:51.777189 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 29 02:01:51.777189 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 02:01:51.777189 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 29 02:01:51.777189 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 02:01:51.777189 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 02:01:51.777189 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 02:01:51.777189 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 02:01:51.777189 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 02:01:51.777189 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 02:01:51.777189 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 02:01:51.777189 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 02:01:51.777189 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 02:01:51.777189 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 02:01:51.777189 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 02:01:51.777189 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 02:01:51.777189 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 02:01:51.778418 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 02:01:51.778418 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 02:01:51.778418 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 29 02:01:51.778418 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 29 02:01:51.778418 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 29 02:01:51.778418 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 29 02:01:51.778418 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 29 02:01:51.778418 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 29 02:01:51.778418 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 29 02:01:51.778418 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 02:01:51.778418 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 627/1239] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 02:01:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 02:01:51.785735 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e39ae9-5538-45a3-b1a6-04f889b4261a None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:01:51.906048 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e39ae9-5538-45a3-b1a6-04f889b4261a None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:01:51.947124 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1d4c09-1527-403e-8805-021a3b53c051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:01:51.947923 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1d4c09-1527-403e-8805-021a3b53c051 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:51.948110 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1d4c09-1527-403e-8805-021a3b53c051 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:51.948460 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1d4c09-1527-403e-8805-021a3b53c051 None admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:51.949388 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1d4c09-1527-403e-8805-021a3b53c051 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:01:51.949735 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1d4c09-1527-403e-8805-021a3b53c051 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:01:51.951299 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1d4c09-1527-403e-8805-021a3b53c051 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:01:51.971322 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 613/1240] 10.222.0.49 () {56 vars in 1143 bytes} [Thu Sep 29 02:01:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:01:51.977331 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acac59ab-815b-4fe4-ad84-a16467ca8c39 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:01:52.089389 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acac59ab-815b-4fe4-ad84-a16467ca8c39 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:01:52.126503 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2780f5c-20c9-4f6a-8e47-5b475e5e9806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:01:52.127585 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2780f5c-20c9-4f6a-8e47-5b475e5e9806 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:52.127891 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2780f5c-20c9-4f6a-8e47-5b475e5e9806 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:52.128188 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2780f5c-20c9-4f6a-8e47-5b475e5e9806 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:52.199893 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:01:52.210095 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2780f5c-20c9-4f6a-8e47-5b475e5e9806 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:01:52.211900 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2780f5c-20c9-4f6a-8e47-5b475e5e9806 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:01:52.328292 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 628/1241] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Sep 29 02:01:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 29 02:01:52.334750 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1d4c09-1527-403e-8805-021a3b53c051 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:01:52.366239 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:01:52.447084 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1d4c09-1527-403e-8805-021a3b53c051 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:01:52.488396 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba972c00-a2b4-4594-8669-59ce35e7a8d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:01:52.489033 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba972c00-a2b4-4594-8669-59ce35e7a8d5 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:52.489333 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba972c00-a2b4-4594-8669-59ce35e7a8d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:52.489608 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba972c00-a2b4-4594-8669-59ce35e7a8d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:52.499704 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba972c00-a2b4-4594-8669-59ce35e7a8d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:01:52.501207 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba972c00-a2b4-4594-8669-59ce35e7a8d5 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:01:52.515976 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-ba972c00-a2b4-4594-8669-59ce35e7a8d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 02:01:52.515976 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 02:01:52.515976 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 02:01:52.515976 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 02:01:52.515976 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 02:01:52.515976 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 02:01:52.515976 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 02:01:52.515976 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 02:01:52.515976 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 02:01:52.515976 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 02:01:52.515976 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 02:01:52.515976 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 02:01:52.515976 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 02:01:52.515976 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 02:01:52.515976 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 02:01:52.515976 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 02:01:52.517334 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 02:01:52.517334 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 02:01:52.517334 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 02:01:52.517334 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 02:01:52.517334 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 02:01:52.517334 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 02:01:52.517334 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 02:01:52.517334 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 02:01:52.517334 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 02:01:52.517334 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 02:01:52.517334 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 02:01:52.517334 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 02:01:52.517334 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 02:01:52.517334 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 02:01:52.517334 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 02:01:52.517334 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 02:01:52.517334 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 02:01:52.518233 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 02:01:52.518233 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 02:01:52.518233 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 02:01:52.518233 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 614/1242] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 02:01:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 02:01:52.523254 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2780f5c-20c9-4f6a-8e47-5b475e5e9806 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:01:52.633196 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:01:52.640509 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2780f5c-20c9-4f6a-8e47-5b475e5e9806 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:01:52.677969 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2031645d-6be2-411f-973a-84aada757250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:01:52.678694 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2031645d-6be2-411f-973a-84aada757250 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:52.678981 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2031645d-6be2-411f-973a-84aada757250 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:52.679299 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2031645d-6be2-411f-973a-84aada757250 None admin] PATH_INFO: `/v3/domains` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:52.680029 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2031645d-6be2-411f-973a-84aada757250 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:01:52.680411 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2031645d-6be2-411f-973a-84aada757250 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:01:52.681877 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2031645d-6be2-411f-973a-84aada757250 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:01:52.694781 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 629/1243] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Sep 29 02:01:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 02:01:52.700970 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba972c00-a2b4-4594-8669-59ce35e7a8d5 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:01:52.791515 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:01:52.815919 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba972c00-a2b4-4594-8669-59ce35e7a8d5 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:01:52.854867 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5a4395-f64e-4704-8236-fccd9b103cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:01:52.855552 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a4395-f64e-4704-8236-fccd9b103cf4 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:52.855836 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a4395-f64e-4704-8236-fccd9b103cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:52.856117 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a4395-f64e-4704-8236-fccd9b103cf4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:52.864004 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5a4395-f64e-4704-8236-fccd9b103cf4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:01:52.865614 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5a4395-f64e-4704-8236-fccd9b103cf4 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:01:52.878782 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-fd5a4395-f64e-4704-8236-fccd9b103cf4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 02:01:52.878782 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 02:01:52.878782 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 02:01:52.878782 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 02:01:52.878782 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 02:01:52.878782 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 02:01:52.878782 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 02:01:52.878782 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 02:01:52.878782 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 02:01:52.878782 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 02:01:52.878782 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 02:01:52.878782 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 02:01:52.878782 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 29 02:01:52.878782 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 29 02:01:52.878782 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 29 02:01:52.879856 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 29 02:01:52.879856 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 02:01:52.879856 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 02:01:52.879856 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 02:01:52.879856 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 02:01:52.879856 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 02:01:52.879856 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 02:01:52.879856 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 02:01:52.879856 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 02:01:52.879856 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 02:01:52.879856 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 02:01:52.879856 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 02:01:52.879856 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 02:01:52.879856 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 02:01:52.879856 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 02:01:52.879856 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 02:01:52.879856 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 02:01:52.880784 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 29 02:01:52.880784 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 29 02:01:52.880784 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 29 02:01:52.880784 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 29 02:01:52.880784 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 29 02:01:52.880784 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 29 02:01:52.880784 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 02:01:52.880784 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 02:01:52.880784 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 615/1244] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Sep 29 02:01:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 02:01:52.886110 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2031645d-6be2-411f-973a-84aada757250 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:01:53.003164 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2031645d-6be2-411f-973a-84aada757250 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:01:53.041745 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431b1b8f-587c-432d-9da9-71f8df5b4132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:01:53.042430 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b1b8f-587c-432d-9da9-71f8df5b4132 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:53.042737 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b1b8f-587c-432d-9da9-71f8df5b4132 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:53.043088 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b1b8f-587c-432d-9da9-71f8df5b4132 None admin] PATH_INFO: `/v3/projects` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:53.043940 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431b1b8f-587c-432d-9da9-71f8df5b4132 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:01:53.044281 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431b1b8f-587c-432d-9da9-71f8df5b4132 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:01:53.045960 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431b1b8f-587c-432d-9da9-71f8df5b4132 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:01:53.060050 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 630/1245] 10.222.0.49 () {56 vars in 1148 bytes} [Thu Sep 29 02:01:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:01:53.067946 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5a4395-f64e-4704-8236-fccd9b103cf4 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:01:53.183589 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5a4395-f64e-4704-8236-fccd9b103cf4 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:01:53.220217 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c19cadd-7970-4683-8dda-54e42c27aaab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:01:53.221075 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c19cadd-7970-4683-8dda-54e42c27aaab None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:53.221456 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c19cadd-7970-4683-8dda-54e42c27aaab None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:53.221733 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c19cadd-7970-4683-8dda-54e42c27aaab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:53.222473 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c19cadd-7970-4683-8dda-54e42c27aaab None admin] RBAC: Adding query filter params (role.id=393e6032e5cc4678b8351026fe4434f8, scope.project.id=6f1d8fd250c84c5887cb3173053ea2dd, user.id=3cbb39731a6b42e2a6647d6134b5c7cd) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:01:53.222806 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c19cadd-7970-4683-8dda-54e42c27aaab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:01:53.224354 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c19cadd-7970-4683-8dda-54e42c27aaab None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:01:53.231788 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 616/1246] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Sep 29 02:01:53 2022] GET /identity/v3/role_assignments?user.id=3cbb39731a6b42e2a6647d6134b5c7cd&scope.project.id=6f1d8fd250c84c5887cb3173053ea2dd&role.id=393e6032e5cc4678b8351026fe4434f8 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:01:55.722356 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a1707c-57ac-40ec-879e-2a5de924f607 None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:55.722979 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a1707c-57ac-40ec-879e-2a5de924f607 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:55.723071 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a1707c-57ac-40ec-879e-2a5de924f607 None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:55.724647 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 631/1247] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 02:01:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:01:55.730458 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f452cde2-d7ba-4be3-b9c2-2fb6534ae34a None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:55.730913 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f452cde2-d7ba-4be3-b9c2-2fb6534ae34a None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:55.731019 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f452cde2-d7ba-4be3-b9c2-2fb6534ae34a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:55.738919 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:01:55.753700 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-f452cde2-d7ba-4be3-b9c2-2fb6534ae34a None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:01:55.755448 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-f452cde2-d7ba-4be3-b9c2-2fb6534ae34a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:01:55.832643 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 617/1248] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 02:01:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 29 02:01:56.124510 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a1707c-57ac-40ec-879e-2a5de924f607 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:01:56.144032 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:01:56.234574 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a1707c-57ac-40ec-879e-2a5de924f607 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:01:56.270877 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab41a029-0333-493a-8b60-53ac2bc053aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:01:56.271522 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab41a029-0333-493a-8b60-53ac2bc053aa None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:56.271799 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab41a029-0333-493a-8b60-53ac2bc053aa None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:56.272061 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab41a029-0333-493a-8b60-53ac2bc053aa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:56.284282 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab41a029-0333-493a-8b60-53ac2bc053aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 02:01:56.289125 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-ab41a029-0333-493a-8b60-53ac2bc053aa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 02:01:56.289125 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 02:01:56.289125 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 02:01:56.289125 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 02:01:56.289125 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 02:01:56.289125 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 02:01:56.289125 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 02:01:56.289125 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 02:01:56.289125 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 02:01:56.289125 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 02:01:56.289125 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 02:01:56.289125 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 02:01:56.289125 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 02:01:56.289125 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 02:01:56.289125 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 02:01:56.289125 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 02:01:56.290262 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 02:01:56.290262 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 02:01:56.290262 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 02:01:56.290262 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 02:01:56.290262 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 02:01:56.290262 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 02:01:56.290262 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 02:01:56.290262 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 02:01:56.290262 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 02:01:56.290262 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 02:01:56.290262 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 02:01:56.290262 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 02:01:56.290262 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 02:01:56.290262 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 02:01:56.290262 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 02:01:56.290262 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 02:01:56.294437 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 02:01:56.294437 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 02:01:56.294437 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 02:01:56.294437 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 02:01:56.294437 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 02:01:56.294437 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 02:01:56.294437 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 02:01:56.294437 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 02:01:56.294437 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 02:01:56.294437 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 02:01:56.294437 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 02:01:56.294437 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 02:01:56.294437 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 632/1249] 10.222.0.49 () {56 vars in 1096 bytes} [Thu Sep 29 02:01:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 02:01:56.296315 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f452cde2-d7ba-4be3-b9c2-2fb6534ae34a None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:01:56.398852 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f452cde2-d7ba-4be3-b9c2-2fb6534ae34a None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:01:56.431086 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:01:56.436228 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a38aa5-23a4-4e38-ace5-69400b69fbd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:01:56.436845 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a38aa5-23a4-4e38-ace5-69400b69fbd1 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:56.437118 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a38aa5-23a4-4e38-ace5-69400b69fbd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:56.437417 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a38aa5-23a4-4e38-ace5-69400b69fbd1 None admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:56.438090 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a38aa5-23a4-4e38-ace5-69400b69fbd1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:01:56.438393 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a38aa5-23a4-4e38-ace5-69400b69fbd1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:01:56.439880 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a38aa5-23a4-4e38-ace5-69400b69fbd1 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:01:56.448850 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 618/1250] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Sep 29 02:01:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 02:01:56.456098 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab41a029-0333-493a-8b60-53ac2bc053aa None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:01:56.536897 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:01:56.561289 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab41a029-0333-493a-8b60-53ac2bc053aa None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:01:56.598809 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7842678e-705f-4f99-a7c5-7ec90e7cc70a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:01:56.599531 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7842678e-705f-4f99-a7c5-7ec90e7cc70a None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:56.599813 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7842678e-705f-4f99-a7c5-7ec90e7cc70a None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:56.601228 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7842678e-705f-4f99-a7c5-7ec90e7cc70a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:56.613021 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7842678e-705f-4f99-a7c5-7ec90e7cc70a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:01:56.614144 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7842678e-705f-4f99-a7c5-7ec90e7cc70a None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:01:56.631774 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-7842678e-705f-4f99-a7c5-7ec90e7cc70a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 02:01:56.631774 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 02:01:56.631774 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 02:01:56.631774 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 02:01:56.631774 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 02:01:56.631774 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 02:01:56.631774 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 02:01:56.631774 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 02:01:56.631774 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 02:01:56.631774 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 02:01:56.631774 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 02:01:56.631774 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 02:01:56.631774 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 02:01:56.631774 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 02:01:56.631774 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 02:01:56.631774 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 02:01:56.633070 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 02:01:56.633070 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 02:01:56.633070 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 02:01:56.633070 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 02:01:56.633070 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 02:01:56.633070 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 02:01:56.633070 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 02:01:56.633070 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 02:01:56.633070 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 02:01:56.633070 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 02:01:56.633070 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 02:01:56.633070 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 02:01:56.633070 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 02:01:56.633070 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 02:01:56.633070 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 02:01:56.633070 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 02:01:56.633070 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 02:01:56.634316 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 02:01:56.634316 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 02:01:56.634316 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 02:01:56.634316 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 633/1251] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 02:01:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 29 02:01:56.642037 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a38aa5-23a4-4e38-ace5-69400b69fbd1 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:01:56.748834 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a38aa5-23a4-4e38-ace5-69400b69fbd1 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:01:56.788067 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6426a589-404a-401f-b172-262eec5479a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:01:56.788946 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6426a589-404a-401f-b172-262eec5479a3 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:56.789407 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6426a589-404a-401f-b172-262eec5479a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:56.789790 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6426a589-404a-401f-b172-262eec5479a3 None admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:56.790767 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6426a589-404a-401f-b172-262eec5479a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:01:56.791223 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6426a589-404a-401f-b172-262eec5479a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:01:56.793379 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6426a589-404a-401f-b172-262eec5479a3 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:01:56.809746 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 619/1252] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Sep 29 02:01:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 02:01:56.816430 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7842678e-705f-4f99-a7c5-7ec90e7cc70a None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:01:56.915898 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7842678e-705f-4f99-a7c5-7ec90e7cc70a None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:01:56.941921 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:01:56.949790 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d035bf-195c-4418-9e70-134b7ab23f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:01:56.950422 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d035bf-195c-4418-9e70-134b7ab23f0e None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:56.950702 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d035bf-195c-4418-9e70-134b7ab23f0e None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:56.950974 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d035bf-195c-4418-9e70-134b7ab23f0e None admin] PATH_INFO: `/v3/users/placement` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:56.959178 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d035bf-195c-4418-9e70-134b7ab23f0e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:01:56.960621 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d035bf-195c-4418-9e70-134b7ab23f0e None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:01:56.971914 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-03d035bf-195c-4418-9e70-134b7ab23f0e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 29 02:01:56.971914 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 02:01:56.971914 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 02:01:56.971914 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 02:01:56.971914 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 02:01:56.971914 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 02:01:56.971914 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 02:01:56.971914 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 02:01:56.971914 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 02:01:56.971914 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 02:01:56.971914 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 02:01:56.971914 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 02:01:56.971914 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 29 02:01:56.971914 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 29 02:01:56.971914 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 29 02:01:56.971914 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 29 02:01:56.973018 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 02:01:56.973018 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 02:01:56.973018 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 29 02:01:56.973018 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 02:01:56.973018 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 29 02:01:56.973018 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 02:01:56.973018 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 02:01:56.973018 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 02:01:56.973018 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 02:01:56.973018 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 02:01:56.973018 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 02:01:56.973018 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 02:01:56.973018 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 02:01:56.973018 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 02:01:56.973018 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 02:01:56.973018 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 02:01:56.973018 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 02:01:56.973018 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 02:01:56.974408 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 02:01:56.974408 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 02:01:56.974408 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 29 02:01:56.974408 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 29 02:01:56.974408 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 29 02:01:56.974408 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 29 02:01:56.974408 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 29 02:01:56.974408 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 29 02:01:56.974408 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 29 02:01:56.974408 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 02:01:56.974408 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 634/1253] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 02:01:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 02:01:56.978826 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6426a589-404a-401f-b172-262eec5479a3 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:01:57.032400 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:01:57.076433 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6426a589-404a-401f-b172-262eec5479a3 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:01:57.110518 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3ae2da-b4b0-4c3f-8ab1-6036f036cad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:01:57.111138 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ae2da-b4b0-4c3f-8ab1-6036f036cad4 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:57.111407 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ae2da-b4b0-4c3f-8ab1-6036f036cad4 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:57.111671 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ae2da-b4b0-4c3f-8ab1-6036f036cad4 None admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:57.112378 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3ae2da-b4b0-4c3f-8ab1-6036f036cad4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:01:57.112674 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3ae2da-b4b0-4c3f-8ab1-6036f036cad4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:01:57.114099 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3ae2da-b4b0-4c3f-8ab1-6036f036cad4 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:01:57.131201 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 620/1254] 10.222.0.49 () {56 vars in 1143 bytes} [Thu Sep 29 02:01:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:01:57.136968 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d035bf-195c-4418-9e70-134b7ab23f0e None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:01:57.233443 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d035bf-195c-4418-9e70-134b7ab23f0e None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:01:57.266831 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae989d5-c296-4685-8b3a-e655c75eb58c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:01:57.267424 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae989d5-c296-4685-8b3a-e655c75eb58c None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:57.267700 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae989d5-c296-4685-8b3a-e655c75eb58c None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:57.267971 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae989d5-c296-4685-8b3a-e655c75eb58c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:57.325487 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:01:57.338225 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae989d5-c296-4685-8b3a-e655c75eb58c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:01:57.339664 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae989d5-c296-4685-8b3a-e655c75eb58c None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:01:57.434001 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 635/1255] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Sep 29 02:01:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 29 02:01:57.441245 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3ae2da-b4b0-4c3f-8ab1-6036f036cad4 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:01:57.535969 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3ae2da-b4b0-4c3f-8ab1-6036f036cad4 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:01:57.549016 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:01:57.569013 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93017389-213c-48af-a36b-89af772088a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:01:57.569665 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93017389-213c-48af-a36b-89af772088a2 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:57.569941 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93017389-213c-48af-a36b-89af772088a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:57.570223 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93017389-213c-48af-a36b-89af772088a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:57.580957 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93017389-213c-48af-a36b-89af772088a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:01:57.582629 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93017389-213c-48af-a36b-89af772088a2 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:01:57.598936 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-93017389-213c-48af-a36b-89af772088a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 02:01:57.598936 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 02:01:57.598936 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 02:01:57.598936 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 02:01:57.598936 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 02:01:57.598936 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 02:01:57.598936 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 02:01:57.598936 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 02:01:57.598936 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 02:01:57.598936 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 02:01:57.598936 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 02:01:57.598936 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 02:01:57.598936 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 02:01:57.598936 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 02:01:57.598936 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 02:01:57.598936 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 02:01:57.600186 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 02:01:57.600186 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 02:01:57.600186 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 02:01:57.600186 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 02:01:57.600186 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 02:01:57.600186 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 02:01:57.600186 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 02:01:57.600186 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 02:01:57.600186 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 02:01:57.600186 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 02:01:57.600186 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 02:01:57.600186 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 02:01:57.600186 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 02:01:57.600186 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 02:01:57.600186 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 02:01:57.600186 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 02:01:57.600186 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 02:01:57.601252 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 02:01:57.601252 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 02:01:57.601252 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 02:01:57.601252 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 621/1256] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 02:01:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 02:01:57.606197 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae989d5-c296-4685-8b3a-e655c75eb58c None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:01:57.693830 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:01:57.706213 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae989d5-c296-4685-8b3a-e655c75eb58c None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:01:57.739048 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16f24d8-110e-4949-8fae-5d00890f4f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:01:57.739638 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16f24d8-110e-4949-8fae-5d00890f4f51 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:57.739911 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16f24d8-110e-4949-8fae-5d00890f4f51 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:57.740179 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16f24d8-110e-4949-8fae-5d00890f4f51 None admin] PATH_INFO: `/v3/domains` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:57.740805 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16f24d8-110e-4949-8fae-5d00890f4f51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:01:57.741103 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16f24d8-110e-4949-8fae-5d00890f4f51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:01:57.742488 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16f24d8-110e-4949-8fae-5d00890f4f51 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:01:57.753293 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 636/1257] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Sep 29 02:01:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:01:57.758950 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93017389-213c-48af-a36b-89af772088a2 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:01:57.855503 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93017389-213c-48af-a36b-89af772088a2 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:01:57.888103 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952639b2-a5c9-49e9-a951-1f541d131e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:01:57.888711 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952639b2-a5c9-49e9-a951-1f541d131e8b None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:57.888989 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952639b2-a5c9-49e9-a951-1f541d131e8b None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:57.889259 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952639b2-a5c9-49e9-a951-1f541d131e8b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:57.896155 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952639b2-a5c9-49e9-a951-1f541d131e8b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:01:57.897664 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952639b2-a5c9-49e9-a951-1f541d131e8b None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:01:57.909571 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-952639b2-a5c9-49e9-a951-1f541d131e8b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 02:01:57.909571 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 02:01:57.909571 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 02:01:57.909571 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 02:01:57.909571 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 02:01:57.909571 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 02:01:57.909571 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 02:01:57.909571 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 02:01:57.909571 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 02:01:57.909571 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 02:01:57.909571 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 02:01:57.909571 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 02:01:57.909571 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 29 02:01:57.909571 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 29 02:01:57.909571 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 29 02:01:57.910485 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 29 02:01:57.910485 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 02:01:57.910485 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 02:01:57.910485 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 02:01:57.910485 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 02:01:57.910485 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 02:01:57.910485 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 02:01:57.910485 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 02:01:57.910485 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 02:01:57.910485 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 02:01:57.910485 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 02:01:57.910485 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 02:01:57.910485 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 02:01:57.910485 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 02:01:57.910485 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 02:01:57.910485 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 02:01:57.910485 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 02:01:57.911435 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 29 02:01:57.911435 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 29 02:01:57.911435 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 29 02:01:57.911435 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 29 02:01:57.911435 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 29 02:01:57.911435 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 29 02:01:57.911435 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 02:01:57.911435 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 02:01:57.911435 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 622/1258] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Sep 29 02:01:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 02:01:57.916418 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16f24d8-110e-4949-8fae-5d00890f4f51 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:01:58.012977 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16f24d8-110e-4949-8fae-5d00890f4f51 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:01:58.045745 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebf6ec3-b4ff-4910-b467-95d368b50dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:01:58.046338 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebf6ec3-b4ff-4910-b467-95d368b50dfd None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:58.046618 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebf6ec3-b4ff-4910-b467-95d368b50dfd None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:58.046908 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebf6ec3-b4ff-4910-b467-95d368b50dfd None admin] PATH_INFO: `/v3/projects` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:58.047666 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebf6ec3-b4ff-4910-b467-95d368b50dfd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:01:58.048116 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebf6ec3-b4ff-4910-b467-95d368b50dfd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:01:58.049548 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebf6ec3-b4ff-4910-b467-95d368b50dfd None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:01:58.060958 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 637/1259] 10.222.0.49 () {56 vars in 1148 bytes} [Thu Sep 29 02:01:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:01:58.066929 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952639b2-a5c9-49e9-a951-1f541d131e8b None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:01:58.093104 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:01:58.165894 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952639b2-a5c9-49e9-a951-1f541d131e8b None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:01:58.200587 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3a0766-7de9-4e41-a494-e3cc95602288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:01:58.201178 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a0766-7de9-4e41-a494-e3cc95602288 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:01:58.201485 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a0766-7de9-4e41-a494-e3cc95602288 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:01:58.201759 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a0766-7de9-4e41-a494-e3cc95602288 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:01:58.202474 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3a0766-7de9-4e41-a494-e3cc95602288 None admin] RBAC: Adding query filter params (role.id=fe9bbc67742f4f5893f39b18eb31d59a, scope.project.id=6f1d8fd250c84c5887cb3173053ea2dd, user.id=3cbb39731a6b42e2a6647d6134b5c7cd) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:01:58.202779 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3a0766-7de9-4e41-a494-e3cc95602288 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:01:58.205059 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3a0766-7de9-4e41-a494-e3cc95602288 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:01:58.210236 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 623/1260] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Sep 29 02:01:58 2022] GET /identity/v3/role_assignments?user.id=3cbb39731a6b42e2a6647d6134b5c7cd&scope.project.id=6f1d8fd250c84c5887cb3173053ea2dd&role.id=fe9bbc67742f4f5893f39b18eb31d59a => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:02:00.328998 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e9cce2-6a98-4cf5-b197-81d7f5ab84e0 None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:02:00.329567 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e9cce2-6a98-4cf5-b197-81d7f5ab84e0 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:02:00.329567 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e9cce2-6a98-4cf5-b197-81d7f5ab84e0 None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:02:00.330927 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 638/1261] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 02:02:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:02:00.336070 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7812b339-e664-412c-9623-6fb132b93a1e None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:02:00.336455 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7812b339-e664-412c-9623-6fb132b93a1e None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:02:00.336611 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7812b339-e664-412c-9623-6fb132b93a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:02:00.354945 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-7812b339-e664-412c-9623-6fb132b93a1e None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:02:00.356122 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-7812b339-e664-412c-9623-6fb132b93a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:02:00.420024 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 624/1262] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 02:02:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 29 02:02:00.706937 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e9cce2-6a98-4cf5-b197-81d7f5ab84e0 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:02:00.717657 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:02:00.807896 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e9cce2-6a98-4cf5-b197-81d7f5ab84e0 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:02:00.840011 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b92d6b0-1d27-4c09-ba30-cb8e3c167d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:02:00.840638 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b92d6b0-1d27-4c09-ba30-cb8e3c167d2d None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:02:00.840911 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b92d6b0-1d27-4c09-ba30-cb8e3c167d2d None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:02:00.841179 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b92d6b0-1d27-4c09-ba30-cb8e3c167d2d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:02:00.851654 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b92d6b0-1d27-4c09-ba30-cb8e3c167d2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 02:02:00.856403 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-4b92d6b0-1d27-4c09-ba30-cb8e3c167d2d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 02:02:00.856403 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 02:02:00.856403 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 02:02:00.856403 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 02:02:00.856403 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 02:02:00.856403 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 02:02:00.856403 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 02:02:00.856403 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 02:02:00.856403 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 02:02:00.856403 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 02:02:00.856403 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 02:02:00.856403 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 02:02:00.856403 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 02:02:00.856403 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 02:02:00.856403 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 02:02:00.856403 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 02:02:00.857505 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 02:02:00.857505 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 02:02:00.857505 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 02:02:00.857505 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 02:02:00.857505 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 02:02:00.857505 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 02:02:00.857505 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 02:02:00.857505 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 02:02:00.857505 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 02:02:00.857505 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 02:02:00.857505 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 02:02:00.857505 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 02:02:00.857505 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 02:02:00.857505 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 02:02:00.857505 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 02:02:00.857505 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 02:02:00.858703 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 02:02:00.858703 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 02:02:00.858703 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 02:02:00.858703 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 02:02:00.858703 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 02:02:00.858703 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 02:02:00.858703 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 02:02:00.858703 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 02:02:00.858703 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 02:02:00.858703 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 02:02:00.858703 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 02:02:00.858703 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 02:02:00.858703 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 639/1263] 10.222.0.49 () {56 vars in 1096 bytes} [Thu Sep 29 02:02:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 02:02:00.864062 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7812b339-e664-412c-9623-6fb132b93a1e None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:02:00.881659 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:02:00.960820 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7812b339-e664-412c-9623-6fb132b93a1e None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:02:00.992991 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375ebd0b-af44-450f-aa0c-61c7dae3c04b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:02:00.993606 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ebd0b-af44-450f-aa0c-61c7dae3c04b None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:02:00.993886 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ebd0b-af44-450f-aa0c-61c7dae3c04b None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:02:00.994158 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ebd0b-af44-450f-aa0c-61c7dae3c04b None admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:02:00.994809 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375ebd0b-af44-450f-aa0c-61c7dae3c04b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:02:00.995107 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375ebd0b-af44-450f-aa0c-61c7dae3c04b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:02:00.996458 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375ebd0b-af44-450f-aa0c-61c7dae3c04b None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:02:01.004335 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 625/1264] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Sep 29 02:02:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:02:01.010082 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b92d6b0-1d27-4c09-ba30-cb8e3c167d2d None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:02:01.075452 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:02:01.108951 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b92d6b0-1d27-4c09-ba30-cb8e3c167d2d None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:02:01.142056 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bd358d-ebe3-4c06-abc3-109d947d2c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:02:01.142673 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd358d-ebe3-4c06-abc3-109d947d2c66 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:02:01.142952 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd358d-ebe3-4c06-abc3-109d947d2c66 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:02:01.143223 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd358d-ebe3-4c06-abc3-109d947d2c66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:02:01.152932 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bd358d-ebe3-4c06-abc3-109d947d2c66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:02:01.154412 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bd358d-ebe3-4c06-abc3-109d947d2c66 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:02:01.169467 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-d5bd358d-ebe3-4c06-abc3-109d947d2c66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 02:02:01.169467 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 02:02:01.169467 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 02:02:01.169467 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 02:02:01.169467 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 02:02:01.169467 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 02:02:01.169467 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 02:02:01.169467 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 02:02:01.169467 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 02:02:01.169467 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 02:02:01.169467 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 02:02:01.169467 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 02:02:01.169467 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 02:02:01.169467 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 02:02:01.169467 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 02:02:01.169467 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 02:02:01.170591 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 02:02:01.170591 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 02:02:01.170591 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 02:02:01.170591 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 02:02:01.170591 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 02:02:01.170591 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 02:02:01.170591 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 02:02:01.170591 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 02:02:01.170591 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 02:02:01.170591 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 02:02:01.170591 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 02:02:01.170591 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 02:02:01.170591 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 02:02:01.170591 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 02:02:01.170591 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 02:02:01.170591 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 02:02:01.170591 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 02:02:01.171712 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 02:02:01.171712 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 02:02:01.171712 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 02:02:01.171712 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 640/1265] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 02:02:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 02:02:01.177123 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375ebd0b-af44-450f-aa0c-61c7dae3c04b None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:02:01.255880 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:02:01.275307 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375ebd0b-af44-450f-aa0c-61c7dae3c04b None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:02:01.307796 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2713ea3f-4e7c-4117-9cc1-26c526e2b36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:02:01.308391 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2713ea3f-4e7c-4117-9cc1-26c526e2b36a None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:02:01.308671 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2713ea3f-4e7c-4117-9cc1-26c526e2b36a None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:02:01.308941 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2713ea3f-4e7c-4117-9cc1-26c526e2b36a None admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:02:01.309613 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2713ea3f-4e7c-4117-9cc1-26c526e2b36a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:02:01.309916 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2713ea3f-4e7c-4117-9cc1-26c526e2b36a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:02:01.311277 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2713ea3f-4e7c-4117-9cc1-26c526e2b36a None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:02:01.323289 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 626/1266] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Sep 29 02:02:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:02:01.329030 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bd358d-ebe3-4c06-abc3-109d947d2c66 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:02:01.424910 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bd358d-ebe3-4c06-abc3-109d947d2c66 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:02:01.443935 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:02:01.458614 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf25ada-c52f-4fd5-b9f7-f5adaac382e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:02:01.459220 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf25ada-c52f-4fd5-b9f7-f5adaac382e3 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:02:01.459497 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf25ada-c52f-4fd5-b9f7-f5adaac382e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:02:01.459765 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf25ada-c52f-4fd5-b9f7-f5adaac382e3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:02:01.466843 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf25ada-c52f-4fd5-b9f7-f5adaac382e3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:02:01.468265 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf25ada-c52f-4fd5-b9f7-f5adaac382e3 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:02:01.479246 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-1bf25ada-c52f-4fd5-b9f7-f5adaac382e3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 29 02:02:01.479246 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 02:02:01.479246 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 02:02:01.479246 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 02:02:01.479246 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 02:02:01.479246 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 02:02:01.479246 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 02:02:01.479246 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 02:02:01.479246 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 02:02:01.479246 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 02:02:01.479246 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 02:02:01.479246 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 02:02:01.479246 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 29 02:02:01.479246 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 29 02:02:01.479246 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 29 02:02:01.479246 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 29 02:02:01.480396 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 02:02:01.480396 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 02:02:01.480396 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 29 02:02:01.480396 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 02:02:01.480396 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 29 02:02:01.480396 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 02:02:01.480396 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 02:02:01.480396 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 02:02:01.480396 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 02:02:01.480396 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 02:02:01.480396 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 02:02:01.480396 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 02:02:01.480396 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 02:02:01.480396 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 02:02:01.480396 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 02:02:01.480396 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 02:02:01.480396 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 02:02:01.480396 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 02:02:01.481649 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 02:02:01.481649 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 02:02:01.481649 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 29 02:02:01.481649 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 29 02:02:01.481649 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 29 02:02:01.481649 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 29 02:02:01.481649 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 29 02:02:01.481649 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 29 02:02:01.481649 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 29 02:02:01.481649 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 02:02:01.481649 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 641/1267] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 02:02:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 02:02:01.486231 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2713ea3f-4e7c-4117-9cc1-26c526e2b36a None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:02:01.584491 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2713ea3f-4e7c-4117-9cc1-26c526e2b36a None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:02:01.621118 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cc2078-92d8-4b17-a144-f70dc7150146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:02:01.621747 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc2078-92d8-4b17-a144-f70dc7150146 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:02:01.622026 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc2078-92d8-4b17-a144-f70dc7150146 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:02:01.622296 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc2078-92d8-4b17-a144-f70dc7150146 None admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:02:01.623013 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cc2078-92d8-4b17-a144-f70dc7150146 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:02:01.623313 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cc2078-92d8-4b17-a144-f70dc7150146 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:02:01.624718 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cc2078-92d8-4b17-a144-f70dc7150146 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:02:01.633910 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:02:01.642308 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 627/1268] 10.222.0.49 () {56 vars in 1143 bytes} [Thu Sep 29 02:02:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:02:01.648101 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf25ada-c52f-4fd5-b9f7-f5adaac382e3 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:02:01.745951 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf25ada-c52f-4fd5-b9f7-f5adaac382e3 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:02:01.778591 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc29f882-12fb-493a-b580-69c33393110b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:02:01.779202 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc29f882-12fb-493a-b580-69c33393110b None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:02:01.779479 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc29f882-12fb-493a-b580-69c33393110b None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:02:01.779750 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc29f882-12fb-493a-b580-69c33393110b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:02:01.790337 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc29f882-12fb-493a-b580-69c33393110b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:02:01.791764 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc29f882-12fb-493a-b580-69c33393110b None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:02:01.806188 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-cc29f882-12fb-493a-b580-69c33393110b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 02:02:01.806188 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 02:02:01.806188 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 02:02:01.806188 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 02:02:01.806188 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 02:02:01.806188 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 02:02:01.806188 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 02:02:01.806188 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 02:02:01.806188 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 02:02:01.806188 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 02:02:01.806188 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 02:02:01.806188 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 02:02:01.806188 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 02:02:01.806188 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 02:02:01.806188 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 02:02:01.806188 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 02:02:01.807314 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 02:02:01.807314 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 02:02:01.807314 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 02:02:01.807314 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 02:02:01.807314 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 02:02:01.807314 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 02:02:01.807314 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 02:02:01.807314 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 02:02:01.807314 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 02:02:01.807314 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 02:02:01.807314 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 02:02:01.807314 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 02:02:01.807314 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 02:02:01.807314 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 02:02:01.807314 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 02:02:01.807314 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 02:02:01.807314 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 02:02:01.808366 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 02:02:01.808366 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 02:02:01.808366 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 02:02:01.808366 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 642/1269] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 02:02:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 02:02:01.813532 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cc2078-92d8-4b17-a144-f70dc7150146 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:02:01.910669 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cc2078-92d8-4b17-a144-f70dc7150146 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:02:01.943726 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cc3e1d-bebc-45cd-8181-cefb07dc5f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:02:01.944313 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cc3e1d-bebc-45cd-8181-cefb07dc5f94 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:02:01.944585 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cc3e1d-bebc-45cd-8181-cefb07dc5f94 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:02:01.944851 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cc3e1d-bebc-45cd-8181-cefb07dc5f94 None admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:02:01.945503 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cc3e1d-bebc-45cd-8181-cefb07dc5f94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:02:01.945796 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cc3e1d-bebc-45cd-8181-cefb07dc5f94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:02:01.947129 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cc3e1d-bebc-45cd-8181-cefb07dc5f94 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:02:01.957966 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 628/1270] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Sep 29 02:02:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:02:01.963731 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc29f882-12fb-493a-b580-69c33393110b None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:02:01.994692 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:02:02.061599 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc29f882-12fb-493a-b580-69c33393110b None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:02:02.093212 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fcdc6a-f87c-4231-a173-80d9ef79620b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:02:02.093849 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fcdc6a-f87c-4231-a173-80d9ef79620b None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:02:02.094704 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fcdc6a-f87c-4231-a173-80d9ef79620b None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:02:02.094967 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fcdc6a-f87c-4231-a173-80d9ef79620b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:02:02.101249 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fcdc6a-f87c-4231-a173-80d9ef79620b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:02:02.102689 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fcdc6a-f87c-4231-a173-80d9ef79620b None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:02:02.114151 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-66fcdc6a-f87c-4231-a173-80d9ef79620b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 02:02:02.114151 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 02:02:02.114151 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 02:02:02.114151 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 02:02:02.114151 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 02:02:02.114151 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 02:02:02.114151 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 02:02:02.114151 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 02:02:02.114151 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 02:02:02.114151 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 02:02:02.114151 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 02:02:02.114151 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 02:02:02.114151 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 29 02:02:02.114151 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 29 02:02:02.114151 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 29 02:02:02.115043 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 29 02:02:02.115043 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 02:02:02.115043 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 02:02:02.115043 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 02:02:02.115043 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 02:02:02.115043 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 02:02:02.115043 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 02:02:02.115043 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 02:02:02.115043 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 02:02:02.115043 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 02:02:02.115043 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 02:02:02.115043 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 02:02:02.115043 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 02:02:02.115043 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 02:02:02.115043 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 02:02:02.115043 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 02:02:02.115043 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 02:02:02.116018 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 29 02:02:02.116018 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 29 02:02:02.116018 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 29 02:02:02.116018 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 29 02:02:02.116018 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 29 02:02:02.116018 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 29 02:02:02.116018 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 02:02:02.116018 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 02:02:02.116018 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 643/1271] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Sep 29 02:02:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 02:02:02.121039 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cc3e1d-bebc-45cd-8181-cefb07dc5f94 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:02:02.177508 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:02:02.217295 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cc3e1d-bebc-45cd-8181-cefb07dc5f94 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:02:02.250083 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a679a21f-9808-4f63-a563-738fa1ce26ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:02:02.250674 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a679a21f-9808-4f63-a563-738fa1ce26ac None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:02:02.250950 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a679a21f-9808-4f63-a563-738fa1ce26ac None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:02:02.251221 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a679a21f-9808-4f63-a563-738fa1ce26ac None admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:02:02.251903 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a679a21f-9808-4f63-a563-738fa1ce26ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:02:02.252205 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a679a21f-9808-4f63-a563-738fa1ce26ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:02:02.253644 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a679a21f-9808-4f63-a563-738fa1ce26ac None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:02:02.265094 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 629/1272] 10.222.0.49 () {56 vars in 1148 bytes} [Thu Sep 29 02:02:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:02:02.271535 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fcdc6a-f87c-4231-a173-80d9ef79620b None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:02:02.359450 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:02:02.369209 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fcdc6a-f87c-4231-a173-80d9ef79620b None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:02:02.401720 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbd6b0b-b698-4cea-910a-beb09314f8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:02:02.402350 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbd6b0b-b698-4cea-910a-beb09314f8ef None admin] REQUEST_METHOD: `PUT` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:02:02.402624 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbd6b0b-b698-4cea-910a-beb09314f8ef None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:02:02.402890 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbd6b0b-b698-4cea-910a-beb09314f8ef None admin] PATH_INFO: `/v3/projects/6f1d8fd250c84c5887cb3173053ea2dd/users/3cbb39731a6b42e2a6647d6134b5c7cd/roles/fe9bbc67742f4f5893f39b18eb31d59a` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:02:02.404714 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbd6b0b-b698-4cea-910a-beb09314f8ef None admin] RBAC: Authorizing `identity:create_grant(project_id=6f1d8fd250c84c5887cb3173053ea2dd, user_id=3cbb39731a6b42e2a6647d6134b5c7cd, role_id=fe9bbc67742f4f5893f39b18eb31d59a)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:02:02.406155 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbd6b0b-b698-4cea-910a-beb09314f8ef None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:02:02.419302 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 644/1273] 10.222.0.49 () {58 vars in 1439 bytes} [Thu Sep 29 02:02:02 2022] PUT /identity/v3/projects/6f1d8fd250c84c5887cb3173053ea2dd/users/3cbb39731a6b42e2a6647d6134b5c7cd/roles/fe9bbc67742f4f5893f39b18eb31d59a => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:02:04.539428 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c1249-86c1-41d0-8cb7-d2be2b145b4f None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:02:04.539960 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c1249-86c1-41d0-8cb7-d2be2b145b4f None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:02:04.539960 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c1249-86c1-41d0-8cb7-d2be2b145b4f None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:02:04.541280 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 630/1274] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 02:02:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:02:04.546367 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306425d9-4f69-40fd-9665-e98456463c7a None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:02:04.546814 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306425d9-4f69-40fd-9665-e98456463c7a None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:02:04.546965 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306425d9-4f69-40fd-9665-e98456463c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:02:04.565347 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-306425d9-4f69-40fd-9665-e98456463c7a None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:02:04.566525 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-306425d9-4f69-40fd-9665-e98456463c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:02:04.641211 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 645/1275] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 02:02:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 29 02:02:04.913035 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50c1249-86c1-41d0-8cb7-d2be2b145b4f None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:02:05.012599 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50c1249-86c1-41d0-8cb7-d2be2b145b4f None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:02:05.029575 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:02:05.045962 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc78b27-879a-431d-816f-6763bc3d5368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:02:05.046573 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc78b27-879a-431d-816f-6763bc3d5368 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:02:05.046987 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc78b27-879a-431d-816f-6763bc3d5368 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:02:05.047224 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc78b27-879a-431d-816f-6763bc3d5368 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:02:05.056844 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc78b27-879a-431d-816f-6763bc3d5368 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 29 02:02:05.061602 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-5dc78b27-879a-431d-816f-6763bc3d5368 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 02:02:05.061602 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 02:02:05.061602 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 02:02:05.061602 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 02:02:05.061602 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 02:02:05.061602 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 02:02:05.061602 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 02:02:05.061602 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 02:02:05.061602 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 02:02:05.061602 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 02:02:05.061602 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 02:02:05.061602 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 02:02:05.061602 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 29 02:02:05.061602 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 29 02:02:05.061602 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 29 02:02:05.061602 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 29 02:02:05.065415 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 29 02:02:05.065415 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 29 02:02:05.065415 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 29 02:02:05.065415 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 29 02:02:05.065415 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 02:02:05.065415 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 02:02:05.065415 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 02:02:05.065415 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 02:02:05.065415 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 02:02:05.065415 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 02:02:05.065415 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 02:02:05.065415 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 02:02:05.065415 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 02:02:05.065415 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 02:02:05.065415 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 02:02:05.065415 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 02:02:05.066504 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 02:02:05.066504 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 02:02:05.066504 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 02:02:05.066504 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 02:02:05.066504 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 29 02:02:05.066504 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 29 02:02:05.066504 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 29 02:02:05.066504 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 29 02:02:05.066504 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 29 02:02:05.066504 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 29 02:02:05.066504 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 29 02:02:05.066504 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 02:02:05.066504 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 631/1276] 10.222.0.49 () {56 vars in 1096 bytes} [Thu Sep 29 02:02:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 02:02:05.069455 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306425d9-4f69-40fd-9665-e98456463c7a None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:02:05.147193 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:02:05.166225 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306425d9-4f69-40fd-9665-e98456463c7a None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:02:05.198947 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2517418c-cf93-49e9-a183-8987c93beb0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:02:05.199543 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2517418c-cf93-49e9-a183-8987c93beb0c None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:02:05.199823 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2517418c-cf93-49e9-a183-8987c93beb0c None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:02:05.200094 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2517418c-cf93-49e9-a183-8987c93beb0c None admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:02:05.200753 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2517418c-cf93-49e9-a183-8987c93beb0c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:02:05.201054 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2517418c-cf93-49e9-a183-8987c93beb0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:02:05.202452 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2517418c-cf93-49e9-a183-8987c93beb0c None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:02:05.210933 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 646/1277] 10.222.0.49 () {56 vars in 1099 bytes} [Thu Sep 29 02:02:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:02:05.216787 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc78b27-879a-431d-816f-6763bc3d5368 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:02:05.311666 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc78b27-879a-431d-816f-6763bc3d5368 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:02:05.349578 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95807763-6c34-4651-bd46-3187bd9533b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:02:05.350191 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95807763-6c34-4651-bd46-3187bd9533b6 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:02:05.350474 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95807763-6c34-4651-bd46-3187bd9533b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:02:05.350741 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95807763-6c34-4651-bd46-3187bd9533b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:02:05.360962 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95807763-6c34-4651-bd46-3187bd9533b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:02:05.362415 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95807763-6c34-4651-bd46-3187bd9533b6 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:02:05.377109 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-95807763-6c34-4651-bd46-3187bd9533b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 02:02:05.377109 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 02:02:05.377109 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 02:02:05.377109 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 02:02:05.377109 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 02:02:05.377109 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 02:02:05.377109 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 02:02:05.377109 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 02:02:05.377109 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 02:02:05.377109 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 02:02:05.377109 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 02:02:05.377109 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 02:02:05.377109 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 02:02:05.377109 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 02:02:05.377109 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 02:02:05.377109 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 02:02:05.378318 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 02:02:05.378318 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 02:02:05.378318 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 02:02:05.378318 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 02:02:05.378318 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 02:02:05.378318 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 02:02:05.378318 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 02:02:05.378318 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 02:02:05.378318 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 02:02:05.378318 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 02:02:05.378318 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 02:02:05.378318 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 02:02:05.378318 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 02:02:05.378318 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 02:02:05.378318 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 02:02:05.378318 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 02:02:05.378318 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 02:02:05.379233 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 02:02:05.379233 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 02:02:05.379233 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 02:02:05.379233 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 632/1278] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 02:02:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 02:02:05.384151 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2517418c-cf93-49e9-a183-8987c93beb0c None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:02:05.486225 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2517418c-cf93-49e9-a183-8987c93beb0c None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:02:05.518971 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8b1040-0ddb-4497-ad31-3e2c76d6959a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:02:05.519563 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8b1040-0ddb-4497-ad31-3e2c76d6959a None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:02:05.519840 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8b1040-0ddb-4497-ad31-3e2c76d6959a None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:02:05.520110 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8b1040-0ddb-4497-ad31-3e2c76d6959a None admin] PATH_INFO: `/v3/domains` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:02:05.520753 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8b1040-0ddb-4497-ad31-3e2c76d6959a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:02:05.521056 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8b1040-0ddb-4497-ad31-3e2c76d6959a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:02:05.522448 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8b1040-0ddb-4497-ad31-3e2c76d6959a None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:02:05.534539 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 647/1279] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Sep 29 02:02:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:02:05.540089 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95807763-6c34-4651-bd46-3187bd9533b6 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:02:05.570471 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:02:05.642826 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95807763-6c34-4651-bd46-3187bd9533b6 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:02:05.675204 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1584eac9-1d45-4633-9ebd-6e36ea49f1f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:02:05.675816 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1584eac9-1d45-4633-9ebd-6e36ea49f1f9 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:02:05.676094 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1584eac9-1d45-4633-9ebd-6e36ea49f1f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:02:05.676362 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1584eac9-1d45-4633-9ebd-6e36ea49f1f9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:02:05.683458 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1584eac9-1d45-4633-9ebd-6e36ea49f1f9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:02:05.684869 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1584eac9-1d45-4633-9ebd-6e36ea49f1f9 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:02:05.696313 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-1584eac9-1d45-4633-9ebd-6e36ea49f1f9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 29 02:02:05.696313 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 02:02:05.696313 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 02:02:05.696313 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 02:02:05.696313 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 02:02:05.696313 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 02:02:05.696313 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 02:02:05.696313 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 02:02:05.696313 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 02:02:05.696313 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 02:02:05.696313 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 02:02:05.696313 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 02:02:05.696313 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 29 02:02:05.696313 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 29 02:02:05.696313 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 29 02:02:05.696313 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 29 02:02:05.697425 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 02:02:05.697425 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 02:02:05.697425 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 29 02:02:05.697425 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 02:02:05.697425 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 29 02:02:05.697425 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 29 02:02:05.697425 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 02:02:05.697425 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 02:02:05.697425 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 02:02:05.697425 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 02:02:05.697425 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 02:02:05.697425 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 02:02:05.697425 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 02:02:05.697425 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 02:02:05.697425 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 02:02:05.697425 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 02:02:05.697425 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 02:02:05.697425 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 02:02:05.698393 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 02:02:05.698393 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 02:02:05.698393 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 29 02:02:05.698393 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 29 02:02:05.698393 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 29 02:02:05.698393 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 29 02:02:05.698393 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 29 02:02:05.698393 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 29 02:02:05.698393 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 29 02:02:05.698393 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 02:02:05.698393 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 633/1280] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 02:02:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 02:02:05.703366 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8b1040-0ddb-4497-ad31-3e2c76d6959a None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:02:05.707114 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:02:05.801442 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8b1040-0ddb-4497-ad31-3e2c76d6959a None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:02:05.833850 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e02a829-66c7-428e-927a-c3a436292038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:02:05.834449 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e02a829-66c7-428e-927a-c3a436292038 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:02:05.834733 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e02a829-66c7-428e-927a-c3a436292038 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:02:05.835007 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e02a829-66c7-428e-927a-c3a436292038 None admin] PATH_INFO: `/v3/users` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:02:05.835720 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e02a829-66c7-428e-927a-c3a436292038 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:02:05.836025 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e02a829-66c7-428e-927a-c3a436292038 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:02:05.837473 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e02a829-66c7-428e-927a-c3a436292038 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:02:05.854576 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 648/1281] 10.222.0.49 () {56 vars in 1143 bytes} [Thu Sep 29 02:02:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:02:05.860857 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1584eac9-1d45-4633-9ebd-6e36ea49f1f9 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:02:05.950256 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:02:05.960146 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1584eac9-1d45-4633-9ebd-6e36ea49f1f9 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:02:05.993170 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be28f494-6836-40f1-ad7b-b178d57520df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:02:05.993790 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be28f494-6836-40f1-ad7b-b178d57520df None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:02:05.994067 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be28f494-6836-40f1-ad7b-b178d57520df None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:02:05.994338 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be28f494-6836-40f1-ad7b-b178d57520df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:02:06.058451 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be28f494-6836-40f1-ad7b-b178d57520df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:02:06.059872 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be28f494-6836-40f1-ad7b-b178d57520df None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:02:06.144192 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:02:06.154495 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 634/1282] 10.222.0.49 () {58 vars in 1282 bytes} [Thu Sep 29 02:02:05 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 29 02:02:06.161192 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e02a829-66c7-428e-927a-c3a436292038 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:02:06.219936 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:02:06.256626 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e02a829-66c7-428e-927a-c3a436292038 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:02:06.292005 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5580033d-781d-4ae6-a5bf-1317f3f89d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:02:06.292621 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5580033d-781d-4ae6-a5bf-1317f3f89d65 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:02:06.292897 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5580033d-781d-4ae6-a5bf-1317f3f89d65 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:02:06.293163 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5580033d-781d-4ae6-a5bf-1317f3f89d65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:02:06.303571 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5580033d-781d-4ae6-a5bf-1317f3f89d65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:02:06.304994 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5580033d-781d-4ae6-a5bf-1317f3f89d65 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:02:06.319249 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-5580033d-781d-4ae6-a5bf-1317f3f89d65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 02:02:06.319249 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 02:02:06.319249 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 02:02:06.319249 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 02:02:06.319249 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 02:02:06.319249 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 02:02:06.319249 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 02:02:06.319249 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 02:02:06.319249 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 02:02:06.319249 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 02:02:06.319249 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 02:02:06.319249 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 02:02:06.319249 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 29 02:02:06.319249 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 29 02:02:06.319249 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 29 02:02:06.319249 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 29 02:02:06.320357 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 02:02:06.320357 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 02:02:06.320357 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 02:02:06.320357 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 02:02:06.320357 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 02:02:06.320357 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 02:02:06.320357 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 02:02:06.320357 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 02:02:06.320357 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 02:02:06.320357 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 02:02:06.320357 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 02:02:06.320357 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 02:02:06.320357 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 02:02:06.320357 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 02:02:06.320357 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 02:02:06.320357 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 02:02:06.320357 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 29 02:02:06.321473 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 29 02:02:06.321473 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 29 02:02:06.321473 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 02:02:06.321473 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 649/1283] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 02:02:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 02:02:06.325968 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be28f494-6836-40f1-ad7b-b178d57520df None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:02:06.420259 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be28f494-6836-40f1-ad7b-b178d57520df None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:02:06.451751 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c457370-42f7-46a0-b3d5-ff599bab1457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:02:06.452333 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c457370-42f7-46a0-b3d5-ff599bab1457 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:02:06.452608 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c457370-42f7-46a0-b3d5-ff599bab1457 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:02:06.453436 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c457370-42f7-46a0-b3d5-ff599bab1457 None admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:02:06.454174 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c457370-42f7-46a0-b3d5-ff599bab1457 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:02:06.454471 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c457370-42f7-46a0-b3d5-ff599bab1457 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:02:06.455801 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c457370-42f7-46a0-b3d5-ff599bab1457 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:02:06.466406 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 635/1284] 10.222.0.49 () {56 vars in 1109 bytes} [Thu Sep 29 02:02:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 02:02:06.472061 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5580033d-781d-4ae6-a5bf-1317f3f89d65 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:02:06.569852 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5580033d-781d-4ae6-a5bf-1317f3f89d65 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:02:06.584256 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:02:06.604820 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426bc57b-a478-482c-833e-b90b46d37ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:02:06.605479 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426bc57b-a478-482c-833e-b90b46d37ac3 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:02:06.605758 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426bc57b-a478-482c-833e-b90b46d37ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:02:06.606025 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426bc57b-a478-482c-833e-b90b46d37ac3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:02:06.613204 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426bc57b-a478-482c-833e-b90b46d37ac3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:02:06.614662 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426bc57b-a478-482c-833e-b90b46d37ac3 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:02:06.625690 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-426bc57b-a478-482c-833e-b90b46d37ac3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 02:02:06.625690 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 02:02:06.625690 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 02:02:06.625690 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 02:02:06.625690 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 02:02:06.625690 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 02:02:06.625690 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 02:02:06.625690 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 02:02:06.625690 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 02:02:06.625690 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 02:02:06.625690 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 02:02:06.625690 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 02:02:06.625690 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 29 02:02:06.625690 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 29 02:02:06.625690 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 29 02:02:06.626710 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 29 02:02:06.626710 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 02:02:06.626710 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 02:02:06.626710 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 02:02:06.626710 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 02:02:06.626710 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 02:02:06.626710 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 02:02:06.626710 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 02:02:06.626710 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 02:02:06.626710 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 02:02:06.626710 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 02:02:06.626710 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 02:02:06.626710 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 02:02:06.626710 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 02:02:06.626710 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 02:02:06.626710 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 02:02:06.626710 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 02:02:06.627837 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 29 02:02:06.627837 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 29 02:02:06.627837 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 29 02:02:06.627837 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 29 02:02:06.627837 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 29 02:02:06.627837 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 29 02:02:06.627837 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 29 02:02:06.627837 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 02:02:06.627837 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 650/1285] 10.222.0.49 () {56 vars in 1111 bytes} [Thu Sep 29 02:02:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 02:02:06.632607 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c457370-42f7-46a0-b3d5-ff599bab1457 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:02:06.681609 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:02:06.730066 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c457370-42f7-46a0-b3d5-ff599bab1457 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:02:06.762366 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4139cae-5759-4e28-954f-19e32453ca9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:02:06.762952 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4139cae-5759-4e28-954f-19e32453ca9e None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:02:06.763228 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4139cae-5759-4e28-954f-19e32453ca9e None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:02:06.763497 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4139cae-5759-4e28-954f-19e32453ca9e None admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:02:06.764175 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4139cae-5759-4e28-954f-19e32453ca9e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:02:06.764476 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4139cae-5759-4e28-954f-19e32453ca9e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:02:06.765948 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4139cae-5759-4e28-954f-19e32453ca9e None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:02:06.777304 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 636/1286] 10.222.0.49 () {56 vars in 1148 bytes} [Thu Sep 29 02:02:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:02:06.784160 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426bc57b-a478-482c-833e-b90b46d37ac3 None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:02:06.880165 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426bc57b-a478-482c-833e-b90b46d37ac3 None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:02:06.913530 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ab55e1-c580-4635-8fcc-7b8ec0830f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:02:06.914139 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab55e1-c580-4635-8fcc-7b8ec0830f66 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:02:06.914419 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab55e1-c580-4635-8fcc-7b8ec0830f66 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:02:06.914691 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab55e1-c580-4635-8fcc-7b8ec0830f66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:02:06.915405 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ab55e1-c580-4635-8fcc-7b8ec0830f66 None admin] RBAC: Adding query filter params (role.id=fe9bbc67742f4f5893f39b18eb31d59a, scope.project.id=6f1d8fd250c84c5887cb3173053ea2dd, user.id=3cbb39731a6b42e2a6647d6134b5c7cd) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:02:06.915710 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ab55e1-c580-4635-8fcc-7b8ec0830f66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:02:06.917145 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ab55e1-c580-4635-8fcc-7b8ec0830f66 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:02:06.922918 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 651/1287] 10.222.0.49 () {56 vars in 1374 bytes} [Thu Sep 29 02:02:06 2022] GET /identity/v3/role_assignments?user.id=3cbb39731a6b42e2a6647d6134b5c7cd&scope.project.id=6f1d8fd250c84c5887cb3173053ea2dd&role.id=fe9bbc67742f4f5893f39b18eb31d59a => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:02:09.076361 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcff695-fa1e-480b-b2d3-249a94cb0889 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:02:09.076950 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcff695-fa1e-480b-b2d3-249a94cb0889 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:02:09.076950 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcff695-fa1e-480b-b2d3-249a94cb0889 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:02:09.078988 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 637/1288] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 02:02:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:02:09.084164 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb361dbb-1193-4443-bc38-c64fa0c1da2e None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:02:09.084586 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb361dbb-1193-4443-bc38-c64fa0c1da2e None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:02:09.084710 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb361dbb-1193-4443-bc38-c64fa0c1da2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:02:09.102613 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-fb361dbb-1193-4443-bc38-c64fa0c1da2e None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:02:09.103794 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-fb361dbb-1193-4443-bc38-c64fa0c1da2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:02:09.133225 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:02:09.169359 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 652/1289] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 02:02:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 29 02:02:09.439642 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcff695-fa1e-480b-b2d3-249a94cb0889 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:02:09.539192 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcff695-fa1e-480b-b2d3-249a94cb0889 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:02:09.550061 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:02:09.572953 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0281001a-4d0f-4cf6-aea8-1f7d220b908f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:02:09.573613 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0281001a-4d0f-4cf6-aea8-1f7d220b908f None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:02:09.573898 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0281001a-4d0f-4cf6-aea8-1f7d220b908f None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:02:09.574165 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0281001a-4d0f-4cf6-aea8-1f7d220b908f None admin] PATH_INFO: `/v3/services/placement` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:02:09.574739 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0281001a-4d0f-4cf6-aea8-1f7d220b908f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:02:09.576076 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0281001a-4d0f-4cf6-aea8-1f7d220b908f None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:02:09.586923 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-0281001a-4d0f-4cf6-aea8-1f7d220b908f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 29 02:02:09.586923 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 02:02:09.586923 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 29 02:02:09.586923 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 29 02:02:09.586923 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 29 02:02:09.586923 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 29 02:02:09.586923 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 29 02:02:09.586923 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 29 02:02:09.586923 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 29 02:02:09.586923 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 02:02:09.586923 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 29 02:02:09.586923 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 02:02:09.586923 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 02:02:09.586923 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 02:02:09.586923 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 02:02:09.586923 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 02:02:09.586923 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 02:02:09.588191 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 02:02:09.588191 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 02:02:09.588191 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 02:02:09.588191 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 02:02:09.588191 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 02:02:09.588191 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 02:02:09.588191 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 29 02:02:09.588191 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 29 02:02:09.588191 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 29 02:02:09.588191 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 29 02:02:09.588191 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 02:02:09.588191 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 02:02:09.588191 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 02:02:09.588191 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 02:02:09.588191 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 02:02:09.588191 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 02:02:09.589450 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 02:02:09.589450 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 02:02:09.589450 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 02:02:09.589450 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 02:02:09.589450 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 02:02:09.589450 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 02:02:09.589450 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 02:02:09.589450 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 02:02:09.589450 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 02:02:09.589450 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 02:02:09.589450 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 29 02:02:09.589450 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 29 02:02:09.589450 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 29 02:02:09.589450 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 02:02:09.589450 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 638/1290] 10.222.0.49 () {56 vars in 1117 bytes} [Thu Sep 29 02:02:09 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 02:02:09.594991 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb361dbb-1193-4443-bc38-c64fa0c1da2e None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:02:09.703574 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb361dbb-1193-4443-bc38-c64fa0c1da2e None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:02:09.736810 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cb9633-beef-466c-bd70-313264914379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:02:09.737438 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cb9633-beef-466c-bd70-313264914379 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:02:09.737718 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cb9633-beef-466c-bd70-313264914379 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:02:09.737990 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cb9633-beef-466c-bd70-313264914379 None admin] PATH_INFO: `/v3/services` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:02:09.738609 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cb9633-beef-466c-bd70-313264914379 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:02:09.738908 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cb9633-beef-466c-bd70-313264914379 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:02:09.740275 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cb9633-beef-466c-bd70-313264914379 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:02:09.744939 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 653/1291] 10.222.0.49 () {56 vars in 1116 bytes} [Thu Sep 29 02:02:09 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:02:09.750778 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0281001a-4d0f-4cf6-aea8-1f7d220b908f None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:02:09.846231 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0281001a-4d0f-4cf6-aea8-1f7d220b908f None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:02:09.877896 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0712ce46-7c1f-44aa-8c8d-8b062d1ba495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:02:09.878481 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0712ce46-7c1f-44aa-8c8d-8b062d1ba495 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:02:09.878757 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0712ce46-7c1f-44aa-8c8d-8b062d1ba495 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:02:09.879026 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0712ce46-7c1f-44aa-8c8d-8b062d1ba495 None admin] PATH_INFO: `/v3/services` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:02:09.879645 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0712ce46-7c1f-44aa-8c8d-8b062d1ba495 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:02:09.879941 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0712ce46-7c1f-44aa-8c8d-8b062d1ba495 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:02:09.881329 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0712ce46-7c1f-44aa-8c8d-8b062d1ba495 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:02:09.885532 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 639/1292] 10.222.0.49 () {56 vars in 1116 bytes} [Thu Sep 29 02:02:09 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:02:11.992848 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27198508-c85d-4756-8abc-c4cb1550e0b4 None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:02:11.993392 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27198508-c85d-4756-8abc-c4cb1550e0b4 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:02:11.993488 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27198508-c85d-4756-8abc-c4cb1550e0b4 None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:02:11.994745 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 654/1293] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 02:02:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:02:12.000548 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f1f8bc-3aae-405f-b4a6-e7b6441ef089 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:02:12.000959 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f1f8bc-3aae-405f-b4a6-e7b6441ef089 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:02:12.001097 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f1f8bc-3aae-405f-b4a6-e7b6441ef089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:02:12.019398 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-55f1f8bc-3aae-405f-b4a6-e7b6441ef089 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:02:12.020589 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-55f1f8bc-3aae-405f-b4a6-e7b6441ef089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:02:12.049054 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:02:12.085109 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 640/1294] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 02:02:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 29 02:02:12.350487 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27198508-c85d-4756-8abc-c4cb1550e0b4 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:02:12.381842 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:02:12.450583 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27198508-c85d-4756-8abc-c4cb1550e0b4 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:02:12.485810 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6212ea6c-3274-4937-bfba-74d22098b143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:02:12.486415 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6212ea6c-3274-4937-bfba-74d22098b143 None admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:02:12.486689 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6212ea6c-3274-4937-bfba-74d22098b143 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:02:12.486955 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6212ea6c-3274-4937-bfba-74d22098b143 None admin] PATH_INFO: `/v3/services` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:02:12.487609 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6212ea6c-3274-4937-bfba-74d22098b143 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:02:12.488960 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6212ea6c-3274-4937-bfba-74d22098b143 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:02:12.503361 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 655/1295] 10.222.0.49 () {60 vars in 1141 bytes} [Thu Sep 29 02:02:12 2022] POST /identity/v3/services => generated 246 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:02:14.712738 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf02b59e-7be3-4ac1-95cd-bb5b597c6ef0 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:02:14.713273 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf02b59e-7be3-4ac1-95cd-bb5b597c6ef0 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:02:14.713273 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf02b59e-7be3-4ac1-95cd-bb5b597c6ef0 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:02:14.714677 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 641/1296] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 02:02:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:02:14.720649 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599dcb88-c2a3-4ae7-9dc1-6aaceecab95c None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:02:14.721054 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599dcb88-c2a3-4ae7-9dc1-6aaceecab95c None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:02:14.721220 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599dcb88-c2a3-4ae7-9dc1-6aaceecab95c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:02:14.739684 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-599dcb88-c2a3-4ae7-9dc1-6aaceecab95c None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:02:14.740876 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-599dcb88-c2a3-4ae7-9dc1-6aaceecab95c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:02:14.812095 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 656/1297] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 02:02:14 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 29 02:02:15.083896 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf02b59e-7be3-4ac1-95cd-bb5b597c6ef0 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:02:15.182163 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf02b59e-7be3-4ac1-95cd-bb5b597c6ef0 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:02:15.214453 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc20c93-76a3-438b-85ff-a1268c44a447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:02:15.215064 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc20c93-76a3-438b-85ff-a1268c44a447 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:02:15.215339 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc20c93-76a3-438b-85ff-a1268c44a447 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:02:15.215606 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc20c93-76a3-438b-85ff-a1268c44a447 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:02:15.216172 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc20c93-76a3-438b-85ff-a1268c44a447 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:02:15.217658 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc20c93-76a3-438b-85ff-a1268c44a447 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:02:15.226264 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-0fc20c93-76a3-438b-85ff-a1268c44a447 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 29 02:02:15.226264 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 02:02:15.226264 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 29 02:02:15.226264 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 29 02:02:15.226264 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 29 02:02:15.226264 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 29 02:02:15.226264 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 29 02:02:15.226264 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 29 02:02:15.226264 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 29 02:02:15.226264 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 02:02:15.226264 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 29 02:02:15.226264 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 02:02:15.226264 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 02:02:15.226264 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 02:02:15.226264 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 02:02:15.226264 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 02:02:15.226264 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 02:02:15.227424 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 02:02:15.227424 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 02:02:15.227424 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 02:02:15.227424 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 02:02:15.227424 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 02:02:15.227424 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 02:02:15.227424 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 29 02:02:15.227424 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 29 02:02:15.227424 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 29 02:02:15.227424 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 29 02:02:15.227424 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 02:02:15.227424 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 02:02:15.227424 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 02:02:15.227424 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 02:02:15.227424 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 02:02:15.227424 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 02:02:15.228256 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 02:02:15.228256 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 02:02:15.228256 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 02:02:15.228256 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 02:02:15.228256 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 02:02:15.228256 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 02:02:15.228256 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 02:02:15.228256 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 02:02:15.228256 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 02:02:15.228256 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 02:02:15.228256 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 29 02:02:15.228256 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 29 02:02:15.228256 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 29 02:02:15.228256 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 02:02:15.228256 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 642/1298] 10.222.0.49 () {56 vars in 1117 bytes} [Thu Sep 29 02:02:15 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 02:02:15.234000 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599dcb88-c2a3-4ae7-9dc1-6aaceecab95c None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:02:15.252999 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:02:15.333257 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599dcb88-c2a3-4ae7-9dc1-6aaceecab95c None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:02:15.366602 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb29a618-b1f3-441b-bffc-571e5fa1fe0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:02:15.367143 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb29a618-b1f3-441b-bffc-571e5fa1fe0f None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:02:15.367424 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb29a618-b1f3-441b-bffc-571e5fa1fe0f None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:02:15.367699 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb29a618-b1f3-441b-bffc-571e5fa1fe0f None admin] PATH_INFO: `/v3/services` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:02:15.368322 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb29a618-b1f3-441b-bffc-571e5fa1fe0f None admin] RBAC: Adding query filter params (name=placement) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:02:15.368623 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb29a618-b1f3-441b-bffc-571e5fa1fe0f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:02:15.370019 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb29a618-b1f3-441b-bffc-571e5fa1fe0f None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:02:15.375995 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 657/1299] 10.222.0.49 () {56 vars in 1116 bytes} [Thu Sep 29 02:02:15 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:02:15.387383 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc20c93-76a3-438b-85ff-a1268c44a447 None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:02:15.418268 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:02:15.484546 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc20c93-76a3-438b-85ff-a1268c44a447 None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:02:15.516535 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5f11df-dd7c-4606-97d9-d941549af313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:02:15.517116 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f11df-dd7c-4606-97d9-d941549af313 None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:02:15.517417 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f11df-dd7c-4606-97d9-d941549af313 None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:02:15.517686 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f11df-dd7c-4606-97d9-d941549af313 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:02:15.518371 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5f11df-dd7c-4606-97d9-d941549af313 None admin] RBAC: Adding query filter params (interface=public, service_id=fba38f4b65fb4c42a6ba1124e32e372b, region_id=RegionOne) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:02:15.518670 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5f11df-dd7c-4606-97d9-d941549af313 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:02:15.520007 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5f11df-dd7c-4606-97d9-d941549af313 None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:02:15.524731 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 643/1300] 10.222.0.49 () {56 vars in 1251 bytes} [Thu Sep 29 02:02:15 2022] GET /identity/v3/endpoints?service_id=fba38f4b65fb4c42a6ba1124e32e372b&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:02:15.531004 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb29a618-b1f3-441b-bffc-571e5fa1fe0f None admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:02:15.610505 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:02:15.628988 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb29a618-b1f3-441b-bffc-571e5fa1fe0f None admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:02:15.661548 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a6f550-dbc6-4aad-9daa-e55a1d3d3979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:02:15.662137 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a6f550-dbc6-4aad-9daa-e55a1d3d3979 None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:02:15.662412 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a6f550-dbc6-4aad-9daa-e55a1d3d3979 None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:02:15.662676 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a6f550-dbc6-4aad-9daa-e55a1d3d3979 None admin] PATH_INFO: `/v3/services` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:02:15.663262 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a6f550-dbc6-4aad-9daa-e55a1d3d3979 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:02:15.664612 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a6f550-dbc6-4aad-9daa-e55a1d3d3979 None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:02:15.671196 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 658/1301] 10.222.0.49 () {56 vars in 1087 bytes} [Thu Sep 29 02:02:15 2022] GET /identity/v3/services => generated 2191 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:02:17.781958 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac78a5-f4dd-4d05-a495-4c516a6ee031 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:02:17.782517 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac78a5-f4dd-4d05-a495-4c516a6ee031 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:02:17.782517 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac78a5-f4dd-4d05-a495-4c516a6ee031 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:02:17.783815 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 644/1302] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 02:02:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:02:17.788871 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb97de17-8c39-483c-9ea5-4fb27d31aa36 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:02:17.789290 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb97de17-8c39-483c-9ea5-4fb27d31aa36 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:02:17.789452 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb97de17-8c39-483c-9ea5-4fb27d31aa36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:02:17.808210 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-bb97de17-8c39-483c-9ea5-4fb27d31aa36 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:02:17.809413 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-bb97de17-8c39-483c-9ea5-4fb27d31aa36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:02:17.873116 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 659/1303] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 02:02:17 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 29 02:02:18.140462 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ac78a5-f4dd-4d05-a495-4c516a6ee031 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:02:18.232847 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:02:18.241876 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ac78a5-f4dd-4d05-a495-4c516a6ee031 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:02:18.277294 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ebc8c5-41e6-414a-a0cf-d36df5a438bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:02:18.277937 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ebc8c5-41e6-414a-a0cf-d36df5a438bd None admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:02:18.278213 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ebc8c5-41e6-414a-a0cf-d36df5a438bd None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:02:18.278482 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ebc8c5-41e6-414a-a0cf-d36df5a438bd None admin] PATH_INFO: `/v3/services/placement` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:02:18.279060 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ebc8c5-41e6-414a-a0cf-d36df5a438bd None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:02:18.281004 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ebc8c5-41e6-414a-a0cf-d36df5a438bd None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:02:18.289801 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application [None req-d4ebc8c5-41e6-414a-a0cf-d36df5a438bd None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 29 02:02:18.289801 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 02:02:18.289801 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 29 02:02:18.289801 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 29 02:02:18.289801 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 29 02:02:18.289801 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 29 02:02:18.289801 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 29 02:02:18.289801 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 29 02:02:18.289801 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 29 02:02:18.289801 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 02:02:18.289801 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 29 02:02:18.289801 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 02:02:18.289801 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 02:02:18.289801 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 02:02:18.289801 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 02:02:18.289801 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 02:02:18.289801 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 02:02:18.290993 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 02:02:18.290993 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 02:02:18.290993 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 02:02:18.290993 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 02:02:18.290993 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 02:02:18.290993 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 02:02:18.290993 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 29 02:02:18.290993 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 29 02:02:18.290993 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 29 02:02:18.290993 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 29 02:02:18.290993 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 02:02:18.290993 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 02:02:18.290993 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 02:02:18.290993 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 02:02:18.290993 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 02:02:18.290993 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 02:02:18.292020 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 02:02:18.292020 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application with Lock( Sep 29 02:02:18.292020 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 02:02:18.292020 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self._enter() Sep 29 02:02:18.292020 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 02:02:18.292020 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 02:02:18.292020 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 02:02:18.292020 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application return self.creator() Sep 29 02:02:18.292020 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 02:02:18.292020 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application created_value = creator( Sep 29 02:02:18.292020 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 29 02:02:18.292020 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 29 02:02:18.292020 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 29 02:02:18.292020 dv-cinder-740146-21-smb devstack@keystone.service[81649]: ERROR keystone.server.flask.application Sep 29 02:02:18.292020 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 645/1304] 10.222.0.49 () {56 vars in 1117 bytes} [Thu Sep 29 02:02:18 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 29 02:02:18.296890 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb97de17-8c39-483c-9ea5-4fb27d31aa36 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:02:18.370139 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:02:18.393066 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb97de17-8c39-483c-9ea5-4fb27d31aa36 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:02:18.426837 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b812f8f2-1c01-4758-9a22-eca97ac7ceff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:02:18.427436 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b812f8f2-1c01-4758-9a22-eca97ac7ceff None admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:02:18.427713 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b812f8f2-1c01-4758-9a22-eca97ac7ceff None admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:02:18.427981 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b812f8f2-1c01-4758-9a22-eca97ac7ceff None admin] PATH_INFO: `/v3/services` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:02:18.428599 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b812f8f2-1c01-4758-9a22-eca97ac7ceff None admin] RBAC: Adding query filter params (name=placement) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:02:18.428899 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b812f8f2-1c01-4758-9a22-eca97ac7ceff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:02:18.430290 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b812f8f2-1c01-4758-9a22-eca97ac7ceff None admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:02:18.435225 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 660/1305] 10.222.0.49 () {56 vars in 1116 bytes} [Thu Sep 29 02:02:18 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:02:18.441890 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ebc8c5-41e6-414a-a0cf-d36df5a438bd None admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:02:18.539742 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ebc8c5-41e6-414a-a0cf-d36df5a438bd None admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:02:18.572745 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9c1494-e628-41ed-9134-f83f77021c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:02:18.573363 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9c1494-e628-41ed-9134-f83f77021c7d None admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:02:18.573643 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9c1494-e628-41ed-9134-f83f77021c7d None admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:02:18.573909 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9c1494-e628-41ed-9134-f83f77021c7d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:02:18.574569 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9c1494-e628-41ed-9134-f83f77021c7d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:02:18.575916 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9c1494-e628-41ed-9134-f83f77021c7d None admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:02:18.594886 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 646/1306] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 02:02:18 2022] POST /identity/v3/endpoints => generated 331 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 29 02:02:28.432394 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=30 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:02:28.590127 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:03:22.916891 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df214342-7e79-4788-96d8-3edd312718fa None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:03:22.917301 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df214342-7e79-4788-96d8-3edd312718fa None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:03:22.917511 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df214342-7e79-4788-96d8-3edd312718fa None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:03:22.918990 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 661/1307] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 02:03:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:03:22.928864 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85199cfa-b86d-42c1-abfa-f0e0cab3f7db None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:03:22.930591 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85199cfa-b86d-42c1-abfa-f0e0cab3f7db None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:03:22.931537 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85199cfa-b86d-42c1-abfa-f0e0cab3f7db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:03:23.079981 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-85199cfa-b86d-42c1-abfa-f0e0cab3f7db None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:03:23.081207 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-85199cfa-b86d-42c1-abfa-f0e0cab3f7db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:03:23.293546 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 647/1308] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 02:03:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:03:23.590437 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340a550d-87c6-4e76-a9e2-58674e08589a None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:03:23.591165 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340a550d-87c6-4e76-a9e2-58674e08589a None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:03:23.591781 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340a550d-87c6-4e76-a9e2-58674e08589a None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:03:23.594102 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 662/1309] 10.222.0.49 () {54 vars in 964 bytes} [Thu Sep 29 02:03:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:03:23.602163 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a725864-9453-4f77-a9ea-1ce5dbf8181e None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:03:23.602570 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a725864-9453-4f77-a9ea-1ce5dbf8181e None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:03:23.602928 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a725864-9453-4f77-a9ea-1ce5dbf8181e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:03:23.703267 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-6a725864-9453-4f77-a9ea-1ce5dbf8181e None None] MFA Rules not processed for user `2053f823bd3c4098a43c299890c1f733`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:03:23.704696 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-6a725864-9453-4f77-a9ea-1ce5dbf8181e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:03:23.729137 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:03:23.796687 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 648/1310] 10.222.0.49 () {58 vars in 1061 bytes} [Thu Sep 29 02:03:23 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:03:23.806908 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340a550d-87c6-4e76-a9e2-58674e08589a None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:03:23.809028 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-340a550d-87c6-4e76-a9e2-58674e08589a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:03:23.928088 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340a550d-87c6-4e76-a9e2-58674e08589a None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:03:24.011160 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cde711-07f3-4768-ba6a-5a14802d3763 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:03:24.012180 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cde711-07f3-4768-ba6a-5a14802d3763 service neutron] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:03:24.012694 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cde711-07f3-4768-ba6a-5a14802d3763 service neutron] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:03:24.013201 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cde711-07f3-4768-ba6a-5a14802d3763 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:03:24.015201 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-b3cde711-07f3-4768-ba6a-5a14802d3763 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:03:24.078936 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:03:24.145771 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cde711-07f3-4768-ba6a-5a14802d3763 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:03:24.147673 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cde711-07f3-4768-ba6a-5a14802d3763 service neutron] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:03:24.180891 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 663/1311] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:03:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 29 02:03:26.710409 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f8eaa6-54e6-4574-a208-e76d8f0fd074 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:03:26.710940 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f8eaa6-54e6-4574-a208-e76d8f0fd074 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:03:26.711235 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f8eaa6-54e6-4574-a208-e76d8f0fd074 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:03:26.712579 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 649/1312] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 02:03:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:03:26.717909 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa2c50d-7348-4340-9d59-eca1c661a683 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:03:26.718309 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa2c50d-7348-4340-9d59-eca1c661a683 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:03:26.718450 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa2c50d-7348-4340-9d59-eca1c661a683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:03:26.789338 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-aaa2c50d-7348-4340-9d59-eca1c661a683 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:03:26.790478 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-aaa2c50d-7348-4340-9d59-eca1c661a683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:03:26.885880 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 664/1313] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 02:03:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:03:27.165101 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f8eaa6-54e6-4574-a208-e76d8f0fd074 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:03:27.166678 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-55f8eaa6-54e6-4574-a208-e76d8f0fd074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:03:27.268798 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f8eaa6-54e6-4574-a208-e76d8f0fd074 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:03:27.338628 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:03:27.340958 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb88fdf-6b3b-4477-bdcd-9cfff2ebc16c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:03:27.341831 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb88fdf-6b3b-4477-bdcd-9cfff2ebc16c service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:03:27.342312 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb88fdf-6b3b-4477-bdcd-9cfff2ebc16c service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:03:27.342771 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb88fdf-6b3b-4477-bdcd-9cfff2ebc16c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:03:27.344436 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-4eb88fdf-6b3b-4477-bdcd-9cfff2ebc16c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:03:27.451900 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb88fdf-6b3b-4477-bdcd-9cfff2ebc16c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:03:27.453250 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb88fdf-6b3b-4477-bdcd-9cfff2ebc16c service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:03:27.471498 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 650/1314] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:03:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:03:29.929129 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e450d5-d8b2-4696-8309-2c6a6c9c06b6 None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:03:29.929707 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e450d5-d8b2-4696-8309-2c6a6c9c06b6 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:03:29.929707 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e450d5-d8b2-4696-8309-2c6a6c9c06b6 None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:03:29.931038 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 665/1315] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 02:03:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:03:29.936291 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54da3a61-864b-47bf-97e0-c993991e78c3 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:03:29.936706 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54da3a61-864b-47bf-97e0-c993991e78c3 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:03:29.936821 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54da3a61-864b-47bf-97e0-c993991e78c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:03:30.002845 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-54da3a61-864b-47bf-97e0-c993991e78c3 None None] MFA Rules not processed for user `a64bc3897f184f0bb688c7deb7e88f66`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:03:30.004063 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-54da3a61-864b-47bf-97e0-c993991e78c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:03:30.055641 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:03:30.101104 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 651/1316] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 02:03:29 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:03:30.386606 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e450d5-d8b2-4696-8309-2c6a6c9c06b6 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:03:30.388131 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-e1e450d5-d8b2-4696-8309-2c6a6c9c06b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:03:30.398831 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:03:30.492958 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e450d5-d8b2-4696-8309-2c6a6c9c06b6 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:03:30.565733 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8795023-6785-43ab-94b2-33dbb815599e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:03:30.566333 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8795023-6785-43ab-94b2-33dbb815599e service neutron] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:03:30.566608 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8795023-6785-43ab-94b2-33dbb815599e service neutron] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:03:30.566882 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8795023-6785-43ab-94b2-33dbb815599e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:03:30.568461 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-c8795023-6785-43ab-94b2-33dbb815599e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:03:30.631958 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:03:30.678431 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8795023-6785-43ab-94b2-33dbb815599e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:03:30.680453 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8795023-6785-43ab-94b2-33dbb815599e service neutron] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:03:30.698324 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 666/1317] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:03:30 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:03:33.371890 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbaf09c-333c-4d6e-a9a1-e1c78fb022ab None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:03:33.372446 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbaf09c-333c-4d6e-a9a1-e1c78fb022ab None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:03:33.372446 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbaf09c-333c-4d6e-a9a1-e1c78fb022ab None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:03:33.373804 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 652/1318] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 02:03:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:03:33.378930 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f9330b-3406-459b-9c5a-99d7b96d46fe None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:03:33.379323 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f9330b-3406-459b-9c5a-99d7b96d46fe None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:03:33.379475 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f9330b-3406-459b-9c5a-99d7b96d46fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:03:33.444643 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-b8f9330b-3406-459b-9c5a-99d7b96d46fe None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:03:33.445876 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-b8f9330b-3406-459b-9c5a-99d7b96d46fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:03:33.540277 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 667/1319] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 02:03:33 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:03:33.824173 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbaf09c-333c-4d6e-a9a1-e1c78fb022ab None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:03:33.826116 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-3bbaf09c-333c-4d6e-a9a1-e1c78fb022ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:03:33.929396 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbaf09c-333c-4d6e-a9a1-e1c78fb022ab None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:03:34.002330 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acb5642-474f-44da-8e37-c9572a299388 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:03:34.002934 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb5642-474f-44da-8e37-c9572a299388 service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:03:34.003212 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb5642-474f-44da-8e37-c9572a299388 service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:03:34.003480 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb5642-474f-44da-8e37-c9572a299388 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:03:34.005078 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-8acb5642-474f-44da-8e37-c9572a299388 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:03:34.012115 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:03:34.115699 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acb5642-474f-44da-8e37-c9572a299388 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:03:34.117612 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acb5642-474f-44da-8e37-c9572a299388 service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:03:34.135875 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 653/1320] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:03:33 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:03:36.962179 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f839c-1403-4875-9e7f-0f0cd120654e None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:03:36.962771 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f839c-1403-4875-9e7f-0f0cd120654e None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:03:36.962771 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f839c-1403-4875-9e7f-0f0cd120654e None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:03:36.964084 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 668/1321] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 02:03:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:03:36.970046 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f61f8e-be8b-4553-b285-d92de1e375e8 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:03:36.970571 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f61f8e-be8b-4553-b285-d92de1e375e8 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:03:36.970571 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f61f8e-be8b-4553-b285-d92de1e375e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:03:37.046513 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-e7f61f8e-be8b-4553-b285-d92de1e375e8 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:03:37.047767 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-e7f61f8e-be8b-4553-b285-d92de1e375e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:03:37.110581 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:03:37.152898 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 654/1322] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 02:03:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:03:37.448956 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec770bb3-f89c-4cc5-a44b-f56ee7a1628a None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:03:37.449378 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec770bb3-f89c-4cc5-a44b-f56ee7a1628a None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:03:37.449723 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec770bb3-f89c-4cc5-a44b-f56ee7a1628a None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:03:37.451127 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 669/1323] 10.222.0.49 () {54 vars in 964 bytes} [Thu Sep 29 02:03:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:03:37.457081 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab2b798-1704-4220-8ec5-2087dd72dcf0 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:03:37.457395 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab2b798-1704-4220-8ec5-2087dd72dcf0 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:03:37.457673 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab2b798-1704-4220-8ec5-2087dd72dcf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:03:37.534324 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-eab2b798-1704-4220-8ec5-2087dd72dcf0 None None] MFA Rules not processed for user `2053f823bd3c4098a43c299890c1f733`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:03:37.535544 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-eab2b798-1704-4220-8ec5-2087dd72dcf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:03:37.613111 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 655/1324] 10.222.0.49 () {58 vars in 1061 bytes} [Thu Sep 29 02:03:37 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:03:37.622320 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec770bb3-f89c-4cc5-a44b-f56ee7a1628a None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:03:37.623846 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-ec770bb3-f89c-4cc5-a44b-f56ee7a1628a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:03:37.643983 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:03:37.728061 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec770bb3-f89c-4cc5-a44b-f56ee7a1628a None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:03:37.800639 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b618867d-dfa8-4e92-a339-12c133d977ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:03:37.801243 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b618867d-dfa8-4e92-a339-12c133d977ba service neutron] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:03:37.801550 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b618867d-dfa8-4e92-a339-12c133d977ba service neutron] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:03:37.801821 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b618867d-dfa8-4e92-a339-12c133d977ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:03:37.804031 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-b618867d-dfa8-4e92-a339-12c133d977ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:03:37.884230 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:03:37.924858 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b618867d-dfa8-4e92-a339-12c133d977ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:03:37.926359 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b618867d-dfa8-4e92-a339-12c133d977ba service neutron] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:03:37.945951 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 670/1325] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:03:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:03:40.394883 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a12dad6-f48f-4c34-8445-928ce7cdef24 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:03:40.395391 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a12dad6-f48f-4c34-8445-928ce7cdef24 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:03:40.395391 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a12dad6-f48f-4c34-8445-928ce7cdef24 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:03:40.397488 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 656/1326] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 02:03:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:03:40.402757 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7fa01a-0324-4427-b9c6-f34dafbfd811 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:03:40.403171 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7fa01a-0324-4427-b9c6-f34dafbfd811 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:03:40.403441 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7fa01a-0324-4427-b9c6-f34dafbfd811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:03:40.468831 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-5a7fa01a-0324-4427-b9c6-f34dafbfd811 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:03:40.470090 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-5a7fa01a-0324-4427-b9c6-f34dafbfd811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:03:40.569471 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 671/1327] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 02:03:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:03:40.867818 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a12dad6-f48f-4c34-8445-928ce7cdef24 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:03:40.869552 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-6a12dad6-f48f-4c34-8445-928ce7cdef24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:03:40.945376 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:03:40.993670 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a12dad6-f48f-4c34-8445-928ce7cdef24 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:03:41.072836 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f332596f-8980-48aa-87a4-4e39d7776ab4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:03:41.073483 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f332596f-8980-48aa-87a4-4e39d7776ab4 service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:03:41.073762 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f332596f-8980-48aa-87a4-4e39d7776ab4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:03:41.074033 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f332596f-8980-48aa-87a4-4e39d7776ab4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:03:41.075665 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-f332596f-8980-48aa-87a4-4e39d7776ab4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:03:41.199097 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:03:41.202403 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f332596f-8980-48aa-87a4-4e39d7776ab4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:03:41.204182 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f332596f-8980-48aa-87a4-4e39d7776ab4 service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:03:41.227253 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 657/1328] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:03:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:03:43.488548 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3103b4ad-ab5f-489a-a3db-f5fd38b2ee89 None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:03:43.489016 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3103b4ad-ab5f-489a-a3db-f5fd38b2ee89 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:03:43.489112 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3103b4ad-ab5f-489a-a3db-f5fd38b2ee89 None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:03:43.491001 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 672/1329] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 02:03:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:03:43.496666 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed7101d-7310-4f9b-817b-8918bb9d4c7d None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:03:43.497148 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed7101d-7310-4f9b-817b-8918bb9d4c7d None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:03:43.497241 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed7101d-7310-4f9b-817b-8918bb9d4c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:03:43.567290 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-4ed7101d-7310-4f9b-817b-8918bb9d4c7d None None] MFA Rules not processed for user `a64bc3897f184f0bb688c7deb7e88f66`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:03:43.569003 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-4ed7101d-7310-4f9b-817b-8918bb9d4c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:03:43.667725 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 658/1330] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 02:03:43 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:03:43.960516 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3103b4ad-ab5f-489a-a3db-f5fd38b2ee89 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:03:43.962099 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-3103b4ad-ab5f-489a-a3db-f5fd38b2ee89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:03:43.994381 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:03:44.073711 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3103b4ad-ab5f-489a-a3db-f5fd38b2ee89 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:03:44.152125 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf589b9b-9381-4254-b0f6-d7e712bd4a87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:03:44.152744 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf589b9b-9381-4254-b0f6-d7e712bd4a87 service neutron] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:03:44.153020 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf589b9b-9381-4254-b0f6-d7e712bd4a87 service neutron] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:03:44.153288 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf589b9b-9381-4254-b0f6-d7e712bd4a87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:03:44.154924 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-bf589b9b-9381-4254-b0f6-d7e712bd4a87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:03:44.236174 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:03:44.270025 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf589b9b-9381-4254-b0f6-d7e712bd4a87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:03:44.272217 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf589b9b-9381-4254-b0f6-d7e712bd4a87 service neutron] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:03:44.292494 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 673/1331] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:03:43 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:03:46.849632 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9408e8a7-7596-4de5-bf50-f45d004dded5 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:03:46.850159 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9408e8a7-7596-4de5-bf50-f45d004dded5 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:03:46.850159 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9408e8a7-7596-4de5-bf50-f45d004dded5 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:03:46.851628 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 659/1332] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 02:03:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:03:46.856718 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e1c0f-3485-48a9-b2f6-5e45ad242e19 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:03:46.857123 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e1c0f-3485-48a9-b2f6-5e45ad242e19 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:03:46.857240 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e1c0f-3485-48a9-b2f6-5e45ad242e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:03:46.923664 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-eb4e1c0f-3485-48a9-b2f6-5e45ad242e19 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:03:46.924876 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-eb4e1c0f-3485-48a9-b2f6-5e45ad242e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:03:47.018293 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 674/1333] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 02:03:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 29 02:03:47.297249 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9408e8a7-7596-4de5-bf50-f45d004dded5 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:03:47.298840 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-9408e8a7-7596-4de5-bf50-f45d004dded5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:03:47.369635 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:03:47.403183 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9408e8a7-7596-4de5-bf50-f45d004dded5 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:03:47.475420 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccc5c44-0783-403c-90d1-89c78a1e43df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:03:47.476014 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc5c44-0783-403c-90d1-89c78a1e43df service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:03:47.476290 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc5c44-0783-403c-90d1-89c78a1e43df service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:03:47.476557 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc5c44-0783-403c-90d1-89c78a1e43df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:03:47.478158 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-3ccc5c44-0783-403c-90d1-89c78a1e43df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:03:47.584257 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccc5c44-0783-403c-90d1-89c78a1e43df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:03:47.585751 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccc5c44-0783-403c-90d1-89c78a1e43df service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:03:47.596541 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:03:47.604882 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 660/1334] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:03:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:03:49.824783 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35123e7c-0582-4bf4-9600-6e535a1b262a None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:03:49.825364 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35123e7c-0582-4bf4-9600-6e535a1b262a None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:03:49.825364 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35123e7c-0582-4bf4-9600-6e535a1b262a None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:03:49.826682 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 675/1335] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 02:03:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:03:49.831932 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad01ade-0fca-4d00-bcca-fd10acb6c262 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:03:49.832369 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad01ade-0fca-4d00-bcca-fd10acb6c262 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:03:49.832479 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad01ade-0fca-4d00-bcca-fd10acb6c262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:03:49.898802 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-7ad01ade-0fca-4d00-bcca-fd10acb6c262 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:03:49.900270 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-7ad01ade-0fca-4d00-bcca-fd10acb6c262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:03:50.002120 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 661/1336] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 02:03:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:03:50.290351 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35123e7c-0582-4bf4-9600-6e535a1b262a None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:03:50.291912 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-35123e7c-0582-4bf4-9600-6e535a1b262a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:03:50.332374 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:03:50.396198 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35123e7c-0582-4bf4-9600-6e535a1b262a None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:03:50.467793 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed22dce0-076a-4c72-b3bf-9a25ffe76e74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:03:50.468392 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed22dce0-076a-4c72-b3bf-9a25ffe76e74 service neutron] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:03:50.468668 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed22dce0-076a-4c72-b3bf-9a25ffe76e74 service neutron] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:03:50.468937 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed22dce0-076a-4c72-b3bf-9a25ffe76e74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:03:50.470525 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-ed22dce0-076a-4c72-b3bf-9a25ffe76e74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:03:50.553962 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:03:50.580839 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed22dce0-076a-4c72-b3bf-9a25ffe76e74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:03:50.582293 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed22dce0-076a-4c72-b3bf-9a25ffe76e74 service neutron] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:03:50.600243 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 676/1337] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:03:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:03:53.078247 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1e6c90-35c1-40b1-b30d-d9e6234588bb None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:03:53.078782 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1e6c90-35c1-40b1-b30d-d9e6234588bb None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:03:53.078782 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1e6c90-35c1-40b1-b30d-d9e6234588bb None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:03:53.080145 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 662/1338] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 02:03:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:03:53.085982 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f723a-09d6-4e9e-8e3d-0cf11352fdd2 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:03:53.086413 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f723a-09d6-4e9e-8e3d-0cf11352fdd2 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:03:53.086534 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f723a-09d6-4e9e-8e3d-0cf11352fdd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:03:53.157128 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-5d5f723a-09d6-4e9e-8e3d-0cf11352fdd2 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:03:53.158370 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-5d5f723a-09d6-4e9e-8e3d-0cf11352fdd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:03:53.252168 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 677/1339] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 02:03:53 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:03:53.535244 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1e6c90-35c1-40b1-b30d-d9e6234588bb None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:03:53.537585 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-5c1e6c90-35c1-40b1-b30d-d9e6234588bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:03:53.616295 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:03:53.643067 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1e6c90-35c1-40b1-b30d-d9e6234588bb None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:03:53.715032 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038c8b72-8795-4c2d-8b7b-55e588675063 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:03:53.715624 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c8b72-8795-4c2d-8b7b-55e588675063 service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:03:53.715904 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c8b72-8795-4c2d-8b7b-55e588675063 service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:03:53.716168 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c8b72-8795-4c2d-8b7b-55e588675063 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:03:53.717775 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-038c8b72-8795-4c2d-8b7b-55e588675063 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:03:53.826003 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038c8b72-8795-4c2d-8b7b-55e588675063 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:03:53.827417 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038c8b72-8795-4c2d-8b7b-55e588675063 service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:03:53.848503 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 663/1340] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:03:53 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:03:57.934527 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b45de5-b5d1-4969-adbc-818167a7824c None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:03:57.935079 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b45de5-b5d1-4969-adbc-818167a7824c None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:03:57.935079 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b45de5-b5d1-4969-adbc-818167a7824c None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:03:57.936414 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 678/1341] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 02:03:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:03:57.942206 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492c900-98d4-4b95-82af-63ba11aa3528 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:03:57.942664 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492c900-98d4-4b95-82af-63ba11aa3528 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:03:57.942770 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492c900-98d4-4b95-82af-63ba11aa3528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:03:57.948317 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:03:58.012450 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-f492c900-98d4-4b95-82af-63ba11aa3528 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:03:58.013636 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-f492c900-98d4-4b95-82af-63ba11aa3528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:03:58.112264 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 664/1342] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 02:03:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:03:58.396849 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b45de5-b5d1-4969-adbc-818167a7824c None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:03:58.398500 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-15b45de5-b5d1-4969-adbc-818167a7824c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:03:58.447195 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:03:58.507681 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b45de5-b5d1-4969-adbc-818167a7824c None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:03:58.583410 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2fe628-e887-4a08-8b9d-f02516db47c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:03:58.584043 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2fe628-e887-4a08-8b9d-f02516db47c4 service neutron] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:03:58.584322 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2fe628-e887-4a08-8b9d-f02516db47c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:03:58.584590 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2fe628-e887-4a08-8b9d-f02516db47c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:03:58.586211 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-4e2fe628-e887-4a08-8b9d-f02516db47c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:03:58.680976 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:03:58.699385 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2fe628-e887-4a08-8b9d-f02516db47c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:03:58.700799 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2fe628-e887-4a08-8b9d-f02516db47c4 service neutron] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:03:58.719287 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 679/1343] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:03:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:04:01.535204 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30da258-8cdc-4752-a577-18d48042ad49 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:01.535759 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30da258-8cdc-4752-a577-18d48042ad49 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:01.535759 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30da258-8cdc-4752-a577-18d48042ad49 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:01.536972 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 665/1344] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 02:04:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 29 02:04:01.542136 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb6f30c-467b-4cb4-9dad-af8ee34d7a1a None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:01.542597 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb6f30c-467b-4cb4-9dad-af8ee34d7a1a None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:01.542712 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb6f30c-467b-4cb4-9dad-af8ee34d7a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:01.613142 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-7eb6f30c-467b-4cb4-9dad-af8ee34d7a1a None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:04:01.614886 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-7eb6f30c-467b-4cb4-9dad-af8ee34d7a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:01.719526 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 680/1345] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 02:04:01 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:04:02.000142 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30da258-8cdc-4752-a577-18d48042ad49 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:04:02.001746 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-e30da258-8cdc-4752-a577-18d48042ad49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:02.092338 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:04:02.112198 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30da258-8cdc-4752-a577-18d48042ad49 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:04:02.190421 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84777e42-1e27-404d-a4e6-4ff8107f1d88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:04:02.190987 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84777e42-1e27-404d-a4e6-4ff8107f1d88 service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:02.191454 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84777e42-1e27-404d-a4e6-4ff8107f1d88 service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:02.191724 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84777e42-1e27-404d-a4e6-4ff8107f1d88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:02.193337 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-84777e42-1e27-404d-a4e6-4ff8107f1d88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:02.302389 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84777e42-1e27-404d-a4e6-4ff8107f1d88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:04:02.303816 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84777e42-1e27-404d-a4e6-4ff8107f1d88 service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:04:02.322335 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 666/1346] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:04:01 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:04:06.466888 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6008d-ffc4-4937-893d-051e4894bb80 None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:06.467363 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6008d-ffc4-4937-893d-051e4894bb80 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:06.467459 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6008d-ffc4-4937-893d-051e4894bb80 None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:06.468751 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 681/1347] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 02:04:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:04:06.474804 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdfd015-7bbd-4c68-9da7-794954e5b2e6 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:06.475274 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdfd015-7bbd-4c68-9da7-794954e5b2e6 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:06.475382 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdfd015-7bbd-4c68-9da7-794954e5b2e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:06.490633 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:04:06.554090 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-4fdfd015-7bbd-4c68-9da7-794954e5b2e6 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:04:06.555324 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-4fdfd015-7bbd-4c68-9da7-794954e5b2e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:06.659527 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 667/1348] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 02:04:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:04:06.959024 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d6008d-ffc4-4937-893d-051e4894bb80 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:04:06.960559 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-30d6008d-ffc4-4937-893d-051e4894bb80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:07.018966 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:04:07.064649 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d6008d-ffc4-4937-893d-051e4894bb80 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:04:07.138380 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacfe58c-d05c-4d82-b876-919b9eabed3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:04:07.139005 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacfe58c-d05c-4d82-b876-919b9eabed3b service neutron] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:07.139281 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacfe58c-d05c-4d82-b876-919b9eabed3b service neutron] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:07.139548 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacfe58c-d05c-4d82-b876-919b9eabed3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:07.141128 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-bacfe58c-d05c-4d82-b876-919b9eabed3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:07.246344 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:04:07.250860 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacfe58c-d05c-4d82-b876-919b9eabed3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:04:07.252356 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacfe58c-d05c-4d82-b876-919b9eabed3b service neutron] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:04:07.271142 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 682/1349] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:04:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:04:12.193884 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c37f9-53a6-4bea-99ef-9a05a484a710 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:12.194370 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c37f9-53a6-4bea-99ef-9a05a484a710 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:12.194471 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c37f9-53a6-4bea-99ef-9a05a484a710 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:12.195911 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 668/1350] 10.222.0.49 () {54 vars in 921 bytes} [Thu Sep 29 02:04:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:04:12.200747 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5dc6fb-b55a-4eda-b054-c7aa3769270d None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:12.201163 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5dc6fb-b55a-4eda-b054-c7aa3769270d None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:12.201296 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5dc6fb-b55a-4eda-b054-c7aa3769270d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:12.335202 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-8b5dc6fb-b55a-4eda-b054-c7aa3769270d None None] MFA Rules not processed for user `3cbb39731a6b42e2a6647d6134b5c7cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:04:12.336975 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-8b5dc6fb-b55a-4eda-b054-c7aa3769270d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:12.472578 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 683/1351] 10.222.0.49 () {58 vars in 1018 bytes} [Thu Sep 29 02:04:12 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:04:16.588279 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d457d-c597-4044-b7b5-aa852076efa4 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:16.588786 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d457d-c597-4044-b7b5-aa852076efa4 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:16.588890 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d457d-c597-4044-b7b5-aa852076efa4 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:16.590434 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 669/1352] 10.222.0.49 () {54 vars in 921 bytes} [Thu Sep 29 02:04:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:04:16.596357 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a5ee0c-f4c5-402a-a326-4bc8932dfba1 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:16.596814 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a5ee0c-f4c5-402a-a326-4bc8932dfba1 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:16.596898 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a5ee0c-f4c5-402a-a326-4bc8932dfba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:16.655360 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:04:16.657738 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=59 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:04:16.681785 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-f4a5ee0c-f4c5-402a-a326-4bc8932dfba1 None None] MFA Rules not processed for user `3cbb39731a6b42e2a6647d6134b5c7cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:04:16.683013 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-f4a5ee0c-f4c5-402a-a326-4bc8932dfba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:16.793803 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 684/1353] 10.222.0.49 () {58 vars in 1018 bytes} [Thu Sep 29 02:04:16 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:04:18.113159 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65808b01-b952-48b7-a76d-954cc3f28feb None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:18.113833 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65808b01-b952-48b7-a76d-954cc3f28feb None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:18.113833 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65808b01-b952-48b7-a76d-954cc3f28feb None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:18.115108 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 670/1354] 10.222.0.49 () {54 vars in 921 bytes} [Thu Sep 29 02:04:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:04:18.122100 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eef7da-77d3-4348-aca5-c0c2ec158292 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:18.122534 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eef7da-77d3-4348-aca5-c0c2ec158292 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:18.122654 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eef7da-77d3-4348-aca5-c0c2ec158292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:18.203518 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-46eef7da-77d3-4348-aca5-c0c2ec158292 None None] MFA Rules not processed for user `3cbb39731a6b42e2a6647d6134b5c7cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:04:18.204651 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-46eef7da-77d3-4348-aca5-c0c2ec158292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:18.247596 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:04:18.315984 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 685/1355] 10.222.0.49 () {58 vars in 1018 bytes} [Thu Sep 29 02:04:18 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:04:22.018241 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c69108-2837-4beb-a0cd-f570263420ac None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:22.019258 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c69108-2837-4beb-a0cd-f570263420ac None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:22.019784 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c69108-2837-4beb-a0cd-f570263420ac None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:22.021338 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 671/1356] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 02:04:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:04:22.027396 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ac0503-f92c-4d9d-aa8a-60628a01cde3 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:22.027902 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ac0503-f92c-4d9d-aa8a-60628a01cde3 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:22.030650 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ac0503-f92c-4d9d-aa8a-60628a01cde3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:22.135407 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-16ac0503-f92c-4d9d-aa8a-60628a01cde3 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:04:22.137011 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-16ac0503-f92c-4d9d-aa8a-60628a01cde3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:22.249181 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 686/1357] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 02:04:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:04:22.559403 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08402e64-ac6c-4b5b-8ad9-1d34e59a5350 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:22.560263 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08402e64-ac6c-4b5b-8ad9-1d34e59a5350 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:22.560747 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08402e64-ac6c-4b5b-8ad9-1d34e59a5350 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:22.562577 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 672/1358] 10.222.0.49 () {54 vars in 961 bytes} [Thu Sep 29 02:04:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:04:22.571542 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9599c95c-4aaf-42cc-a1bd-eaa4995ca8d2 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:22.571914 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9599c95c-4aaf-42cc-a1bd-eaa4995ca8d2 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:22.572111 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9599c95c-4aaf-42cc-a1bd-eaa4995ca8d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:22.590229 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:04:22.656027 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-9599c95c-4aaf-42cc-a1bd-eaa4995ca8d2 None None] MFA Rules not processed for user `f3325a7111d447f4a9cf00c672d5420f`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:04:22.657259 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-9599c95c-4aaf-42cc-a1bd-eaa4995ca8d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:22.781952 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 687/1359] 10.222.0.49 () {58 vars in 1058 bytes} [Thu Sep 29 02:04:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:04:22.790106 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08402e64-ac6c-4b5b-8ad9-1d34e59a5350 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:04:22.791610 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-08402e64-ac6c-4b5b-8ad9-1d34e59a5350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:22.952644 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08402e64-ac6c-4b5b-8ad9-1d34e59a5350 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:04:23.030586 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:04:23.073185 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3777f31f-091a-486b-b97c-db8d2a08f4f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3325a7111d447f4a9cf00c672d5420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:04:23.073807 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3777f31f-091a-486b-b97c-db8d2a08f4f3 service nova] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:23.074084 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3777f31f-091a-486b-b97c-db8d2a08f4f3 service nova] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:23.074353 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3777f31f-091a-486b-b97c-db8d2a08f4f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:23.075936 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-3777f31f-091a-486b-b97c-db8d2a08f4f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:23.184870 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3777f31f-091a-486b-b97c-db8d2a08f4f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:04:23.186992 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3777f31f-091a-486b-b97c-db8d2a08f4f3 service nova] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:04:23.208757 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 673/1360] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:04:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:04:25.625632 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb920d79-c700-4bd8-82c1-2bda13b9303e None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:25.626728 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb920d79-c700-4bd8-82c1-2bda13b9303e None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:25.627559 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb920d79-c700-4bd8-82c1-2bda13b9303e None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:25.633617 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 688/1361] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 02:04:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:04:25.637039 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ecc6db-3ece-48ea-b42c-f4dd779fcfd7 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:25.637558 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ecc6db-3ece-48ea-b42c-f4dd779fcfd7 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:25.637842 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ecc6db-3ece-48ea-b42c-f4dd779fcfd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:25.709644 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-c0ecc6db-3ece-48ea-b42c-f4dd779fcfd7 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:04:25.710874 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-c0ecc6db-3ece-48ea-b42c-f4dd779fcfd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:25.752836 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:04:25.816440 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 674/1362] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 02:04:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:04:26.106784 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb920d79-c700-4bd8-82c1-2bda13b9303e None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:04:26.108302 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-eb920d79-c700-4bd8-82c1-2bda13b9303e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:26.179166 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:04:26.292576 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb920d79-c700-4bd8-82c1-2bda13b9303e None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:04:26.425214 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e13ea6b-19c8-40a1-aa49-c8024d526c9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3325a7111d447f4a9cf00c672d5420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:04:26.425785 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e13ea6b-19c8-40a1-aa49-c8024d526c9b service nova] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:26.426059 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e13ea6b-19c8-40a1-aa49-c8024d526c9b service nova] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:26.426325 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e13ea6b-19c8-40a1-aa49-c8024d526c9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:26.427907 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-6e13ea6b-19c8-40a1-aa49-c8024d526c9b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:26.451744 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:04:26.524088 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e13ea6b-19c8-40a1-aa49-c8024d526c9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:04:26.525823 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e13ea6b-19c8-40a1-aa49-c8024d526c9b service nova] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:04:26.545148 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 689/1363] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:04:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:04:29.025495 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9680eb5b-746b-4bb6-857b-f94c4a7b6ba0 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:29.026020 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9680eb5b-746b-4bb6-857b-f94c4a7b6ba0 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:29.026020 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9680eb5b-746b-4bb6-857b-f94c4a7b6ba0 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:29.027346 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 675/1364] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 02:04:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:04:29.033288 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e04af-8926-4d99-bea9-3d6d8eb33c59 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:29.033732 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e04af-8926-4d99-bea9-3d6d8eb33c59 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:29.033905 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e04af-8926-4d99-bea9-3d6d8eb33c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:29.107065 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-7a7e04af-8926-4d99-bea9-3d6d8eb33c59 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:04:29.108291 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-7a7e04af-8926-4d99-bea9-3d6d8eb33c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:29.210156 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:04:29.221662 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 690/1365] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 02:04:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:04:29.508308 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380134ac-d6fc-4bd9-8262-627344aeef07 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:29.508721 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380134ac-d6fc-4bd9-8262-627344aeef07 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:29.509098 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380134ac-d6fc-4bd9-8262-627344aeef07 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:29.510724 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 676/1366] 10.222.0.49 () {54 vars in 961 bytes} [Thu Sep 29 02:04:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:04:29.516218 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddcd3a4-90d2-4a2a-88b1-f517827cc60e None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:29.516785 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddcd3a4-90d2-4a2a-88b1-f517827cc60e None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:29.517065 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddcd3a4-90d2-4a2a-88b1-f517827cc60e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:29.597248 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-7ddcd3a4-90d2-4a2a-88b1-f517827cc60e None None] MFA Rules not processed for user `f3325a7111d447f4a9cf00c672d5420f`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:04:29.598568 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-7ddcd3a4-90d2-4a2a-88b1-f517827cc60e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:29.725104 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 691/1367] 10.222.0.49 () {58 vars in 1058 bytes} [Thu Sep 29 02:04:29 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:04:29.733882 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380134ac-d6fc-4bd9-8262-627344aeef07 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:04:29.736542 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-380134ac-d6fc-4bd9-8262-627344aeef07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:29.898305 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380134ac-d6fc-4bd9-8262-627344aeef07 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:04:29.924590 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:04:30.028556 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3814d9-e98a-44a5-97f9-24547d6e050b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3325a7111d447f4a9cf00c672d5420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:04:30.029481 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3814d9-e98a-44a5-97f9-24547d6e050b service nova] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:30.029865 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3814d9-e98a-44a5-97f9-24547d6e050b service nova] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:30.030278 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3814d9-e98a-44a5-97f9-24547d6e050b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:30.032132 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-4d3814d9-e98a-44a5-97f9-24547d6e050b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:30.137519 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3814d9-e98a-44a5-97f9-24547d6e050b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:04:30.139567 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3814d9-e98a-44a5-97f9-24547d6e050b service nova] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:04:30.164475 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 677/1368] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:04:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:04:30.253263 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f9c3f-83aa-4480-9b82-9b4d1677dc97 None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:30.253825 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f9c3f-83aa-4480-9b82-9b4d1677dc97 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:30.253825 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f9c3f-83aa-4480-9b82-9b4d1677dc97 None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:30.255319 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 692/1369] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 02:04:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:04:30.261584 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a0057b-4fe4-4c68-9e67-db783f00117f None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:30.261882 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a0057b-4fe4-4c68-9e67-db783f00117f None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:30.262278 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a0057b-4fe4-4c68-9e67-db783f00117f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:30.305663 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:04:30.350609 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-a3a0057b-4fe4-4c68-9e67-db783f00117f None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:04:30.352206 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-a3a0057b-4fe4-4c68-9e67-db783f00117f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:30.482442 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 678/1370] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 02:04:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:04:30.831063 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d577331d-eb3e-4fe5-a3c6-a8be1453b098 None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:30.831063 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d577331d-eb3e-4fe5-a3c6-a8be1453b098 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:30.831063 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d577331d-eb3e-4fe5-a3c6-a8be1453b098 None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:30.833350 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 693/1371] 10.222.0.49 () {54 vars in 963 bytes} [Thu Sep 29 02:04:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:04:30.837617 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2753779-5c80-42f7-8866-7bb61ccdfd59 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:30.837987 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2753779-5c80-42f7-8866-7bb61ccdfd59 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:30.838373 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2753779-5c80-42f7-8866-7bb61ccdfd59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:30.932195 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-d2753779-5c80-42f7-8866-7bb61ccdfd59 None None] MFA Rules not processed for user `e75135b856134ba4b9ccac337886f682`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:04:30.934467 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-d2753779-5c80-42f7-8866-7bb61ccdfd59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:30.994348 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:04:31.029146 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 679/1372] 10.222.0.49 () {58 vars in 1060 bytes} [Thu Sep 29 02:04:30 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:04:31.037066 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d577331d-eb3e-4fe5-a3c6-a8be1453b098 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:04:31.038724 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-d577331d-eb3e-4fe5-a3c6-a8be1453b098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:31.104321 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:04:31.175676 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d577331d-eb3e-4fe5-a3c6-a8be1453b098 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:04:31.266139 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21161e58-108b-47b7-96d3-5cbc4c8d4375 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75135b856134ba4b9ccac337886f682', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:04:31.267012 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21161e58-108b-47b7-96d3-5cbc4c8d4375 service cinder] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:31.267292 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21161e58-108b-47b7-96d3-5cbc4c8d4375 service cinder] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:31.267562 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21161e58-108b-47b7-96d3-5cbc4c8d4375 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:31.269111 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-21161e58-108b-47b7-96d3-5cbc4c8d4375 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:31.374077 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:04:31.389853 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21161e58-108b-47b7-96d3-5cbc4c8d4375 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:04:31.392105 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21161e58-108b-47b7-96d3-5cbc4c8d4375 service cinder] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:04:31.412353 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 694/1373] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:04:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:04:32.430058 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f4cc3-cb7a-48a6-8292-d75bb122d9b2 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:32.430671 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f4cc3-cb7a-48a6-8292-d75bb122d9b2 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:32.430671 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f4cc3-cb7a-48a6-8292-d75bb122d9b2 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:32.431933 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 680/1374] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 02:04:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:04:32.437276 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ef6f46-a6ea-44b8-b0a9-8639f7492df0 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:32.437820 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ef6f46-a6ea-44b8-b0a9-8639f7492df0 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:32.437918 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ef6f46-a6ea-44b8-b0a9-8639f7492df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:32.503320 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-19ef6f46-a6ea-44b8-b0a9-8639f7492df0 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:04:32.504543 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-19ef6f46-a6ea-44b8-b0a9-8639f7492df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:32.605846 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 695/1375] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 02:04:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:04:32.898516 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766f4cc3-cb7a-48a6-8292-d75bb122d9b2 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:04:32.900122 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-766f4cc3-cb7a-48a6-8292-d75bb122d9b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:33.067885 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766f4cc3-cb7a-48a6-8292-d75bb122d9b2 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:04:33.122471 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:04:33.187456 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae801451-66a5-4a81-b831-10babf3a96ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3325a7111d447f4a9cf00c672d5420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:04:33.188755 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae801451-66a5-4a81-b831-10babf3a96ea service nova] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:33.189030 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae801451-66a5-4a81-b831-10babf3a96ea service nova] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:33.189303 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae801451-66a5-4a81-b831-10babf3a96ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:33.190953 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-ae801451-66a5-4a81-b831-10babf3a96ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:33.283516 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae801451-66a5-4a81-b831-10babf3a96ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:04:33.285097 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae801451-66a5-4a81-b831-10babf3a96ea service nova] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:04:33.303734 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 681/1376] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:04:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:04:35.560206 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba0d089-dbfe-405f-a300-310470e911c2 None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:35.560831 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba0d089-dbfe-405f-a300-310470e911c2 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:35.561039 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba0d089-dbfe-405f-a300-310470e911c2 None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:35.562913 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 696/1377] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 02:04:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:04:35.568259 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bec8505-dab0-43ac-bd2e-3412bbb8b6ee None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:35.568673 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bec8505-dab0-43ac-bd2e-3412bbb8b6ee None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:35.568852 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bec8505-dab0-43ac-bd2e-3412bbb8b6ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:35.641491 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-2bec8505-dab0-43ac-bd2e-3412bbb8b6ee None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:04:35.642710 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-2bec8505-dab0-43ac-bd2e-3412bbb8b6ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:35.650358 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:04:35.753135 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 682/1378] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 02:04:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:04:36.040851 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba0d089-dbfe-405f-a300-310470e911c2 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:04:36.042612 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-fba0d089-dbfe-405f-a300-310470e911c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:36.108724 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:04:36.201899 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba0d089-dbfe-405f-a300-310470e911c2 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:04:36.336865 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5534743b-a552-4c26-bf12-71711b4f6811 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3325a7111d447f4a9cf00c672d5420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:04:36.337791 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5534743b-a552-4c26-bf12-71711b4f6811 service nova] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:36.338219 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5534743b-a552-4c26-bf12-71711b4f6811 service nova] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:36.338649 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5534743b-a552-4c26-bf12-71711b4f6811 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:36.340584 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-5534743b-a552-4c26-bf12-71711b4f6811 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:36.361741 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:04:36.438025 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5534743b-a552-4c26-bf12-71711b4f6811 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:04:36.439619 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5534743b-a552-4c26-bf12-71711b4f6811 service nova] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:04:36.459540 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 697/1379] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:04:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:04:38.691438 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e793e94a-5148-49e1-abd9-e84a56ddf16e None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:38.691898 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e793e94a-5148-49e1-abd9-e84a56ddf16e None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:38.692261 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e793e94a-5148-49e1-abd9-e84a56ddf16e None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:38.693769 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 683/1380] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 02:04:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:04:38.699182 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f6e02-449d-4dd6-8777-dd2487ab0e1c None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:38.699635 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f6e02-449d-4dd6-8777-dd2487ab0e1c None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:38.700117 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f6e02-449d-4dd6-8777-dd2487ab0e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:38.774953 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-4c0f6e02-449d-4dd6-8777-dd2487ab0e1c None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:04:38.776370 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-4c0f6e02-449d-4dd6-8777-dd2487ab0e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:38.881134 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:04:38.888677 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 698/1381] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 02:04:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 29 02:04:39.197960 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e793e94a-5148-49e1-abd9-e84a56ddf16e None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:04:39.199930 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-e793e94a-5148-49e1-abd9-e84a56ddf16e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:39.343947 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:04:39.355865 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e793e94a-5148-49e1-abd9-e84a56ddf16e None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:04:39.467557 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac43cbe-0edb-428b-88c1-8ab3a6bd9230 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3325a7111d447f4a9cf00c672d5420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:04:39.468718 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac43cbe-0edb-428b-88c1-8ab3a6bd9230 service nova] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:39.469087 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac43cbe-0edb-428b-88c1-8ab3a6bd9230 service nova] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:39.469374 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac43cbe-0edb-428b-88c1-8ab3a6bd9230 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:39.470981 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-9ac43cbe-0edb-428b-88c1-8ab3a6bd9230 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:39.559376 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac43cbe-0edb-428b-88c1-8ab3a6bd9230 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:04:39.560955 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac43cbe-0edb-428b-88c1-8ab3a6bd9230 service nova] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:04:39.571419 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:04:39.580336 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 684/1382] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:04:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:04:41.757395 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c0b86-f2f8-4c49-9598-1401aca5f6da None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:41.757949 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c0b86-f2f8-4c49-9598-1401aca5f6da None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:41.757949 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c0b86-f2f8-4c49-9598-1401aca5f6da None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:41.759268 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 699/1383] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 02:04:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:04:41.764427 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1218be-9c9e-4484-9cd5-9929c50dd107 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:41.764913 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1218be-9c9e-4484-9cd5-9929c50dd107 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:41.765102 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1218be-9c9e-4484-9cd5-9929c50dd107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:41.834661 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-ce1218be-9c9e-4484-9cd5-9929c50dd107 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:04:41.835747 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-ce1218be-9c9e-4484-9cd5-9929c50dd107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:41.938752 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 685/1384] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 02:04:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:04:42.227605 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665c0b86-f2f8-4c49-9598-1401aca5f6da None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:04:42.229128 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-665c0b86-f2f8-4c49-9598-1401aca5f6da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:42.392227 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665c0b86-f2f8-4c49-9598-1401aca5f6da None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:04:42.460653 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:04:42.508875 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373863a5-08ac-43e1-9bf5-34a65f327ecd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3325a7111d447f4a9cf00c672d5420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:04:42.509525 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373863a5-08ac-43e1-9bf5-34a65f327ecd service nova] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:42.509815 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373863a5-08ac-43e1-9bf5-34a65f327ecd service nova] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:42.510085 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373863a5-08ac-43e1-9bf5-34a65f327ecd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:42.511725 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-373863a5-08ac-43e1-9bf5-34a65f327ecd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:42.607614 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373863a5-08ac-43e1-9bf5-34a65f327ecd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:04:42.609359 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373863a5-08ac-43e1-9bf5-34a65f327ecd service nova] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:04:42.635526 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 700/1385] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:04:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:04:45.307330 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c376052-6764-4335-a891-dac3380c3825 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:45.308079 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c376052-6764-4335-a891-dac3380c3825 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:45.308079 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c376052-6764-4335-a891-dac3380c3825 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:45.309554 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 686/1386] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 02:04:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:04:45.315942 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dcc85e-b195-4f79-b4e3-183a6a069b7c None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:45.316382 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dcc85e-b195-4f79-b4e3-183a6a069b7c None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:45.316478 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dcc85e-b195-4f79-b4e3-183a6a069b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:45.385743 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-76dcc85e-b195-4f79-b4e3-183a6a069b7c None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:04:45.386961 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-76dcc85e-b195-4f79-b4e3-183a6a069b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:45.420065 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:04:45.487973 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 701/1387] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 02:04:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:04:45.780356 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c376052-6764-4335-a891-dac3380c3825 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:04:45.782606 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-1c376052-6764-4335-a891-dac3380c3825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:45.862238 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:04:45.935775 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c376052-6764-4335-a891-dac3380c3825 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:04:46.056251 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fb555d-6035-4a6b-98e9-f61e4b951f7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3325a7111d447f4a9cf00c672d5420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:04:46.056865 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fb555d-6035-4a6b-98e9-f61e4b951f7c service nova] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:46.057146 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fb555d-6035-4a6b-98e9-f61e4b951f7c service nova] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:46.057453 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fb555d-6035-4a6b-98e9-f61e4b951f7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:46.059083 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-65fb555d-6035-4a6b-98e9-f61e4b951f7c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:46.100443 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:04:46.153266 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fb555d-6035-4a6b-98e9-f61e4b951f7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:04:46.154830 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fb555d-6035-4a6b-98e9-f61e4b951f7c service nova] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:04:46.173926 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 687/1388] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:04:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:04:48.548908 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a859f10-ce16-4025-9a4b-e8d14e3f8399 None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:48.549419 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a859f10-ce16-4025-9a4b-e8d14e3f8399 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:48.549517 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a859f10-ce16-4025-9a4b-e8d14e3f8399 None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:48.550816 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 702/1389] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 02:04:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:04:48.556057 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd11d84-3dea-4d69-999a-e6fc37483775 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:48.556490 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd11d84-3dea-4d69-999a-e6fc37483775 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:48.556595 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd11d84-3dea-4d69-999a-e6fc37483775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:48.624846 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-6cd11d84-3dea-4d69-999a-e6fc37483775 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:04:48.626113 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-6cd11d84-3dea-4d69-999a-e6fc37483775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:48.725674 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 688/1390] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 02:04:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:04:49.017025 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a859f10-ce16-4025-9a4b-e8d14e3f8399 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:04:49.018565 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-4a859f10-ce16-4025-9a4b-e8d14e3f8399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:49.162710 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a859f10-ce16-4025-9a4b-e8d14e3f8399 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:04:49.179336 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:04:49.277003 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5d0c09-3253-4b7d-aa21-8e5fc2900a36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3325a7111d447f4a9cf00c672d5420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:04:49.277640 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d0c09-3253-4b7d-aa21-8e5fc2900a36 service nova] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:49.277916 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d0c09-3253-4b7d-aa21-8e5fc2900a36 service nova] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:49.278180 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d0c09-3253-4b7d-aa21-8e5fc2900a36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:49.279741 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-1f5d0c09-3253-4b7d-aa21-8e5fc2900a36 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:49.384323 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5d0c09-3253-4b7d-aa21-8e5fc2900a36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:04:49.386189 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5d0c09-3253-4b7d-aa21-8e5fc2900a36 service nova] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:04:49.405402 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 703/1391] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:04:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:04:49.807365 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc831d-acee-4acc-b628-74402d0fd075 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:49.807935 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc831d-acee-4acc-b628-74402d0fd075 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:49.807935 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc831d-acee-4acc-b628-74402d0fd075 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:49.809247 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 689/1392] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 02:04:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:04:49.815322 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f4922c-3320-4b02-abab-3139c89677ef None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:49.815805 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f4922c-3320-4b02-abab-3139c89677ef None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:49.815912 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f4922c-3320-4b02-abab-3139c89677ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:49.841197 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:04:49.884419 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-63f4922c-3320-4b02-abab-3139c89677ef None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:04:49.885934 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-63f4922c-3320-4b02-abab-3139c89677ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:49.983108 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 704/1393] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 02:04:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:04:50.283175 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f5d0a0-7551-4621-8438-007bb3e24f9d None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:50.283464 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f5d0a0-7551-4621-8438-007bb3e24f9d None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:50.283740 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f5d0a0-7551-4621-8438-007bb3e24f9d None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:50.285089 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 690/1394] 10.222.0.49 () {54 vars in 962 bytes} [Thu Sep 29 02:04:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:04:50.290487 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea0aa3d-24af-4a2e-b2bf-25d36d48bf0c None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:50.290758 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea0aa3d-24af-4a2e-b2bf-25d36d48bf0c None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:50.291031 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea0aa3d-24af-4a2e-b2bf-25d36d48bf0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:50.370680 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-8ea0aa3d-24af-4a2e-b2bf-25d36d48bf0c None None] MFA Rules not processed for user `5d36669146554031ba8596cb583cd6f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:04:50.371895 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-8ea0aa3d-24af-4a2e-b2bf-25d36d48bf0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:50.414971 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:04:50.452011 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 705/1395] 10.222.0.49 () {58 vars in 1059 bytes} [Thu Sep 29 02:04:50 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:04:50.460989 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f5d0a0-7551-4621-8438-007bb3e24f9d None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:04:50.462553 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-46f5d0a0-7551-4621-8438-007bb3e24f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:50.476049 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:04:50.569153 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f5d0a0-7551-4621-8438-007bb3e24f9d None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:04:50.645110 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df9f8a4-0902-41d3-a01c-8021be7f09f4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d36669146554031ba8596cb583cd6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:04:50.645751 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df9f8a4-0902-41d3-a01c-8021be7f09f4 service glance] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:50.646028 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df9f8a4-0902-41d3-a01c-8021be7f09f4 service glance] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:50.646555 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df9f8a4-0902-41d3-a01c-8021be7f09f4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:50.648139 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-8df9f8a4-0902-41d3-a01c-8021be7f09f4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:50.717201 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:04:50.758606 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df9f8a4-0902-41d3-a01c-8021be7f09f4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:04:50.760040 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df9f8a4-0902-41d3-a01c-8021be7f09f4 service glance] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:04:50.778173 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 691/1396] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:04:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:04:51.540951 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10accac-9132-4c92-bf52-ad35a53ce130 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:51.541471 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10accac-9132-4c92-bf52-ad35a53ce130 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:51.541600 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10accac-9132-4c92-bf52-ad35a53ce130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:51.609464 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-a10accac-9132-4c92-bf52-ad35a53ce130 None None] MFA Rules not processed for user `0f8f13f302de4701a7f4e0562bca08cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:04:51.610668 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-a10accac-9132-4c92-bf52-ad35a53ce130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:51.613826 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ba4757-164f-4007-b4c8-d6e600d43677 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:51.614301 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ba4757-164f-4007-b4c8-d6e600d43677 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:51.614397 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ba4757-164f-4007-b4c8-d6e600d43677 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:51.615689 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 692/1397] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 02:04:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 29 02:04:51.620738 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f178be14-633e-4f78-9da1-b652c95fef45 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:51.621147 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f178be14-633e-4f78-9da1-b652c95fef45 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:51.621445 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f178be14-633e-4f78-9da1-b652c95fef45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:51.689413 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-f178be14-633e-4f78-9da1-b652c95fef45 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:04:51.690576 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-f178be14-633e-4f78-9da1-b652c95fef45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:51.699543 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 706/1398] 10.222.0.49 () {58 vars in 1009 bytes} [Thu Sep 29 02:04:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:04:51.744621 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eb744c-a823-48e9-914d-257b69e4077a None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:51.744931 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eb744c-a823-48e9-914d-257b69e4077a None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:51.745205 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eb744c-a823-48e9-914d-257b69e4077a None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:51.746591 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 707/1399] 10.222.0.49 () {54 vars in 943 bytes} [Thu Sep 29 02:04:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 29 02:04:51.752926 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d22992-97c5-4a21-bb23-e75ec0981b54 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:51.753419 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d22992-97c5-4a21-bb23-e75ec0981b54 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:51.753702 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d22992-97c5-4a21-bb23-e75ec0981b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:51.795309 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 693/1400] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 02:04:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 29 02:04:51.824855 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:04:51.832959 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-b4d22992-97c5-4a21-bb23-e75ec0981b54 None None] MFA Rules not processed for user `c88bc0f32600416ca7c6a59f4196e497`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:04:51.834206 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-b4d22992-97c5-4a21-bb23-e75ec0981b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:51.943138 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 708/1401] 10.222.0.49 () {58 vars in 1040 bytes} [Thu Sep 29 02:04:51 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 29 02:04:51.952572 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f178be14-633e-4f78-9da1-b652c95fef45 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:04:51.954503 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-f178be14-633e-4f78-9da1-b652c95fef45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:51.980694 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:04:52.064345 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f178be14-633e-4f78-9da1-b652c95fef45 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:04:52.090467 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d22992-97c5-4a21-bb23-e75ec0981b54 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:04:52.091721 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-b4d22992-97c5-4a21-bb23-e75ec0981b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:52.172537 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef498924-16b9-45c6-9cf2-df58fea25f59 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c88bc0f32600416ca7c6a59f4196e497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:04:52.173149 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef498924-16b9-45c6-9cf2-df58fea25f59 service swift] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:52.173463 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef498924-16b9-45c6-9cf2-df58fea25f59 service swift] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:52.173732 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef498924-16b9-45c6-9cf2-df58fea25f59 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:52.175414 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-ef498924-16b9-45c6-9cf2-df58fea25f59 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:52.194432 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d22992-97c5-4a21-bb23-e75ec0981b54 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:04:52.215729 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:04:52.217192 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:04:52.261752 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef498924-16b9-45c6-9cf2-df58fea25f59 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:04:52.263265 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef498924-16b9-45c6-9cf2-df58fea25f59 service swift] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:04:52.271682 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 694/1402] 10.222.0.49 () {60 vars in 1384 bytes} [Thu Sep 29 02:04:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 29 02:04:52.324098 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e30b51-5d52-445d-9dbc-c07aa9ac3cdf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3325a7111d447f4a9cf00c672d5420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:04:52.325926 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e30b51-5d52-445d-9dbc-c07aa9ac3cdf service nova] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:52.325926 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e30b51-5d52-445d-9dbc-c07aa9ac3cdf service nova] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:52.325926 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e30b51-5d52-445d-9dbc-c07aa9ac3cdf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:52.328636 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-74e30b51-5d52-445d-9dbc-c07aa9ac3cdf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:52.430041 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e30b51-5d52-445d-9dbc-c07aa9ac3cdf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:04:52.431671 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e30b51-5d52-445d-9dbc-c07aa9ac3cdf service nova] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:04:52.450805 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 709/1403] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:04:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:04:54.687570 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe51e7-cfbc-4a8c-85e5-2ad7a37c2556 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:54.688063 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe51e7-cfbc-4a8c-85e5-2ad7a37c2556 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:54.688270 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe51e7-cfbc-4a8c-85e5-2ad7a37c2556 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:54.694997 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 695/1404] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 02:04:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:04:54.695185 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2450835-f7d7-42ff-af79-654cc8c5d9d8 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:54.695601 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2450835-f7d7-42ff-af79-654cc8c5d9d8 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:54.695601 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2450835-f7d7-42ff-af79-654cc8c5d9d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:54.729636 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:04:54.768289 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-c2450835-f7d7-42ff-af79-654cc8c5d9d8 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:04:54.769524 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-c2450835-f7d7-42ff-af79-654cc8c5d9d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:54.882185 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 710/1405] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 02:04:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 29 02:04:55.181454 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efe51e7-cfbc-4a8c-85e5-2ad7a37c2556 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:04:55.183218 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-5efe51e7-cfbc-4a8c-85e5-2ad7a37c2556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:55.359633 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efe51e7-cfbc-4a8c-85e5-2ad7a37c2556 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:04:55.402615 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:04:55.554000 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb46d6f-bee2-4496-8be7-535bd0f9b344 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3325a7111d447f4a9cf00c672d5420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:04:55.554000 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb46d6f-bee2-4496-8be7-535bd0f9b344 service nova] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:55.554000 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb46d6f-bee2-4496-8be7-535bd0f9b344 service nova] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:55.554000 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb46d6f-bee2-4496-8be7-535bd0f9b344 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:55.554434 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-fdb46d6f-bee2-4496-8be7-535bd0f9b344 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:55.653096 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb46d6f-bee2-4496-8be7-535bd0f9b344 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:04:55.654722 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb46d6f-bee2-4496-8be7-535bd0f9b344 service nova] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:04:55.675011 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 696/1406] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:04:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:04:57.935055 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886acdd5-f70b-46fe-9b67-242b599aa796 None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:57.935639 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886acdd5-f70b-46fe-9b67-242b599aa796 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:57.935755 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886acdd5-f70b-46fe-9b67-242b599aa796 None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:57.937121 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 711/1407] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 02:04:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:04:57.942403 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b973292-8350-4cb6-a3e8-90dd73fe288e None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:57.942831 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b973292-8350-4cb6-a3e8-90dd73fe288e None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:57.943034 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b973292-8350-4cb6-a3e8-90dd73fe288e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:58.006585 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:04:58.027680 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-0b973292-8350-4cb6-a3e8-90dd73fe288e None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:04:58.028914 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-0b973292-8350-4cb6-a3e8-90dd73fe288e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:58.145992 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 697/1408] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 02:04:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:04:58.442351 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886acdd5-f70b-46fe-9b67-242b599aa796 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:04:58.443953 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-886acdd5-f70b-46fe-9b67-242b599aa796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:58.553020 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:04:58.614263 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886acdd5-f70b-46fe-9b67-242b599aa796 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:04:58.742884 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20613b00-74b5-4e66-8222-602200e0f9ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3325a7111d447f4a9cf00c672d5420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:04:58.743406 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20613b00-74b5-4e66-8222-602200e0f9ab service nova] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:04:58.743678 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20613b00-74b5-4e66-8222-602200e0f9ab service nova] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:04:58.743946 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20613b00-74b5-4e66-8222-602200e0f9ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:04:58.745567 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-20613b00-74b5-4e66-8222-602200e0f9ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:04:58.824264 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:04:58.849104 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20613b00-74b5-4e66-8222-602200e0f9ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:04:58.850770 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20613b00-74b5-4e66-8222-602200e0f9ab service nova] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:04:58.873184 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 712/1409] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:04:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:05:08.133713 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=47 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:05:08.870857 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=16 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:05:15.401249 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba15d8-ffd0-4273-b565-96bd040b7dca None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:15.401838 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba15d8-ffd0-4273-b565-96bd040b7dca None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:15.401838 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba15d8-ffd0-4273-b565-96bd040b7dca None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:15.403171 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 698/1410] 10.222.0.49 () {54 vars in 918 bytes} [Thu Sep 29 02:05:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:05:15.408373 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89ecad0-7183-4277-845f-53d72aef6ada None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:15.408818 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89ecad0-7183-4277-845f-53d72aef6ada None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:15.408928 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89ecad0-7183-4277-845f-53d72aef6ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:15.484522 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-f89ecad0-7183-4277-845f-53d72aef6ada None None] MFA Rules not processed for user `3cbb39731a6b42e2a6647d6134b5c7cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:05:15.485795 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-f89ecad0-7183-4277-845f-53d72aef6ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:15.592143 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 713/1411] 10.222.0.49 () {58 vars in 1015 bytes} [Thu Sep 29 02:05:15 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:05:15.606990 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73809ee0-68f1-44c6-974f-1eca7fa41d61 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:15.607272 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73809ee0-68f1-44c6-974f-1eca7fa41d61 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:15.607547 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73809ee0-68f1-44c6-974f-1eca7fa41d61 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:15.608849 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 699/1412] 10.222.0.49 () {54 vars in 918 bytes} [Thu Sep 29 02:05:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:05:15.613554 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a05a50e-e4c8-4590-ae58-92e481d1d616 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:15.613839 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a05a50e-e4c8-4590-ae58-92e481d1d616 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:15.614111 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a05a50e-e4c8-4590-ae58-92e481d1d616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:15.687666 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:05:15.690374 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-2a05a50e-e4c8-4590-ae58-92e481d1d616 None None] MFA Rules not processed for user `f3325a7111d447f4a9cf00c672d5420f`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:05:15.692092 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-2a05a50e-e4c8-4590-ae58-92e481d1d616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:15.805782 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 714/1413] 10.222.0.49 () {58 vars in 1015 bytes} [Thu Sep 29 02:05:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 29 02:05:18.473701 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0718acb5-d5e3-43e0-93de-86996c49fe5b None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:18.474275 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0718acb5-d5e3-43e0-93de-86996c49fe5b None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:18.474275 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0718acb5-d5e3-43e0-93de-86996c49fe5b None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:18.475611 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 700/1414] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 29 02:05:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:05:18.480769 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ed747-390c-4b25-837c-5e8f0a9a4c98 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:18.481173 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ed747-390c-4b25-837c-5e8f0a9a4c98 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:18.481339 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ed747-390c-4b25-837c-5e8f0a9a4c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:18.546941 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-758ed747-390c-4b25-837c-5e8f0a9a4c98 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:05:18.548562 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-758ed747-390c-4b25-837c-5e8f0a9a4c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:18.604009 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:05:18.646531 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 715/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 29 02:05:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:05:18.943824 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0718acb5-d5e3-43e0-93de-86996c49fe5b None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:05:18.945484 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-0718acb5-d5e3-43e0-93de-86996c49fe5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:19.090601 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0718acb5-d5e3-43e0-93de-86996c49fe5b None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:05:19.163098 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:05:19.202627 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2277ca1-60d8-4da5-99ae-e2aeeec58d73 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3325a7111d447f4a9cf00c672d5420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:05:19.203230 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2277ca1-60d8-4da5-99ae-e2aeeec58d73 service nova] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:19.203509 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2277ca1-60d8-4da5-99ae-e2aeeec58d73 service nova] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:19.203828 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2277ca1-60d8-4da5-99ae-e2aeeec58d73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:19.205422 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-b2277ca1-60d8-4da5-99ae-e2aeeec58d73 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:19.293001 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2277ca1-60d8-4da5-99ae-e2aeeec58d73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:05:19.294640 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2277ca1-60d8-4da5-99ae-e2aeeec58d73 service nova] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:05:19.312701 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 701/1416] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:05:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:05:20.453099 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6e51c7-0072-4ba2-89af-838f66cf49b0 None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:20.453707 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6e51c7-0072-4ba2-89af-838f66cf49b0 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:20.453707 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6e51c7-0072-4ba2-89af-838f66cf49b0 None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:20.455067 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 716/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 29 02:05:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:05:20.461144 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a80b86-aa25-4216-a88f-496d8032deb4 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:20.461612 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a80b86-aa25-4216-a88f-496d8032deb4 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:20.461739 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a80b86-aa25-4216-a88f-496d8032deb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:20.536497 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-35a80b86-aa25-4216-a88f-496d8032deb4 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:05:20.537727 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-35a80b86-aa25-4216-a88f-496d8032deb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:20.564547 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:05:20.635638 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 702/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 29 02:05:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:05:20.788813 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6e51c7-0072-4ba2-89af-838f66cf49b0 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:05:20.790312 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-8f6e51c7-0072-4ba2-89af-838f66cf49b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:20.935757 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6e51c7-0072-4ba2-89af-838f66cf49b0 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:05:20.976548 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:05:21.049067 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98b195c-0264-4b56-b2a3-75067b827d8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3325a7111d447f4a9cf00c672d5420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:05:21.049640 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98b195c-0264-4b56-b2a3-75067b827d8c service nova] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:21.049913 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98b195c-0264-4b56-b2a3-75067b827d8c service nova] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:21.050555 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98b195c-0264-4b56-b2a3-75067b827d8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:21.051773 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-c98b195c-0264-4b56-b2a3-75067b827d8c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:21.140196 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98b195c-0264-4b56-b2a3-75067b827d8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:05:21.142592 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98b195c-0264-4b56-b2a3-75067b827d8c service nova] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:05:21.161148 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 717/1419] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:05:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:05:22.303140 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c132b355-dffc-474f-b41e-ca2bf31cf6f4 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:22.303691 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c132b355-dffc-474f-b41e-ca2bf31cf6f4 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:22.303691 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c132b355-dffc-474f-b41e-ca2bf31cf6f4 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:22.305010 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 703/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 29 02:05:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:05:22.311291 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4059b11c-774e-4f9e-b035-116237d9b144 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:22.311731 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4059b11c-774e-4f9e-b035-116237d9b144 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:22.311827 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4059b11c-774e-4f9e-b035-116237d9b144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:22.367701 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:05:22.390486 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-4059b11c-774e-4f9e-b035-116237d9b144 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:05:22.391691 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-4059b11c-774e-4f9e-b035-116237d9b144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:22.487754 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 718/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 29 02:05:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:05:22.641301 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c132b355-dffc-474f-b41e-ca2bf31cf6f4 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:05:22.643276 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-c132b355-dffc-474f-b41e-ca2bf31cf6f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:22.787629 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c132b355-dffc-474f-b41e-ca2bf31cf6f4 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:05:22.799668 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:05:22.900642 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a669f83f-390d-4b70-aa59-e13f9a6cf7ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3325a7111d447f4a9cf00c672d5420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:05:22.901172 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a669f83f-390d-4b70-aa59-e13f9a6cf7ec service nova] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:22.901480 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a669f83f-390d-4b70-aa59-e13f9a6cf7ec service nova] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:22.901750 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a669f83f-390d-4b70-aa59-e13f9a6cf7ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:22.903369 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-a669f83f-390d-4b70-aa59-e13f9a6cf7ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:22.994134 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a669f83f-390d-4b70-aa59-e13f9a6cf7ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:05:22.995754 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a669f83f-390d-4b70-aa59-e13f9a6cf7ec service nova] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:05:23.014113 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 704/1422] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:05:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:05:24.140870 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cfb687-9e70-415b-a8c7-851b3e4892a8 None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:24.141593 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cfb687-9e70-415b-a8c7-851b3e4892a8 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:24.141593 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cfb687-9e70-415b-a8c7-851b3e4892a8 None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:24.142882 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 719/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 29 02:05:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:05:24.149576 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ceb49-7416-4094-8c1f-e3e461e66edd None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:24.150040 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ceb49-7416-4094-8c1f-e3e461e66edd None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:24.150145 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ceb49-7416-4094-8c1f-e3e461e66edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:24.170399 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:05:24.226706 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-eb4ceb49-7416-4094-8c1f-e3e461e66edd None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:05:24.227913 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-eb4ceb49-7416-4094-8c1f-e3e461e66edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:24.324115 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 705/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 29 02:05:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:05:24.473343 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cfb687-9e70-415b-a8c7-851b3e4892a8 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:05:24.474888 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-30cfb687-9e70-415b-a8c7-851b3e4892a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:24.585237 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:05:24.622719 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cfb687-9e70-415b-a8c7-851b3e4892a8 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:05:24.855481 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22615df0-eff0-437c-bb53-c4f5c05720cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3325a7111d447f4a9cf00c672d5420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:05:24.856122 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22615df0-eff0-437c-bb53-c4f5c05720cc service nova] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:24.856402 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22615df0-eff0-437c-bb53-c4f5c05720cc service nova] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:24.856674 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22615df0-eff0-437c-bb53-c4f5c05720cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:24.858299 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-22615df0-eff0-437c-bb53-c4f5c05720cc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:24.935106 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:05:24.950090 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22615df0-eff0-437c-bb53-c4f5c05720cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:05:24.951687 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22615df0-eff0-437c-bb53-c4f5c05720cc service nova] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:05:24.970264 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 720/1425] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:05:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:05:26.071558 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b716d5-dbae-43b8-bab2-8f08b35620e7 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:26.072100 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b716d5-dbae-43b8-bab2-8f08b35620e7 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:26.072100 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b716d5-dbae-43b8-bab2-8f08b35620e7 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:26.073486 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 706/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 29 02:05:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:05:26.080502 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ee370b-af00-488a-b394-d31734e4c87a None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:26.080951 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ee370b-af00-488a-b394-d31734e4c87a None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:26.081054 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ee370b-af00-488a-b394-d31734e4c87a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:26.156136 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-60ee370b-af00-488a-b394-d31734e4c87a None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:05:26.157863 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-60ee370b-af00-488a-b394-d31734e4c87a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:26.252513 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 721/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 29 02:05:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:05:26.401841 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b716d5-dbae-43b8-bab2-8f08b35620e7 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:05:26.403359 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-77b716d5-dbae-43b8-bab2-8f08b35620e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:26.486002 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:05:26.548645 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b716d5-dbae-43b8-bab2-8f08b35620e7 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:05:26.660060 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797c2ab1-9f4f-448b-baf5-30a62eab796f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3325a7111d447f4a9cf00c672d5420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:05:26.660677 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c2ab1-9f4f-448b-baf5-30a62eab796f service nova] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:26.660951 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c2ab1-9f4f-448b-baf5-30a62eab796f service nova] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:26.661218 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c2ab1-9f4f-448b-baf5-30a62eab796f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:26.662821 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-797c2ab1-9f4f-448b-baf5-30a62eab796f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:26.712302 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:05:26.752743 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797c2ab1-9f4f-448b-baf5-30a62eab796f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:05:26.754276 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797c2ab1-9f4f-448b-baf5-30a62eab796f service nova] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:05:26.772645 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 707/1428] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:05:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:05:27.821996 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e402c32-c32a-4ee2-aac9-3b960f712bc5 None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:27.822585 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e402c32-c32a-4ee2-aac9-3b960f712bc5 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:27.822585 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e402c32-c32a-4ee2-aac9-3b960f712bc5 None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:27.823899 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 722/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 29 02:05:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:05:27.830009 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e4543-1126-464a-8feb-2a9dd7ef804c None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:27.830440 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e4543-1126-464a-8feb-2a9dd7ef804c None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:27.830566 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e4543-1126-464a-8feb-2a9dd7ef804c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:27.908659 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-2a8e4543-1126-464a-8feb-2a9dd7ef804c None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:05:27.908789 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-2a8e4543-1126-464a-8feb-2a9dd7ef804c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:28.005982 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 708/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 29 02:05:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:05:28.158084 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e402c32-c32a-4ee2-aac9-3b960f712bc5 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:05:28.159956 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-6e402c32-c32a-4ee2-aac9-3b960f712bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:28.208340 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:05:28.305901 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e402c32-c32a-4ee2-aac9-3b960f712bc5 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:05:28.416321 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbba2648-8bc7-48f0-940a-17814ae5c23d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3325a7111d447f4a9cf00c672d5420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:05:28.416837 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba2648-8bc7-48f0-940a-17814ae5c23d service nova] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:28.417110 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba2648-8bc7-48f0-940a-17814ae5c23d service nova] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:28.417397 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba2648-8bc7-48f0-940a-17814ae5c23d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:28.418964 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-bbba2648-8bc7-48f0-940a-17814ae5c23d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:28.426418 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:05:28.508293 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbba2648-8bc7-48f0-940a-17814ae5c23d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:05:28.509907 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbba2648-8bc7-48f0-940a-17814ae5c23d service nova] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:05:28.527627 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 723/1431] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:05:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:05:29.578830 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf5b6c7-a8a6-49b3-9e1f-999dce8e7def None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:29.579444 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf5b6c7-a8a6-49b3-9e1f-999dce8e7def None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:29.579652 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf5b6c7-a8a6-49b3-9e1f-999dce8e7def None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:29.580868 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 709/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 29 02:05:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:05:29.587238 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daad51c-6920-4508-b485-d622f3bb7e53 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:29.587687 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daad51c-6920-4508-b485-d622f3bb7e53 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:29.587806 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daad51c-6920-4508-b485-d622f3bb7e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:29.664868 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-2daad51c-6920-4508-b485-d622f3bb7e53 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:05:29.666123 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-2daad51c-6920-4508-b485-d622f3bb7e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:29.732446 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:05:29.761489 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 724/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 29 02:05:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:05:29.914116 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf5b6c7-a8a6-49b3-9e1f-999dce8e7def None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:05:29.915652 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-bdf5b6c7-a8a6-49b3-9e1f-999dce8e7def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:29.932629 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:05:30.059456 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf5b6c7-a8a6-49b3-9e1f-999dce8e7def None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:05:30.145842 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:05:30.171981 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7746ba13-996e-4984-a818-81a742275347 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3325a7111d447f4a9cf00c672d5420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:05:30.172512 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7746ba13-996e-4984-a818-81a742275347 service nova] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:30.172791 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7746ba13-996e-4984-a818-81a742275347 service nova] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:30.173688 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7746ba13-996e-4984-a818-81a742275347 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:30.175283 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-7746ba13-996e-4984-a818-81a742275347 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:30.262857 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7746ba13-996e-4984-a818-81a742275347 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:05:30.264436 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7746ba13-996e-4984-a818-81a742275347 service nova] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:05:30.282862 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 710/1434] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:05:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:05:31.330045 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f565f6-6df4-450d-bc36-12d0eaf16540 None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:31.330625 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f565f6-6df4-450d-bc36-12d0eaf16540 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:31.330625 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f565f6-6df4-450d-bc36-12d0eaf16540 None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:31.331963 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 725/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 29 02:05:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:05:31.338413 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8094f155-d461-4c26-ae5b-f1d7f5348304 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:31.338830 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8094f155-d461-4c26-ae5b-f1d7f5348304 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:31.338970 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8094f155-d461-4c26-ae5b-f1d7f5348304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:31.415804 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-8094f155-d461-4c26-ae5b-f1d7f5348304 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:05:31.417029 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-8094f155-d461-4c26-ae5b-f1d7f5348304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:31.459563 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:05:31.513517 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 711/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 29 02:05:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:05:31.692852 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f565f6-6df4-450d-bc36-12d0eaf16540 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:05:31.694305 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-a3f565f6-6df4-450d-bc36-12d0eaf16540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:31.837801 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f565f6-6df4-450d-bc36-12d0eaf16540 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:05:31.891198 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:05:31.952291 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa8ec6e-ef34-4b7c-a72e-1712807da0f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3325a7111d447f4a9cf00c672d5420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:05:31.952858 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa8ec6e-ef34-4b7c-a72e-1712807da0f6 service nova] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:31.953136 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa8ec6e-ef34-4b7c-a72e-1712807da0f6 service nova] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:31.953441 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa8ec6e-ef34-4b7c-a72e-1712807da0f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:31.955975 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-7fa8ec6e-ef34-4b7c-a72e-1712807da0f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:32.050886 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa8ec6e-ef34-4b7c-a72e-1712807da0f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:05:32.052513 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa8ec6e-ef34-4b7c-a72e-1712807da0f6 service nova] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:05:32.071383 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 726/1437] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:05:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:05:33.138664 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb48571-6f5e-4580-8ea4-9c0c2f0bbb8d None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:33.139248 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb48571-6f5e-4580-8ea4-9c0c2f0bbb8d None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:33.139248 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb48571-6f5e-4580-8ea4-9c0c2f0bbb8d None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:33.140565 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 712/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 29 02:05:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:05:33.147458 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b2272e-07a8-4658-9444-15d70237398e None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:33.147930 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b2272e-07a8-4658-9444-15d70237398e None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:33.148040 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b2272e-07a8-4658-9444-15d70237398e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:33.223819 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-52b2272e-07a8-4658-9444-15d70237398e None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:05:33.224987 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-52b2272e-07a8-4658-9444-15d70237398e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:33.227108 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:05:33.324700 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 727/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 29 02:05:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:05:33.474141 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb48571-6f5e-4580-8ea4-9c0c2f0bbb8d None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:05:33.475607 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-6eb48571-6f5e-4580-8ea4-9c0c2f0bbb8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:33.619275 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb48571-6f5e-4580-8ea4-9c0c2f0bbb8d None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:05:33.646208 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:05:33.734443 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c938c58-1f4f-4869-984a-96708fabc3a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3325a7111d447f4a9cf00c672d5420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:05:33.734983 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c938c58-1f4f-4869-984a-96708fabc3a6 service nova] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:33.735260 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c938c58-1f4f-4869-984a-96708fabc3a6 service nova] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:33.736041 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c938c58-1f4f-4869-984a-96708fabc3a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:33.738042 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-2c938c58-1f4f-4869-984a-96708fabc3a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:33.826716 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c938c58-1f4f-4869-984a-96708fabc3a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:05:33.828302 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c938c58-1f4f-4869-984a-96708fabc3a6 service nova] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:05:33.846081 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 713/1440] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:05:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:05:35.900368 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e72025f-602b-4b84-b9f1-4f32724ffde5 None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:35.900946 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e72025f-602b-4b84-b9f1-4f32724ffde5 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:35.900946 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e72025f-602b-4b84-b9f1-4f32724ffde5 None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:35.902300 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 728/1441] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 29 02:05:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:05:35.908526 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea8c63a-2553-424f-be60-f1fa86d54d10 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:35.908953 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea8c63a-2553-424f-be60-f1fa86d54d10 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:35.909172 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea8c63a-2553-424f-be60-f1fa86d54d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:35.949656 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:05:35.976683 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-fea8c63a-2553-424f-be60-f1fa86d54d10 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:05:35.977980 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-fea8c63a-2553-424f-be60-f1fa86d54d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:36.073168 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 714/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 29 02:05:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:05:36.360432 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e72025f-602b-4b84-b9f1-4f32724ffde5 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:05:36.362568 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-5e72025f-602b-4b84-b9f1-4f32724ffde5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:36.463832 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e72025f-602b-4b84-b9f1-4f32724ffde5 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:05:36.496149 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:05:36.538150 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7d4861-ed11-4f99-98df-ddd7fdaaf331 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:05:36.538754 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7d4861-ed11-4f99-98df-ddd7fdaaf331 service neutron] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:36.539030 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7d4861-ed11-4f99-98df-ddd7fdaaf331 service neutron] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:36.539296 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7d4861-ed11-4f99-98df-ddd7fdaaf331 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:36.540859 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-ca7d4861-ed11-4f99-98df-ddd7fdaaf331 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:36.650521 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7d4861-ed11-4f99-98df-ddd7fdaaf331 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:05:36.651883 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7d4861-ed11-4f99-98df-ddd7fdaaf331 service neutron] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:05:36.669719 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 729/1443] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:05:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:05:38.975930 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7b9d6-51ea-4e95-8874-83152d64f01b None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:38.976478 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7b9d6-51ea-4e95-8874-83152d64f01b None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:38.976478 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7b9d6-51ea-4e95-8874-83152d64f01b None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:38.977850 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 715/1444] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 29 02:05:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:05:38.983121 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64556cc1-f15c-4dce-a19b-1f5f1d6a1bf8 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:38.983540 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64556cc1-f15c-4dce-a19b-1f5f1d6a1bf8 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:38.983649 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64556cc1-f15c-4dce-a19b-1f5f1d6a1bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:39.049358 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-64556cc1-f15c-4dce-a19b-1f5f1d6a1bf8 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:05:39.050649 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-64556cc1-f15c-4dce-a19b-1f5f1d6a1bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:39.063300 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:05:39.147284 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 730/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 29 02:05:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:05:39.429438 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c7b9d6-51ea-4e95-8874-83152d64f01b None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:05:39.430974 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-f0c7b9d6-51ea-4e95-8874-83152d64f01b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:39.533057 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c7b9d6-51ea-4e95-8874-83152d64f01b None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:05:39.545569 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:05:39.607823 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6076ff57-6f24-47f2-aea6-4ceb0964d95c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:05:39.608423 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6076ff57-6f24-47f2-aea6-4ceb0964d95c service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:39.608700 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6076ff57-6f24-47f2-aea6-4ceb0964d95c service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:39.608970 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6076ff57-6f24-47f2-aea6-4ceb0964d95c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:39.610599 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-6076ff57-6f24-47f2-aea6-4ceb0964d95c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:39.741058 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6076ff57-6f24-47f2-aea6-4ceb0964d95c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:05:39.742452 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6076ff57-6f24-47f2-aea6-4ceb0964d95c service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:05:39.761231 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 716/1446] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:05:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:05:42.229567 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea9b81-1eb4-4757-b161-3136bc2c254d None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:42.230093 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea9b81-1eb4-4757-b161-3136bc2c254d None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:42.230093 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea9b81-1eb4-4757-b161-3136bc2c254d None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:42.231377 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 731/1447] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 29 02:05:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:05:42.237382 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aca444-913a-42a6-8bb2-72ba5f8bd4c3 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:42.237789 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aca444-913a-42a6-8bb2-72ba5f8bd4c3 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:42.237929 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aca444-913a-42a6-8bb2-72ba5f8bd4c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:42.286394 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:05:42.305501 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-34aca444-913a-42a6-8bb2-72ba5f8bd4c3 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:05:42.306734 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-34aca444-913a-42a6-8bb2-72ba5f8bd4c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:42.405288 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 717/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 29 02:05:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:05:42.695379 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ea9b81-1eb4-4757-b161-3136bc2c254d None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:05:42.696924 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-10ea9b81-1eb4-4757-b161-3136bc2c254d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:42.808058 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ea9b81-1eb4-4757-b161-3136bc2c254d None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:05:42.847845 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:05:42.881021 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23c8bdf-0d62-4c48-ba99-f7e25d24d632 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:05:42.881645 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c8bdf-0d62-4c48-ba99-f7e25d24d632 service neutron] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:42.881917 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c8bdf-0d62-4c48-ba99-f7e25d24d632 service neutron] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:42.882182 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c8bdf-0d62-4c48-ba99-f7e25d24d632 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:42.883745 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-d23c8bdf-0d62-4c48-ba99-f7e25d24d632 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:42.993771 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23c8bdf-0d62-4c48-ba99-f7e25d24d632 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:05:42.995213 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23c8bdf-0d62-4c48-ba99-f7e25d24d632 service neutron] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:05:43.013205 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 732/1449] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:05:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:05:45.361196 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e4c997-6c35-4de6-9079-2f2dacf894d6 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:45.361764 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e4c997-6c35-4de6-9079-2f2dacf894d6 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:45.361910 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e4c997-6c35-4de6-9079-2f2dacf894d6 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:45.363259 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 718/1450] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 29 02:05:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:05:45.368604 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09904904-c4e4-46d5-90a1-7fc3f9477b22 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:45.369025 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09904904-c4e4-46d5-90a1-7fc3f9477b22 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:45.369160 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09904904-c4e4-46d5-90a1-7fc3f9477b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:45.435081 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-09904904-c4e4-46d5-90a1-7fc3f9477b22 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:05:45.436305 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-09904904-c4e4-46d5-90a1-7fc3f9477b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:45.458045 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:05:45.534383 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 733/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 29 02:05:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:05:45.824565 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e4c997-6c35-4de6-9079-2f2dacf894d6 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:05:45.826149 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-81e4c997-6c35-4de6-9079-2f2dacf894d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:45.929113 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e4c997-6c35-4de6-9079-2f2dacf894d6 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:05:45.949669 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:05:46.003829 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f5376c-911a-44c5-a602-aec7a4ad6a7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:05:46.004435 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f5376c-911a-44c5-a602-aec7a4ad6a7f service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:46.004716 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f5376c-911a-44c5-a602-aec7a4ad6a7f service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:46.004990 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f5376c-911a-44c5-a602-aec7a4ad6a7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:46.006620 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-04f5376c-911a-44c5-a602-aec7a4ad6a7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:46.115427 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f5376c-911a-44c5-a602-aec7a4ad6a7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:05:46.116774 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f5376c-911a-44c5-a602-aec7a4ad6a7f service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:05:46.135064 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 719/1452] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:05:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:05:48.367659 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea0bb3-9e4a-4f3f-9fa4-264e404b82af None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:48.368224 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea0bb3-9e4a-4f3f-9fa4-264e404b82af None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:48.368224 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea0bb3-9e4a-4f3f-9fa4-264e404b82af None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:48.369571 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 734/1453] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 29 02:05:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:05:48.375170 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a737bc7b-100f-46d0-b1a5-bea26d1fa721 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:48.375579 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a737bc7b-100f-46d0-b1a5-bea26d1fa721 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:48.375728 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a737bc7b-100f-46d0-b1a5-bea26d1fa721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:48.440266 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:05:48.443108 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-a737bc7b-100f-46d0-b1a5-bea26d1fa721 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:05:48.444943 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-a737bc7b-100f-46d0-b1a5-bea26d1fa721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:48.659014 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 720/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 29 02:05:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:05:48.945766 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dea0bb3-9e4a-4f3f-9fa4-264e404b82af None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:05:48.947297 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-0dea0bb3-9e4a-4f3f-9fa4-264e404b82af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:49.051807 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dea0bb3-9e4a-4f3f-9fa4-264e404b82af None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:05:49.101098 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:05:49.125809 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e66c4b-45b7-41a3-bc97-1683cb65353d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:05:49.126409 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e66c4b-45b7-41a3-bc97-1683cb65353d service neutron] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:49.126745 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e66c4b-45b7-41a3-bc97-1683cb65353d service neutron] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:49.127107 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e66c4b-45b7-41a3-bc97-1683cb65353d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:49.128705 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-c3e66c4b-45b7-41a3-bc97-1683cb65353d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:49.236586 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e66c4b-45b7-41a3-bc97-1683cb65353d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:05:49.238007 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e66c4b-45b7-41a3-bc97-1683cb65353d service neutron] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:05:49.255706 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 735/1455] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:05:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:05:51.614265 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddba110-2de9-491a-8967-1a9e8d979275 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:51.614812 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddba110-2de9-491a-8967-1a9e8d979275 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:51.614812 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddba110-2de9-491a-8967-1a9e8d979275 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:51.616100 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 721/1456] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 29 02:05:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:05:51.621624 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f04577-4f04-4dad-8de2-ee5173398384 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:51.622034 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f04577-4f04-4dad-8de2-ee5173398384 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:51.622180 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f04577-4f04-4dad-8de2-ee5173398384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:51.690192 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-f5f04577-4f04-4dad-8de2-ee5173398384 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:05:51.691421 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-f5f04577-4f04-4dad-8de2-ee5173398384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:51.721112 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:05:51.788544 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 736/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 29 02:05:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:05:52.074091 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddba110-2de9-491a-8967-1a9e8d979275 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:05:52.075611 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-4ddba110-2de9-491a-8967-1a9e8d979275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:52.177990 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddba110-2de9-491a-8967-1a9e8d979275 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:05:52.205814 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:05:52.251219 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338790f7-d386-4205-9244-2ae077b1d352 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:05:52.251923 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338790f7-d386-4205-9244-2ae077b1d352 service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:52.252199 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338790f7-d386-4205-9244-2ae077b1d352 service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:52.252469 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338790f7-d386-4205-9244-2ae077b1d352 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:52.254098 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-338790f7-d386-4205-9244-2ae077b1d352 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:52.362373 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338790f7-d386-4205-9244-2ae077b1d352 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:05:52.363793 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338790f7-d386-4205-9244-2ae077b1d352 service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:05:52.381383 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 722/1458] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:05:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:05:54.570171 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cb291c-1524-4e28-ac6f-02b097b811a8 None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:54.570638 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cb291c-1524-4e28-ac6f-02b097b811a8 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:54.570870 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cb291c-1524-4e28-ac6f-02b097b811a8 None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:54.572086 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 737/1459] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 29 02:05:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:05:54.577393 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73bbf0f-d41e-434d-85ec-3214070e0ef8 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:54.577800 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73bbf0f-d41e-434d-85ec-3214070e0ef8 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:54.577938 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73bbf0f-d41e-434d-85ec-3214070e0ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:54.644257 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-b73bbf0f-d41e-434d-85ec-3214070e0ef8 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:05:54.645503 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-b73bbf0f-d41e-434d-85ec-3214070e0ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:54.654112 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:05:54.744756 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 723/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 29 02:05:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:05:55.034997 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cb291c-1524-4e28-ac6f-02b097b811a8 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:05:55.036566 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-e2cb291c-1524-4e28-ac6f-02b097b811a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:55.163487 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cb291c-1524-4e28-ac6f-02b097b811a8 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:05:55.217626 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:05:55.235905 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d3507b-5bde-49b9-bc13-dee28d5aa69b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:05:55.237047 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d3507b-5bde-49b9-bc13-dee28d5aa69b service neutron] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:55.237381 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d3507b-5bde-49b9-bc13-dee28d5aa69b service neutron] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:55.237601 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d3507b-5bde-49b9-bc13-dee28d5aa69b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:55.239171 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-d4d3507b-5bde-49b9-bc13-dee28d5aa69b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:55.348363 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d3507b-5bde-49b9-bc13-dee28d5aa69b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:05:55.349824 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d3507b-5bde-49b9-bc13-dee28d5aa69b service neutron] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:05:55.367653 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 738/1461] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:05:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:05:57.565787 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fe6378-9e13-4863-8ee3-a6c4b54fd41d None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:57.566362 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fe6378-9e13-4863-8ee3-a6c4b54fd41d None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:57.566362 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fe6378-9e13-4863-8ee3-a6c4b54fd41d None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:57.567636 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 724/1462] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 29 02:05:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:05:57.573023 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1efb956-eb80-4481-a2d6-1b0de5039c5e None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:57.573458 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1efb956-eb80-4481-a2d6-1b0de5039c5e None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:57.573650 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1efb956-eb80-4481-a2d6-1b0de5039c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:57.639906 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-b1efb956-eb80-4481-a2d6-1b0de5039c5e None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:05:57.641128 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-b1efb956-eb80-4481-a2d6-1b0de5039c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:57.679799 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:05:57.747701 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 739/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 29 02:05:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:05:58.042757 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fe6378-9e13-4863-8ee3-a6c4b54fd41d None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:05:58.044556 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-67fe6378-9e13-4863-8ee3-a6c4b54fd41d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:58.149038 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fe6378-9e13-4863-8ee3-a6c4b54fd41d None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:05:58.187313 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:05:58.224318 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39c1ae0-6de2-4ba2-a3bf-bb095b855dc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:05:58.224923 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c1ae0-6de2-4ba2-a3bf-bb095b855dc0 service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:05:58.225205 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c1ae0-6de2-4ba2-a3bf-bb095b855dc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:05:58.225504 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c1ae0-6de2-4ba2-a3bf-bb095b855dc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:05:58.227102 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-a39c1ae0-6de2-4ba2-a3bf-bb095b855dc0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:05:58.335698 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39c1ae0-6de2-4ba2-a3bf-bb095b855dc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:05:58.337121 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39c1ae0-6de2-4ba2-a3bf-bb095b855dc0 service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:05:58.355374 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 725/1464] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:05:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:06:00.519098 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46572c8a-3c29-4477-b1a6-b74a4254f5ee None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:06:00.519648 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46572c8a-3c29-4477-b1a6-b74a4254f5ee None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:06:00.519746 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46572c8a-3c29-4477-b1a6-b74a4254f5ee None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:06:00.521026 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 740/1465] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 29 02:06:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:06:00.526523 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be9fbf0-bcef-49ca-ba17-c3fd85ee8c8f None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:06:00.526932 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be9fbf0-bcef-49ca-ba17-c3fd85ee8c8f None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:06:00.527076 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be9fbf0-bcef-49ca-ba17-c3fd85ee8c8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:06:00.592926 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-0be9fbf0-bcef-49ca-ba17-c3fd85ee8c8f None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:06:00.594170 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-0be9fbf0-bcef-49ca-ba17-c3fd85ee8c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:06:00.613421 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:06:00.691897 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 726/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 29 02:06:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:06:00.975481 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46572c8a-3c29-4477-b1a6-b74a4254f5ee None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:06:00.977013 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-46572c8a-3c29-4477-b1a6-b74a4254f5ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:06:01.081364 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46572c8a-3c29-4477-b1a6-b74a4254f5ee None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:06:01.147878 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:06:01.155073 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9867881c-d11a-470f-84df-74f5c86ce173 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:06:01.155730 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9867881c-d11a-470f-84df-74f5c86ce173 service neutron] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:06:01.155960 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9867881c-d11a-470f-84df-74f5c86ce173 service neutron] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:06:01.156230 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9867881c-d11a-470f-84df-74f5c86ce173 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:06:01.157846 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-9867881c-d11a-470f-84df-74f5c86ce173 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:06:01.265498 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9867881c-d11a-470f-84df-74f5c86ce173 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:06:01.266915 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9867881c-d11a-470f-84df-74f5c86ce173 service neutron] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:06:01.285273 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 741/1467] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:06:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:06:03.491353 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e23e90-dea7-4439-a8d8-a6e57b91cb1d None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:06:03.491894 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e23e90-dea7-4439-a8d8-a6e57b91cb1d None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:06:03.491894 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e23e90-dea7-4439-a8d8-a6e57b91cb1d None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:06:03.493249 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 727/1468] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 29 02:06:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:06:03.498831 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59581de6-e4b3-4c4e-890c-4551c6437439 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:06:03.499306 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59581de6-e4b3-4c4e-890c-4551c6437439 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:06:03.499420 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59581de6-e4b3-4c4e-890c-4551c6437439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:06:03.570080 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-59581de6-e4b3-4c4e-890c-4551c6437439 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:06:03.571311 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-59581de6-e4b3-4c4e-890c-4551c6437439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:06:03.620184 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:06:03.669441 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 742/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 29 02:06:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:06:03.963991 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e23e90-dea7-4439-a8d8-a6e57b91cb1d None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:06:03.965539 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-69e23e90-dea7-4439-a8d8-a6e57b91cb1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:06:04.066569 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e23e90-dea7-4439-a8d8-a6e57b91cb1d None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:06:04.113558 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:06:04.138679 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84d4ff4-115c-4689-972d-39a18d9b5611 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:06:04.139289 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d4ff4-115c-4689-972d-39a18d9b5611 service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:06:04.139560 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d4ff4-115c-4689-972d-39a18d9b5611 service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:06:04.139824 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d4ff4-115c-4689-972d-39a18d9b5611 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:06:04.141655 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-d84d4ff4-115c-4689-972d-39a18d9b5611 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:06:04.250929 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84d4ff4-115c-4689-972d-39a18d9b5611 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:06:04.252402 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84d4ff4-115c-4689-972d-39a18d9b5611 service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:06:04.270195 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 728/1470] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:06:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:06:13.667953 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=22 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:06:14.267793 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=66 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:06:24.274343 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e3615-87f2-4230-b457-a88c89c67c4b None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:06:24.274934 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e3615-87f2-4230-b457-a88c89c67c4b None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:06:24.274934 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e3615-87f2-4230-b457-a88c89c67c4b None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:06:24.276242 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 743/1471] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 02:06:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:06:24.281808 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9db4eb-97e7-49d3-a363-148c46be6c6d None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:06:24.282275 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9db4eb-97e7-49d3-a363-148c46be6c6d None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:06:24.282373 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9db4eb-97e7-49d3-a363-148c46be6c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:06:24.347644 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-aa9db4eb-97e7-49d3-a363-148c46be6c6d None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:06:24.349122 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-aa9db4eb-97e7-49d3-a363-148c46be6c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:06:24.443705 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 729/1472] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 02:06:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:06:24.741759 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689ec7c-0abf-463b-9f3c-fbf6f69a44a8 None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:06:24.742044 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689ec7c-0abf-463b-9f3c-fbf6f69a44a8 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:06:24.742317 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689ec7c-0abf-463b-9f3c-fbf6f69a44a8 None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:06:24.743641 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 744/1473] 10.222.0.49 () {54 vars in 962 bytes} [Thu Sep 29 02:06:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:06:24.748771 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6440618-765b-42db-97c5-cdf03dc93ec9 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:06:24.749053 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6440618-765b-42db-97c5-cdf03dc93ec9 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:06:24.749337 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6440618-765b-42db-97c5-cdf03dc93ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:06:24.825969 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-b6440618-765b-42db-97c5-cdf03dc93ec9 None None] MFA Rules not processed for user `5d36669146554031ba8596cb583cd6f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:06:24.827201 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-b6440618-765b-42db-97c5-cdf03dc93ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:06:24.855910 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:06:24.913656 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 730/1474] 10.222.0.49 () {58 vars in 1059 bytes} [Thu Sep 29 02:06:24 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:06:24.921489 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9689ec7c-0abf-463b-9f3c-fbf6f69a44a8 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:06:24.922995 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-9689ec7c-0abf-463b-9f3c-fbf6f69a44a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:06:25.027898 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9689ec7c-0abf-463b-9f3c-fbf6f69a44a8 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:06:25.104412 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d85455-ecba-4b06-a27f-e3fa1236f865 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d36669146554031ba8596cb583cd6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:06:25.104945 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d85455-ecba-4b06-a27f-e3fa1236f865 service glance] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:06:25.105224 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d85455-ecba-4b06-a27f-e3fa1236f865 service glance] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:06:25.105525 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d85455-ecba-4b06-a27f-e3fa1236f865 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:06:25.107143 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-c1d85455-ecba-4b06-a27f-e3fa1236f865 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:06:25.162501 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:06:25.216680 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d85455-ecba-4b06-a27f-e3fa1236f865 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:06:25.218127 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d85455-ecba-4b06-a27f-e3fa1236f865 service glance] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:06:25.237014 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 745/1475] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:06:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:06:27.469908 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5aad2f-54f9-4e67-9461-c2c87b7bdefb None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:06:27.470479 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5aad2f-54f9-4e67-9461-c2c87b7bdefb None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:06:27.470479 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5aad2f-54f9-4e67-9461-c2c87b7bdefb None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:06:27.472873 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 731/1476] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 02:06:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:06:27.478476 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c19a67-6081-4e5e-8cf5-a86c133799f2 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:06:27.478902 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c19a67-6081-4e5e-8cf5-a86c133799f2 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:06:27.479014 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c19a67-6081-4e5e-8cf5-a86c133799f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:06:27.544601 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-f9c19a67-6081-4e5e-8cf5-a86c133799f2 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:06:27.545835 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-f9c19a67-6081-4e5e-8cf5-a86c133799f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:06:27.642223 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 746/1477] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 02:06:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:06:27.921831 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5aad2f-54f9-4e67-9461-c2c87b7bdefb None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:06:27.923365 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-de5aad2f-54f9-4e67-9461-c2c87b7bdefb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:06:28.049963 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5aad2f-54f9-4e67-9461-c2c87b7bdefb None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:06:28.099982 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:06:28.145651 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26376699-5e29-4f6f-8c0c-91cc1ab7f06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:06:28.146263 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26376699-5e29-4f6f-8c0c-91cc1ab7f06f admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:06:28.146543 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26376699-5e29-4f6f-8c0c-91cc1ab7f06f admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:06:28.146817 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26376699-5e29-4f6f-8c0c-91cc1ab7f06f admin admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:06:28.147451 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26376699-5e29-4f6f-8c0c-91cc1ab7f06f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:06:28.149195 dv-cinder-740146-21-smb devstack@keystone.service[81649]: WARNING py.warnings [None req-26376699-5e29-4f6f-8c0c-91cc1ab7f06f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 29 02:06:28.149195 dv-cinder-740146-21-smb devstack@keystone.service[81649]: warnings.warn(msg) Sep 29 02:06:28.149195 dv-cinder-740146-21-smb devstack@keystone.service[81649]: Sep 29 02:06:28.150364 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26376699-5e29-4f6f-8c0c-91cc1ab7f06f admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:06:28.170419 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 732/1478] 10.222.0.49 () {56 vars in 1108 bytes} [Thu Sep 29 02:06:27 2022] GET /identity/v3/projects => generated 2553 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:06:30.322981 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b165e2-0e42-4e19-8f30-38ae92fbb2fe None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:06:30.323530 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b165e2-0e42-4e19-8f30-38ae92fbb2fe None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:06:30.323530 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b165e2-0e42-4e19-8f30-38ae92fbb2fe None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:06:30.324847 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 747/1479] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 02:06:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:06:30.331155 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de44a7c3-3251-4b97-8d71-3539842ac289 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:06:30.331587 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de44a7c3-3251-4b97-8d71-3539842ac289 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:06:30.331701 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de44a7c3-3251-4b97-8d71-3539842ac289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:06:30.397666 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-de44a7c3-3251-4b97-8d71-3539842ac289 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:06:30.398869 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-de44a7c3-3251-4b97-8d71-3539842ac289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:06:30.494032 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 733/1480] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 02:06:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 29 02:06:30.794615 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b165e2-0e42-4e19-8f30-38ae92fbb2fe None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:06:30.796083 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-39b165e2-0e42-4e19-8f30-38ae92fbb2fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:06:30.806863 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:06:30.946689 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b165e2-0e42-4e19-8f30-38ae92fbb2fe None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:06:31.027360 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:06:31.062496 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1635f7e9-fb9e-49ec-a6ee-6d8ff191a7b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3325a7111d447f4a9cf00c672d5420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:06:31.063131 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1635f7e9-fb9e-49ec-a6ee-6d8ff191a7b6 service nova] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:06:31.063412 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1635f7e9-fb9e-49ec-a6ee-6d8ff191a7b6 service nova] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:06:31.063685 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1635f7e9-fb9e-49ec-a6ee-6d8ff191a7b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:06:31.065613 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-1635f7e9-fb9e-49ec-a6ee-6d8ff191a7b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:06:31.157132 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1635f7e9-fb9e-49ec-a6ee-6d8ff191a7b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:06:31.159656 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1635f7e9-fb9e-49ec-a6ee-6d8ff191a7b6 service nova] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:06:31.178259 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 748/1481] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:06:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:06:33.498993 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fd4688-9e46-40b1-a5e9-b5fa717ceff5 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:06:33.499583 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fd4688-9e46-40b1-a5e9-b5fa717ceff5 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:06:33.499583 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fd4688-9e46-40b1-a5e9-b5fa717ceff5 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:06:33.500890 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 734/1482] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 02:06:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:06:33.506700 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee3e6c-8169-41b4-851c-db6ecce9bf1e None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:06:33.507102 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee3e6c-8169-41b4-851c-db6ecce9bf1e None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:06:33.507244 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee3e6c-8169-41b4-851c-db6ecce9bf1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:06:33.573832 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-3eee3e6c-8169-41b4-851c-db6ecce9bf1e None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:06:33.575035 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-3eee3e6c-8169-41b4-851c-db6ecce9bf1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:06:33.623272 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:06:33.673497 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 749/1483] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 02:06:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:06:33.963630 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fd4688-9e46-40b1-a5e9-b5fa717ceff5 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:06:33.965219 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-18fd4688-9e46-40b1-a5e9-b5fa717ceff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:06:33.991047 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:06:34.070565 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fd4688-9e46-40b1-a5e9-b5fa717ceff5 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:06:34.143512 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27697af8-a1c3-4e7c-9c0b-097d5f6ba435 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:06:34.144118 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27697af8-a1c3-4e7c-9c0b-097d5f6ba435 service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:06:34.144396 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27697af8-a1c3-4e7c-9c0b-097d5f6ba435 service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:06:34.144666 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27697af8-a1c3-4e7c-9c0b-097d5f6ba435 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:06:34.146301 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-27697af8-a1c3-4e7c-9c0b-097d5f6ba435 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:06:34.219748 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:06:34.258338 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27697af8-a1c3-4e7c-9c0b-097d5f6ba435 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:06:34.259782 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27697af8-a1c3-4e7c-9c0b-097d5f6ba435 service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:06:34.278146 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 735/1484] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:06:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:06:36.472617 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f211b3a-7292-499f-b86f-3ecfc275b8c6 None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:06:36.473190 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f211b3a-7292-499f-b86f-3ecfc275b8c6 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:06:36.473190 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f211b3a-7292-499f-b86f-3ecfc275b8c6 None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:06:36.474554 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 750/1485] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 02:06:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:06:36.479934 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e928b-3869-4ee2-8101-a33dd40eb5bf None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:06:36.480365 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e928b-3869-4ee2-8101-a33dd40eb5bf None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:06:36.480503 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e928b-3869-4ee2-8101-a33dd40eb5bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:06:36.546302 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-0b7e928b-3869-4ee2-8101-a33dd40eb5bf None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:06:36.547512 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-0b7e928b-3869-4ee2-8101-a33dd40eb5bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:06:36.645672 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 736/1486] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 02:06:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:06:36.934597 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f211b3a-7292-499f-b86f-3ecfc275b8c6 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:06:36.936141 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-5f211b3a-7292-499f-b86f-3ecfc275b8c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:06:37.042678 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f211b3a-7292-499f-b86f-3ecfc275b8c6 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:06:37.112879 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:06:37.114389 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f7a14e-5920-4241-a5fe-c50dfa55f7e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:06:37.114991 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f7a14e-5920-4241-a5fe-c50dfa55f7e9 service neutron] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:06:37.115269 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f7a14e-5920-4241-a5fe-c50dfa55f7e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:06:37.115734 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f7a14e-5920-4241-a5fe-c50dfa55f7e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:06:37.117727 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-e5f7a14e-5920-4241-a5fe-c50dfa55f7e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:06:37.224914 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f7a14e-5920-4241-a5fe-c50dfa55f7e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:06:37.226277 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f7a14e-5920-4241-a5fe-c50dfa55f7e9 service neutron] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:06:37.243741 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 751/1487] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:06:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:06:39.467103 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024272c8-a62b-438b-b930-347e03237826 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:06:39.467650 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024272c8-a62b-438b-b930-347e03237826 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:06:39.467650 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024272c8-a62b-438b-b930-347e03237826 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:06:39.468946 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 737/1488] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 02:06:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:06:39.474801 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9147358d-c3f6-43f0-bc3c-9a1ef4ee82f3 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:06:39.475244 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9147358d-c3f6-43f0-bc3c-9a1ef4ee82f3 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:06:39.475351 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9147358d-c3f6-43f0-bc3c-9a1ef4ee82f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:06:39.541264 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-9147358d-c3f6-43f0-bc3c-9a1ef4ee82f3 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:06:39.542497 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-9147358d-c3f6-43f0-bc3c-9a1ef4ee82f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:06:39.594387 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:06:39.639627 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 752/1489] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 02:06:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:06:39.929233 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024272c8-a62b-438b-b930-347e03237826 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:06:39.930781 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-024272c8-a62b-438b-b930-347e03237826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:06:39.967303 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:06:40.035228 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024272c8-a62b-438b-b930-347e03237826 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:06:40.108658 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0568372d-dca6-404a-8ad4-d5de4e1d904d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:06:40.109256 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0568372d-dca6-404a-8ad4-d5de4e1d904d service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:06:40.109574 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0568372d-dca6-404a-8ad4-d5de4e1d904d service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:06:40.109831 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0568372d-dca6-404a-8ad4-d5de4e1d904d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:06:40.111500 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-0568372d-dca6-404a-8ad4-d5de4e1d904d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:06:40.191637 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:06:40.220528 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0568372d-dca6-404a-8ad4-d5de4e1d904d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:06:40.222059 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0568372d-dca6-404a-8ad4-d5de4e1d904d service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:06:40.239879 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 738/1490] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:06:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:06:42.670092 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca727e7a-7318-4b95-a0ba-982c5b476075 None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:06:42.670619 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca727e7a-7318-4b95-a0ba-982c5b476075 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:06:42.670619 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca727e7a-7318-4b95-a0ba-982c5b476075 None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:06:42.671968 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 753/1491] 10.222.0.49 () {54 vars in 927 bytes} [Thu Sep 29 02:06:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:06:42.677376 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d8d5d-1a28-48ec-acf5-6657fcace5c9 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:06:42.677765 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d8d5d-1a28-48ec-acf5-6657fcace5c9 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:06:42.677927 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d8d5d-1a28-48ec-acf5-6657fcace5c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:06:42.743416 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-d56d8d5d-1a28-48ec-acf5-6657fcace5c9 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:06:42.744628 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-d56d8d5d-1a28-48ec-acf5-6657fcace5c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:06:42.840827 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 739/1492] 10.222.0.49 () {58 vars in 1024 bytes} [Thu Sep 29 02:06:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:06:43.134177 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca727e7a-7318-4b95-a0ba-982c5b476075 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:06:43.135709 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-ca727e7a-7318-4b95-a0ba-982c5b476075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:06:43.239600 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca727e7a-7318-4b95-a0ba-982c5b476075 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:06:43.312814 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af76f226-7e40-4e9f-b960-c051071aa0cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:06:43.313443 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af76f226-7e40-4e9f-b960-c051071aa0cd service neutron] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:06:43.313718 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af76f226-7e40-4e9f-b960-c051071aa0cd service neutron] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:06:43.313984 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af76f226-7e40-4e9f-b960-c051071aa0cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:06:43.315790 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-af76f226-7e40-4e9f-b960-c051071aa0cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:06:43.324263 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:06:43.424156 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af76f226-7e40-4e9f-b960-c051071aa0cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:06:43.425742 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af76f226-7e40-4e9f-b960-c051071aa0cd service neutron] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:06:43.443680 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 754/1493] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:06:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:06:52.839362 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=82 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:06:53.441548 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=50 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:07:56.324603 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe19770f-3134-468d-8acb-c9115602f41d None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:07:56.325178 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe19770f-3134-468d-8acb-c9115602f41d None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:07:56.325178 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe19770f-3134-468d-8acb-c9115602f41d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:07:56.402942 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-fe19770f-3134-468d-8acb-c9115602f41d None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:07:56.404411 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-fe19770f-3134-468d-8acb-c9115602f41d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:07:56.497769 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 740/1494] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:07:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:07:56.506305 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f27f8-6a48-4447-8c02-55ba5d8dbd14 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:07:56.506827 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f27f8-6a48-4447-8c02-55ba5d8dbd14 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:07:56.506935 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f27f8-6a48-4447-8c02-55ba5d8dbd14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:07:56.583292 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-da1f27f8-6a48-4447-8c02-55ba5d8dbd14 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:07:56.584416 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-da1f27f8-6a48-4447-8c02-55ba5d8dbd14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:07:56.681133 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 755/1495] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:07:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:07:56.685950 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe19770f-3134-468d-8acb-c9115602f41d None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:07:56.687168 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-fe19770f-3134-468d-8acb-c9115602f41d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:07:56.698526 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe19770f-3134-468d-8acb-c9115602f41d None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:07:56.759030 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:07:56.793137 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21667423-3775-431b-b200-e42bd01a7b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:07:56.793768 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21667423-3775-431b-b200-e42bd01a7b98 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:07:56.794047 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21667423-3775-431b-b200-e42bd01a7b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:07:56.794318 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21667423-3775-431b-b200-e42bd01a7b98 admin admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:07:56.794959 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21667423-3775-431b-b200-e42bd01a7b98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:07:56.795259 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21667423-3775-431b-b200-e42bd01a7b98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:07:56.796260 dv-cinder-740146-21-smb devstack@keystone.service[81649]: WARNING py.warnings [None req-21667423-3775-431b-b200-e42bd01a7b98 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 29 02:07:56.796260 dv-cinder-740146-21-smb devstack@keystone.service[81649]: warnings.warn(msg) Sep 29 02:07:56.796260 dv-cinder-740146-21-smb devstack@keystone.service[81649]: Sep 29 02:07:56.797230 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21667423-3775-431b-b200-e42bd01a7b98 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:07:56.809504 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 741/1496] 10.222.0.49 () {58 vars in 1153 bytes} [Thu Sep 29 02:07:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:07:56.818174 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1f27f8-6a48-4447-8c02-55ba5d8dbd14 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:07:56.827229 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1f27f8-6a48-4447-8c02-55ba5d8dbd14 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:07:56.889735 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:07:56.924870 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9fb334-b371-4082-a6b6-7ccfe139ef92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:07:56.925505 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9fb334-b371-4082-a6b6-7ccfe139ef92 admin admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:07:56.925781 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9fb334-b371-4082-a6b6-7ccfe139ef92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:07:56.926049 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9fb334-b371-4082-a6b6-7ccfe139ef92 admin admin] PATH_INFO: `/v3/projects` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:07:56.926661 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9fb334-b371-4082-a6b6-7ccfe139ef92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:07:56.928365 dv-cinder-740146-21-smb devstack@keystone.service[81648]: WARNING py.warnings [None req-cf9fb334-b371-4082-a6b6-7ccfe139ef92 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 29 02:07:56.928365 dv-cinder-740146-21-smb devstack@keystone.service[81648]: warnings.warn(msg) Sep 29 02:07:56.928365 dv-cinder-740146-21-smb devstack@keystone.service[81648]: Sep 29 02:07:56.929576 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9fb334-b371-4082-a6b6-7ccfe139ef92 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:07:56.986299 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 756/1497] 10.222.0.49 () {60 vars in 1153 bytes} [Thu Sep 29 02:07:56 2022] POST /identity/v3/projects => generated 379 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:07:56.990412 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21667423-3775-431b-b200-e42bd01a7b98 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:07:56.991917 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-21667423-3775-431b-b200-e42bd01a7b98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:07:57.028980 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21667423-3775-431b-b200-e42bd01a7b98 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:07:57.124394 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591c294d-d941-4340-83c6-a624a62d87b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:07:57.125003 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c294d-d941-4340-83c6-a624a62d87b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:07:57.125281 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c294d-d941-4340-83c6-a624a62d87b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:07:57.125582 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c294d-d941-4340-83c6-a624a62d87b0 admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:07:57.126218 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591c294d-d941-4340-83c6-a624a62d87b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:07:57.127553 dv-cinder-740146-21-smb devstack@keystone.service[81649]: WARNING py.warnings [None req-591c294d-d941-4340-83c6-a624a62d87b0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 29 02:07:57.127553 dv-cinder-740146-21-smb devstack@keystone.service[81649]: warnings.warn(msg) Sep 29 02:07:57.127553 dv-cinder-740146-21-smb devstack@keystone.service[81649]: Sep 29 02:07:57.128764 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591c294d-d941-4340-83c6-a624a62d87b0 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:07:57.173561 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 742/1498] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 02:07:56 2022] POST /identity/v3/users => generated 290 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:07:57.177576 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9fb334-b371-4082-a6b6-7ccfe139ef92 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:07:57.179098 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-cf9fb334-b371-4082-a6b6-7ccfe139ef92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:07:57.240682 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9fb334-b371-4082-a6b6-7ccfe139ef92 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:07:57.323382 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:07:57.335941 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c34e6e-f017-4918-8cae-07ac9f97af4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:07:57.336552 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c34e6e-f017-4918-8cae-07ac9f97af4e admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:07:57.336860 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c34e6e-f017-4918-8cae-07ac9f97af4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:07:57.337125 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c34e6e-f017-4918-8cae-07ac9f97af4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:07:57.337802 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c34e6e-f017-4918-8cae-07ac9f97af4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:07:57.338811 dv-cinder-740146-21-smb devstack@keystone.service[81648]: WARNING py.warnings [None req-07c34e6e-f017-4918-8cae-07ac9f97af4e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 29 02:07:57.338811 dv-cinder-740146-21-smb devstack@keystone.service[81648]: warnings.warn(msg) Sep 29 02:07:57.338811 dv-cinder-740146-21-smb devstack@keystone.service[81648]: Sep 29 02:07:57.339684 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c34e6e-f017-4918-8cae-07ac9f97af4e admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:07:57.352221 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 757/1499] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:07:57 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:07:57.356329 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591c294d-d941-4340-83c6-a624a62d87b0 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:07:57.357929 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-591c294d-d941-4340-83c6-a624a62d87b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:07:57.369282 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591c294d-d941-4340-83c6-a624a62d87b0 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:07:57.394656 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:07:57.464931 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49f4139-70ab-47ea-9fde-8b6e0dd916cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:07:57.465489 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f4139-70ab-47ea-9fde-8b6e0dd916cc admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:07:57.465754 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f4139-70ab-47ea-9fde-8b6e0dd916cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:07:57.466020 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f4139-70ab-47ea-9fde-8b6e0dd916cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:07:57.466650 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49f4139-70ab-47ea-9fde-8b6e0dd916cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:07:57.467644 dv-cinder-740146-21-smb devstack@keystone.service[81649]: WARNING py.warnings [None req-a49f4139-70ab-47ea-9fde-8b6e0dd916cc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 29 02:07:57.467644 dv-cinder-740146-21-smb devstack@keystone.service[81649]: warnings.warn(msg) Sep 29 02:07:57.467644 dv-cinder-740146-21-smb devstack@keystone.service[81649]: Sep 29 02:07:57.468522 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49f4139-70ab-47ea-9fde-8b6e0dd916cc admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:07:57.480728 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 743/1500] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:07:57 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:07:57.485036 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c34e6e-f017-4918-8cae-07ac9f97af4e admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:07:57.486593 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-07c34e6e-f017-4918-8cae-07ac9f97af4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:07:57.520148 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c34e6e-f017-4918-8cae-07ac9f97af4e admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:07:57.613619 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e82a0e1-3b3e-4221-bf2e-f7d3147495ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:07:57.614277 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e82a0e1-3b3e-4221-bf2e-f7d3147495ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:07:57.614557 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e82a0e1-3b3e-4221-bf2e-f7d3147495ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:07:57.614828 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e82a0e1-3b3e-4221-bf2e-f7d3147495ad admin admin] PATH_INFO: `/v3/projects/cc1f73aaa6af4591bbec55494fcbd785/users/3040eb834daa4c348a8870fde546ca39/roles/f157f905c9c94ccfbfb46e52d443e8f2` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:07:57.637978 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e82a0e1-3b3e-4221-bf2e-f7d3147495ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc1f73aaa6af4591bbec55494fcbd785, user_id=3040eb834daa4c348a8870fde546ca39, role_id=f157f905c9c94ccfbfb46e52d443e8f2)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:07:57.639009 dv-cinder-740146-21-smb devstack@keystone.service[81648]: WARNING py.warnings [None req-8e82a0e1-3b3e-4221-bf2e-f7d3147495ad admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 29 02:07:57.639009 dv-cinder-740146-21-smb devstack@keystone.service[81648]: warnings.warn(msg) Sep 29 02:07:57.639009 dv-cinder-740146-21-smb devstack@keystone.service[81648]: Sep 29 02:07:57.640916 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e82a0e1-3b3e-4221-bf2e-f7d3147495ad admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:07:57.665113 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 758/1501] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:07:57 2022] PUT /identity/v3/projects/cc1f73aaa6af4591bbec55494fcbd785/users/3040eb834daa4c348a8870fde546ca39/roles/f157f905c9c94ccfbfb46e52d443e8f2 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:07:57.678227 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bfb781-f7fd-43fb-80db-67e1ce148987 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:07:57.678495 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bfb781-f7fd-43fb-80db-67e1ce148987 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:07:57.678764 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bfb781-f7fd-43fb-80db-67e1ce148987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:07:57.735956 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-05bfb781-f7fd-43fb-80db-67e1ce148987 None None] MFA Rules not processed for user `3040eb834daa4c348a8870fde546ca39`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:07:57.737172 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-05bfb781-f7fd-43fb-80db-67e1ce148987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:07:57.813447 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 744/1502] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:07:57 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:07:57.827059 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625fc28-2b1e-4ae8-ad02-10ce6ce862d4 None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:07:57.827345 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625fc28-2b1e-4ae8-ad02-10ce6ce862d4 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:07:57.827617 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625fc28-2b1e-4ae8-ad02-10ce6ce862d4 None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:07:57.828931 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 759/1503] 10.222.0.49 () {54 vars in 963 bytes} [Thu Sep 29 02:07:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:07:57.833785 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85e315f-dd7d-404c-a969-6ea993d1f170 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:07:57.834068 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85e315f-dd7d-404c-a969-6ea993d1f170 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:07:57.834338 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85e315f-dd7d-404c-a969-6ea993d1f170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:07:57.865882 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:07:57.911423 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-b85e315f-dd7d-404c-a969-6ea993d1f170 None None] MFA Rules not processed for user `e75135b856134ba4b9ccac337886f682`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:07:57.912637 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-b85e315f-dd7d-404c-a969-6ea993d1f170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:07:57.989290 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 745/1504] 10.222.0.49 () {58 vars in 1060 bytes} [Thu Sep 29 02:07:57 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:07:57.996936 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7625fc28-2b1e-4ae8-ad02-10ce6ce862d4 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:07:57.998465 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-7625fc28-2b1e-4ae8-ad02-10ce6ce862d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:07:58.048951 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:07:58.103558 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7625fc28-2b1e-4ae8-ad02-10ce6ce862d4 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:07:58.178914 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde8801f-6569-4384-8ada-6a1e9eea0f84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75135b856134ba4b9ccac337886f682', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:07:58.179517 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8801f-6569-4384-8ada-6a1e9eea0f84 service cinder] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:07:58.179794 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8801f-6569-4384-8ada-6a1e9eea0f84 service cinder] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:07:58.180061 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8801f-6569-4384-8ada-6a1e9eea0f84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:07:58.181682 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-cde8801f-6569-4384-8ada-6a1e9eea0f84 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:07:58.278977 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde8801f-6569-4384-8ada-6a1e9eea0f84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:07:58.280341 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde8801f-6569-4384-8ada-6a1e9eea0f84 service cinder] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:07:58.284700 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:07:58.300343 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 760/1505] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:07:57 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:07:58.345554 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd6a078-8116-4fed-850c-68b7dab22581 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:07:58.345963 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd6a078-8116-4fed-850c-68b7dab22581 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:07:58.346245 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd6a078-8116-4fed-850c-68b7dab22581 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:07:58.347488 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 746/1506] 10.222.0.49 () {52 vars in 830 bytes} [Thu Sep 29 02:07:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:07:58.351052 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde8801f-6569-4384-8ada-6a1e9eea0f84 service cinder] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:07:58.352301 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-cde8801f-6569-4384-8ada-6a1e9eea0f84 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:07:58.449230 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde8801f-6569-4384-8ada-6a1e9eea0f84 service cinder] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:07:58.540487 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0826da8-059b-47b7-82f6-fb3ead90d1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:07:58.541096 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0826da8-059b-47b7-82f6-fb3ead90d1d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:07:58.541297 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0826da8-059b-47b7-82f6-fb3ead90d1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:07:58.541591 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0826da8-059b-47b7-82f6-fb3ead90d1d1 admin admin] PATH_INFO: `/v3/users/3040eb834daa4c348a8870fde546ca39` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:07:58.554076 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0826da8-059b-47b7-82f6-fb3ead90d1d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3040eb834daa4c348a8870fde546ca39)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:07:58.555091 dv-cinder-740146-21-smb devstack@keystone.service[81648]: WARNING py.warnings [None req-b0826da8-059b-47b7-82f6-fb3ead90d1d1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 29 02:07:58.555091 dv-cinder-740146-21-smb devstack@keystone.service[81648]: warnings.warn(msg) Sep 29 02:07:58.555091 dv-cinder-740146-21-smb devstack@keystone.service[81648]: Sep 29 02:07:58.556277 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0826da8-059b-47b7-82f6-fb3ead90d1d1 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:07:58.566583 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:07:58.622868 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-b0826da8-059b-47b7-82f6-fb3ead90d1d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3040eb834daa4c348a8870fde546ca39'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:07:58.623304 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-b0826da8-059b-47b7-82f6-fb3ead90d1d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3040eb834daa4c348a8870fde546ca39'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:07:58.648323 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-b0826da8-059b-47b7-82f6-fb3ead90d1d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3040eb834daa4c348a8870fde546ca39'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:07:58.658597 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-b0826da8-059b-47b7-82f6-fb3ead90d1d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3040eb834daa4c348a8870fde546ca39'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:07:58.659140 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-b0826da8-059b-47b7-82f6-fb3ead90d1d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3040eb834daa4c348a8870fde546ca39'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:07:58.678722 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 761/1507] 10.222.0.49 () {58 vars in 1224 bytes} [Thu Sep 29 02:07:58 2022] DELETE /identity/v3/users/3040eb834daa4c348a8870fde546ca39 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:07:58.683016 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af264ff5-e19d-46ed-86df-1af6363071ca None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:07:58.683491 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af264ff5-e19d-46ed-86df-1af6363071ca None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:07:58.683608 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af264ff5-e19d-46ed-86df-1af6363071ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:07:58.741189 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-af264ff5-e19d-46ed-86df-1af6363071ca None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:07:58.742438 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-af264ff5-e19d-46ed-86df-1af6363071ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:07:58.819022 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:07:58.832679 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 747/1508] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:07:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:07:58.842300 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0826da8-059b-47b7-82f6-fb3ead90d1d1 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:07:58.843532 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-b0826da8-059b-47b7-82f6-fb3ead90d1d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:07:58.945053 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0826da8-059b-47b7-82f6-fb3ead90d1d1 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:07:58.998289 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:07:59.019632 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8868bd4-ba9e-42fc-bee2-1c8edabd1c38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:07:59.020236 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8868bd4-ba9e-42fc-bee2-1c8edabd1c38 service neutron] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:07:59.020510 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8868bd4-ba9e-42fc-bee2-1c8edabd1c38 service neutron] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:07:59.020786 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8868bd4-ba9e-42fc-bee2-1c8edabd1c38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:07:59.022390 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-d8868bd4-ba9e-42fc-bee2-1c8edabd1c38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:07:59.130530 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8868bd4-ba9e-42fc-bee2-1c8edabd1c38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:07:59.131875 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8868bd4-ba9e-42fc-bee2-1c8edabd1c38 service neutron] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:07:59.150314 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 762/1509] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:07:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 29 02:07:59.497328 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af264ff5-e19d-46ed-86df-1af6363071ca None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:07:59.498595 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-af264ff5-e19d-46ed-86df-1af6363071ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:07:59.510038 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af264ff5-e19d-46ed-86df-1af6363071ca None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:07:59.607438 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c76d52-e8cb-40ed-a7b5-be4d9f37f391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:07:59.608074 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c76d52-e8cb-40ed-a7b5-be4d9f37f391 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:07:59.608352 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c76d52-e8cb-40ed-a7b5-be4d9f37f391 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:07:59.608621 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c76d52-e8cb-40ed-a7b5-be4d9f37f391 admin admin] PATH_INFO: `/v3/projects/cc1f73aaa6af4591bbec55494fcbd785` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:07:59.620015 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c76d52-e8cb-40ed-a7b5-be4d9f37f391 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc1f73aaa6af4591bbec55494fcbd785)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:07:59.621035 dv-cinder-740146-21-smb devstack@keystone.service[81649]: WARNING py.warnings [None req-35c76d52-e8cb-40ed-a7b5-be4d9f37f391 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 29 02:07:59.621035 dv-cinder-740146-21-smb devstack@keystone.service[81649]: warnings.warn(msg) Sep 29 02:07:59.621035 dv-cinder-740146-21-smb devstack@keystone.service[81649]: Sep 29 02:07:59.622267 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c76d52-e8cb-40ed-a7b5-be4d9f37f391 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:07:59.680475 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-35c76d52-e8cb-40ed-a7b5-be4d9f37f391 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc1f73aaa6af4591bbec55494fcbd785', 'request_id': 'req-35c76d52-e8cb-40ed-a7b5-be4d9f37f391'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:07:59.693858 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-35c76d52-e8cb-40ed-a7b5-be4d9f37f391 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc1f73aaa6af4591bbec55494fcbd785', 'request_id': 'req-35c76d52-e8cb-40ed-a7b5-be4d9f37f391'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:07:59.703550 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-35c76d52-e8cb-40ed-a7b5-be4d9f37f391 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc1f73aaa6af4591bbec55494fcbd785', 'request_id': 'req-35c76d52-e8cb-40ed-a7b5-be4d9f37f391'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:07:59.726738 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-35c76d52-e8cb-40ed-a7b5-be4d9f37f391 admin admin] The token cache is being invalidate because project cc1f73aaa6af4591bbec55494fcbd785 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81649) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:07:59.727028 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-35c76d52-e8cb-40ed-a7b5-be4d9f37f391 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:07:59.727539 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-35c76d52-e8cb-40ed-a7b5-be4d9f37f391 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:07:59.728847 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 748/1510] 10.222.0.49 () {58 vars in 1233 bytes} [Thu Sep 29 02:07:59 2022] DELETE /identity/v3/projects/cc1f73aaa6af4591bbec55494fcbd785 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:08:09.148068 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=62 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:08:09.724723 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:09:31.575387 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c15a6fc-8998-4d07-8d5c-d1e3d15c9513 None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:09:31.575995 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c15a6fc-8998-4d07-8d5c-d1e3d15c9513 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:09:31.575995 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c15a6fc-8998-4d07-8d5c-d1e3d15c9513 None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:09:31.577544 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 763/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 29 02:09:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:09:31.582519 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed645d2-833f-4e48-8b9d-497317d85507 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:09:31.582988 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed645d2-833f-4e48-8b9d-497317d85507 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:09:31.583100 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed645d2-833f-4e48-8b9d-497317d85507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:09:31.664572 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-8ed645d2-833f-4e48-8b9d-497317d85507 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:09:31.665826 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-8ed645d2-833f-4e48-8b9d-497317d85507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:09:31.771895 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 749/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 29 02:09:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:09:31.927461 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c15a6fc-8998-4d07-8d5c-d1e3d15c9513 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:09:31.929552 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-8c15a6fc-8998-4d07-8d5c-d1e3d15c9513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:09:32.052076 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c15a6fc-8998-4d07-8d5c-d1e3d15c9513 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:09:32.057537 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3ad7e4-7ad1-4ddd-9f80-5d31fe319efa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3325a7111d447f4a9cf00c672d5420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:09:32.058143 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ad7e4-7ad1-4ddd-9f80-5d31fe319efa service nova] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:09:32.058423 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ad7e4-7ad1-4ddd-9f80-5d31fe319efa service nova] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:09:32.058695 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ad7e4-7ad1-4ddd-9f80-5d31fe319efa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:09:32.067018 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3ad7e4-7ad1-4ddd-9f80-5d31fe319efa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:09:32.068608 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3ad7e4-7ad1-4ddd-9f80-5d31fe319efa service nova] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:09:32.078876 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 764/1513] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:09:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:09:33.171717 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc959c-d9bc-4f60-a160-cee18738afa1 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:09:33.172228 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc959c-d9bc-4f60-a160-cee18738afa1 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:09:33.172228 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc959c-d9bc-4f60-a160-cee18738afa1 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:09:33.173644 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 750/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 29 02:09:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:09:33.179873 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c2940-3026-4bab-b854-80645221facf None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:09:33.180263 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c2940-3026-4bab-b854-80645221facf None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:09:33.180420 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c2940-3026-4bab-b854-80645221facf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:09:33.200063 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-781c2940-3026-4bab-b854-80645221facf None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:09:33.201277 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-781c2940-3026-4bab-b854-80645221facf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:09:33.209958 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 765/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 29 02:09:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:09:33.361844 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbc959c-d9bc-4f60-a160-cee18738afa1 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:09:33.376470 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbc959c-d9bc-4f60-a160-cee18738afa1 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:09:33.381823 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069f5d4c-6903-4626-8c31-026e7bd95782 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3325a7111d447f4a9cf00c672d5420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:09:33.382405 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069f5d4c-6903-4626-8c31-026e7bd95782 service nova] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:09:33.382679 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069f5d4c-6903-4626-8c31-026e7bd95782 service nova] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:09:33.382942 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069f5d4c-6903-4626-8c31-026e7bd95782 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:09:33.391586 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069f5d4c-6903-4626-8c31-026e7bd95782 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:09:33.393143 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069f5d4c-6903-4626-8c31-026e7bd95782 service nova] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:09:33.402338 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 751/1516] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:09:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:09:34.314802 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9636cfd-0eb0-444d-88d1-afa1d05beee2 None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:09:34.315356 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9636cfd-0eb0-444d-88d1-afa1d05beee2 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:09:34.315356 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9636cfd-0eb0-444d-88d1-afa1d05beee2 None None] PATH_INFO: `/v3` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:09:34.316586 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 766/1517] 10.222.0.16 () {54 vars in 925 bytes} [Thu Sep 29 02:09:34 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:09:34.323215 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ba977-4120-42db-a2a1-af523dcd6d1e None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:09:34.323619 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ba977-4120-42db-a2a1-af523dcd6d1e None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:09:34.323747 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ba977-4120-42db-a2a1-af523dcd6d1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:09:34.382748 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-147ba977-4120-42db-a2a1-af523dcd6d1e None None] MFA Rules not processed for user `3cbb39731a6b42e2a6647d6134b5c7cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:09:34.383942 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-147ba977-4120-42db-a2a1-af523dcd6d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:09:34.400747 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:09:34.454643 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 752/1518] 10.222.0.16 () {58 vars in 1015 bytes} [Thu Sep 29 02:09:34 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:09:38.134352 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b6011-2802-4ff0-93f8-21d0613d735d None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:09:38.134823 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b6011-2802-4ff0-93f8-21d0613d735d None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:09:38.134932 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b6011-2802-4ff0-93f8-21d0613d735d None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:09:38.136242 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 767/1519] 10.222.0.49 () {54 vars in 961 bytes} [Thu Sep 29 02:09:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:09:38.141707 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad73cf-106c-471d-9808-36f7646b9123 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:09:38.142129 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad73cf-106c-471d-9808-36f7646b9123 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:09:38.142243 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad73cf-106c-471d-9808-36f7646b9123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:09:38.162337 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-15ad73cf-106c-471d-9808-36f7646b9123 None None] MFA Rules not processed for user `3cbb39731a6b42e2a6647d6134b5c7cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:09:38.163455 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-15ad73cf-106c-471d-9808-36f7646b9123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:09:38.171993 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 753/1520] 10.222.0.49 () {58 vars in 1058 bytes} [Thu Sep 29 02:09:38 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:09:38.179390 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605b6011-2802-4ff0-93f8-21d0613d735d None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:09:38.193222 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605b6011-2802-4ff0-93f8-21d0613d735d None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:09:38.198123 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd87e03-3736-4cc0-964e-810108b6a01e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cbb39731a6b42e2a6647d6134b5c7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:09:38.198708 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd87e03-3736-4cc0-964e-810108b6a01e service placement] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:09:38.198986 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd87e03-3736-4cc0-964e-810108b6a01e service placement] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:09:38.199257 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd87e03-3736-4cc0-964e-810108b6a01e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:09:38.207859 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd87e03-3736-4cc0-964e-810108b6a01e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:09:38.209504 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd87e03-3736-4cc0-964e-810108b6a01e service placement] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:09:38.219680 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 768/1521] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:09:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 29 02:09:44.868794 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4461cad-2a45-4b19-9c59-4184d8ff9445 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:09:44.869369 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4461cad-2a45-4b19-9c59-4184d8ff9445 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:09:44.869369 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4461cad-2a45-4b19-9c59-4184d8ff9445 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:09:44.870701 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 754/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 29 02:09:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:09:44.877601 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c63fc46-3177-4905-a301-9c49e8057586 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:09:44.878030 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c63fc46-3177-4905-a301-9c49e8057586 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:09:44.878141 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c63fc46-3177-4905-a301-9c49e8057586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:09:44.897586 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-6c63fc46-3177-4905-a301-9c49e8057586 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:09:44.898812 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-6c63fc46-3177-4905-a301-9c49e8057586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:09:44.907395 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 769/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 29 02:09:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:09:45.060862 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4461cad-2a45-4b19-9c59-4184d8ff9445 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:09:45.075994 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4461cad-2a45-4b19-9c59-4184d8ff9445 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:09:45.081595 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd15091-52f4-465a-86dc-f8357176cce1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3325a7111d447f4a9cf00c672d5420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:09:45.082185 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd15091-52f4-465a-86dc-f8357176cce1 service nova] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:09:45.082462 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd15091-52f4-465a-86dc-f8357176cce1 service nova] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:09:45.082733 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd15091-52f4-465a-86dc-f8357176cce1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:09:45.090680 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd15091-52f4-465a-86dc-f8357176cce1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:09:45.092244 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd15091-52f4-465a-86dc-f8357176cce1 service nova] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:09:45.101778 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 755/1524] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:09:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:09:46.158076 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de4280e-ded1-42bf-afe0-f87f5e1524c3 None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:09:46.158609 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de4280e-ded1-42bf-afe0-f87f5e1524c3 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:09:46.158609 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de4280e-ded1-42bf-afe0-f87f5e1524c3 None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:09:46.159884 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 770/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 29 02:09:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 29 02:09:46.166084 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f2c0b-0b1e-422b-a809-1e7fc1e786f0 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:09:46.166508 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f2c0b-0b1e-422b-a809-1e7fc1e786f0 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:09:46.166604 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f2c0b-0b1e-422b-a809-1e7fc1e786f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:09:46.186030 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-437f2c0b-0b1e-422b-a809-1e7fc1e786f0 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:09:46.187306 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-437f2c0b-0b1e-422b-a809-1e7fc1e786f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:09:46.195018 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 756/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 29 02:09:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:09:46.346828 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de4280e-ded1-42bf-afe0-f87f5e1524c3 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:09:46.361381 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de4280e-ded1-42bf-afe0-f87f5e1524c3 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:09:46.366842 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4282b18e-3f62-48fe-bc4d-802a661a6853 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3325a7111d447f4a9cf00c672d5420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:09:46.367428 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4282b18e-3f62-48fe-bc4d-802a661a6853 service nova] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:09:46.367708 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4282b18e-3f62-48fe-bc4d-802a661a6853 service nova] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:09:46.367979 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4282b18e-3f62-48fe-bc4d-802a661a6853 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:09:46.375966 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4282b18e-3f62-48fe-bc4d-802a661a6853 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:09:46.377565 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4282b18e-3f62-48fe-bc4d-802a661a6853 service nova] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:09:46.386671 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 771/1527] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:09:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:09:50.450815 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b46cf6-c518-463a-811e-f3c0def2ec71 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:09:50.451436 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b46cf6-c518-463a-811e-f3c0def2ec71 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:09:50.451436 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b46cf6-c518-463a-811e-f3c0def2ec71 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:09:50.452913 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 757/1528] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 29 02:09:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:09:50.458190 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7879da20-7b44-44f5-a8f2-c8a8f3a5ba01 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:09:50.458625 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7879da20-7b44-44f5-a8f2-c8a8f3a5ba01 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:09:50.458808 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7879da20-7b44-44f5-a8f2-c8a8f3a5ba01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:09:50.479216 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-7879da20-7b44-44f5-a8f2-c8a8f3a5ba01 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:09:50.480403 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-7879da20-7b44-44f5-a8f2-c8a8f3a5ba01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:09:50.488762 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 772/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 29 02:09:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:09:50.774440 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b46cf6-c518-463a-811e-f3c0def2ec71 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:09:50.776142 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-c8b46cf6-c518-463a-811e-f3c0def2ec71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:09:50.854199 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b46cf6-c518-463a-811e-f3c0def2ec71 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:09:50.857884 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693bc7f5-af96-4a4e-832c-c593ec148e72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:09:50.858708 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693bc7f5-af96-4a4e-832c-c593ec148e72 service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:09:50.858997 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693bc7f5-af96-4a4e-832c-c593ec148e72 service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:09:50.859288 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693bc7f5-af96-4a4e-832c-c593ec148e72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:09:50.868221 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693bc7f5-af96-4a4e-832c-c593ec148e72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:09:50.869680 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693bc7f5-af96-4a4e-832c-c593ec148e72 service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:09:50.878969 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 758/1530] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:09:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:09:53.036340 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9726c8ff-057e-42b7-baad-553b9c87cdd6 None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:09:53.036864 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9726c8ff-057e-42b7-baad-553b9c87cdd6 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:09:53.036864 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9726c8ff-057e-42b7-baad-553b9c87cdd6 None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:09:53.038203 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 773/1531] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 29 02:09:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:09:53.043414 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fa1c3d-c636-4b6d-806c-7c43c41202e6 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:09:53.043837 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fa1c3d-c636-4b6d-806c-7c43c41202e6 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:09:53.043966 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fa1c3d-c636-4b6d-806c-7c43c41202e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:09:53.064239 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-d1fa1c3d-c636-4b6d-806c-7c43c41202e6 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:09:53.065477 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-d1fa1c3d-c636-4b6d-806c-7c43c41202e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:09:53.073193 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 759/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 29 02:09:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:09:53.362518 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9726c8ff-057e-42b7-baad-553b9c87cdd6 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:09:53.373074 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9726c8ff-057e-42b7-baad-553b9c87cdd6 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:09:53.376768 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19495a1-d486-43b3-9abd-aab00b53cfc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:09:53.377387 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19495a1-d486-43b3-9abd-aab00b53cfc2 service neutron] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:09:53.377664 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19495a1-d486-43b3-9abd-aab00b53cfc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:09:53.377935 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19495a1-d486-43b3-9abd-aab00b53cfc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:09:53.386537 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19495a1-d486-43b3-9abd-aab00b53cfc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:09:53.387955 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19495a1-d486-43b3-9abd-aab00b53cfc2 service neutron] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:09:53.397106 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 774/1533] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:09:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:09:57.411999 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a780e459-9fc3-4271-a4e2-c8d362c2062b None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:09:57.412565 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a780e459-9fc3-4271-a4e2-c8d362c2062b None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:09:57.412565 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a780e459-9fc3-4271-a4e2-c8d362c2062b None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:09:57.413916 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 760/1534] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 29 02:09:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:09:57.419036 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599daaff-4d96-4c5f-bf15-67be714a6001 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:09:57.419477 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599daaff-4d96-4c5f-bf15-67be714a6001 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:09:57.419585 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599daaff-4d96-4c5f-bf15-67be714a6001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:09:57.439914 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-599daaff-4d96-4c5f-bf15-67be714a6001 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:09:57.441109 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-599daaff-4d96-4c5f-bf15-67be714a6001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:09:57.448696 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 775/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 29 02:09:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:09:57.749941 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a780e459-9fc3-4271-a4e2-c8d362c2062b None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:09:57.751824 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-a780e459-9fc3-4271-a4e2-c8d362c2062b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:09:57.815712 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:09:57.829146 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a780e459-9fc3-4271-a4e2-c8d362c2062b None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:09:57.832718 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba19c73-2b2a-4448-8a77-98b12bda7018 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75135b856134ba4b9ccac337886f682', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:09:57.833294 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba19c73-2b2a-4448-8a77-98b12bda7018 service cinder] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:09:57.833594 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba19c73-2b2a-4448-8a77-98b12bda7018 service cinder] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:09:57.833863 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba19c73-2b2a-4448-8a77-98b12bda7018 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:09:57.842669 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba19c73-2b2a-4448-8a77-98b12bda7018 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:09:57.844594 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba19c73-2b2a-4448-8a77-98b12bda7018 service cinder] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:09:57.854111 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 761/1536] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:09:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:10:00.003977 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a0810-58f9-460f-832f-e27aa9d41da8 None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:10:00.004565 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a0810-58f9-460f-832f-e27aa9d41da8 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:10:00.004565 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a0810-58f9-460f-832f-e27aa9d41da8 None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:10:00.005890 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 776/1537] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 29 02:10:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:10:00.011180 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fab110b-b3bd-4f5b-bef7-d3f9856c759c None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:10:00.011621 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fab110b-b3bd-4f5b-bef7-d3f9856c759c None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:10:00.011730 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fab110b-b3bd-4f5b-bef7-d3f9856c759c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:10:00.031311 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-1fab110b-b3bd-4f5b-bef7-d3f9856c759c None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:10:00.032997 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-1fab110b-b3bd-4f5b-bef7-d3f9856c759c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:10:00.040764 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 762/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 29 02:10:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:10:00.340321 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558a0810-58f9-460f-832f-e27aa9d41da8 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:10:00.342029 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-558a0810-58f9-460f-832f-e27aa9d41da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:10:00.350554 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=84 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:10:00.357055 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558a0810-58f9-460f-832f-e27aa9d41da8 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:10:00.360833 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7f85d5-aa51-46f5-8e11-0c1e2d539a4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75135b856134ba4b9ccac337886f682', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:10:00.361549 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f85d5-aa51-46f5-8e11-0c1e2d539a4f service cinder] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:10:00.361833 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f85d5-aa51-46f5-8e11-0c1e2d539a4f service cinder] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:10:00.362104 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f85d5-aa51-46f5-8e11-0c1e2d539a4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:10:00.370810 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7f85d5-aa51-46f5-8e11-0c1e2d539a4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:10:00.372260 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7f85d5-aa51-46f5-8e11-0c1e2d539a4f service cinder] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:10:00.381807 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 777/1539] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:10:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:10:10.025796 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=11 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:10:10.377740 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=5 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:11:35.567129 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d7ebb-bfca-4f29-9b00-c8eeb2f94f46 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:35.567830 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d7ebb-bfca-4f29-9b00-c8eeb2f94f46 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:35.567830 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d7ebb-bfca-4f29-9b00-c8eeb2f94f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:35.592792 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-b46d7ebb-bfca-4f29-9b00-c8eeb2f94f46 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:35.593906 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b847ca-33c8-4589-b0d4-3d2f5bc0ef0d None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:35.594409 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-b46d7ebb-bfca-4f29-9b00-c8eeb2f94f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:35.594914 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b847ca-33c8-4589-b0d4-3d2f5bc0ef0d None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:35.595415 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b847ca-33c8-4589-b0d4-3d2f5bc0ef0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:35.612511 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 763/1540] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:11:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:35.614232 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220399d2-bdd4-4439-a03c-b77601f760d1 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:35.614232 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220399d2-bdd4-4439-a03c-b77601f760d1 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:35.614448 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220399d2-bdd4-4439-a03c-b77601f760d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:35.620344 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-e6b847ca-33c8-4589-b0d4-3d2f5bc0ef0d None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:35.621954 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-e6b847ca-33c8-4589-b0d4-3d2f5bc0ef0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:35.641573 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 778/1541] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:11:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:35.642753 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7020baec-93ca-4960-91ed-b4ce0e0fcc83 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:35.643090 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7020baec-93ca-4960-91ed-b4ce0e0fcc83 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:35.643362 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7020baec-93ca-4960-91ed-b4ce0e0fcc83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:35.654408 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-220399d2-bdd4-4439-a03c-b77601f760d1 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:35.655637 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-220399d2-bdd4-4439-a03c-b77601f760d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:35.678575 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 764/1542] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:11:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:35.679843 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c0755-b7ff-4a8c-81d3-997626a95d8c None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:35.680128 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c0755-b7ff-4a8c-81d3-997626a95d8c None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:35.680615 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c0755-b7ff-4a8c-81d3-997626a95d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:35.683123 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-7020baec-93ca-4960-91ed-b4ce0e0fcc83 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:35.684437 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-7020baec-93ca-4960-91ed-b4ce0e0fcc83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:35.706538 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 779/1543] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:11:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:35.707651 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8474f76-a4e0-435f-b8e3-078b58d03014 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:35.707941 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8474f76-a4e0-435f-b8e3-078b58d03014 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:35.708212 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8474f76-a4e0-435f-b8e3-078b58d03014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:35.719153 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-679c0755-b7ff-4a8c-81d3-997626a95d8c None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:35.720382 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-679c0755-b7ff-4a8c-81d3-997626a95d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:35.742970 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 765/1544] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:11:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:35.744140 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03049c10-062b-47b3-beca-6687c8853a4e None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:35.744420 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03049c10-062b-47b3-beca-6687c8853a4e None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:35.744699 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03049c10-062b-47b3-beca-6687c8853a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:35.749446 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-f8474f76-a4e0-435f-b8e3-078b58d03014 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:35.750673 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-f8474f76-a4e0-435f-b8e3-078b58d03014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:35.762903 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 780/1545] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:11:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:35.764109 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8474f76-a4e0-435f-b8e3-078b58d03014 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:35.772370 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-03049c10-062b-47b3-beca-6687c8853a4e None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:35.773619 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-03049c10-062b-47b3-beca-6687c8853a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:35.774224 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8474f76-a4e0-435f-b8e3-078b58d03014 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:35.780027 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a482a117-78dd-474f-86f6-f7e92eb85ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:35.780663 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482a117-78dd-474f-86f6-f7e92eb85ff7 admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:35.780942 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482a117-78dd-474f-86f6-f7e92eb85ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:35.781212 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482a117-78dd-474f-86f6-f7e92eb85ff7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:35.781890 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a482a117-78dd-474f-86f6-f7e92eb85ff7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:11:35.782191 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a482a117-78dd-474f-86f6-f7e92eb85ff7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:35.782948 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 766/1546] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:11:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:35.785352 dv-cinder-740146-21-smb devstack@keystone.service[81648]: WARNING py.warnings [None req-a482a117-78dd-474f-86f6-f7e92eb85ff7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 29 02:11:35.785352 dv-cinder-740146-21-smb devstack@keystone.service[81648]: warnings.warn(msg) Sep 29 02:11:35.785352 dv-cinder-740146-21-smb devstack@keystone.service[81648]: Sep 29 02:11:35.785623 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c18354e-ac49-44a7-ad42-07742860e0c5 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:35.785623 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c18354e-ac49-44a7-ad42-07742860e0c5 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:35.785777 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a482a117-78dd-474f-86f6-f7e92eb85ff7 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:35.785851 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c18354e-ac49-44a7-ad42-07742860e0c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:35.797537 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 781/1547] 10.222.0.49 () {58 vars in 1153 bytes} [Thu Sep 29 02:11:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:11:35.798785 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668003a0-777a-48a4-8268-3a7c5d64601d None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:35.799076 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668003a0-777a-48a4-8268-3a7c5d64601d None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:35.799352 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668003a0-777a-48a4-8268-3a7c5d64601d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:35.804272 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-6c18354e-ac49-44a7-ad42-07742860e0c5 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:35.805762 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-6c18354e-ac49-44a7-ad42-07742860e0c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:35.814249 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 767/1548] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:11:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:35.815453 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c4ae3-4d59-4b9f-97d5-4296f1e78207 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:35.815732 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c4ae3-4d59-4b9f-97d5-4296f1e78207 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:35.816002 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c4ae3-4d59-4b9f-97d5-4296f1e78207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:35.818953 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-668003a0-777a-48a4-8268-3a7c5d64601d None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:35.820251 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-668003a0-777a-48a4-8268-3a7c5d64601d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:35.829354 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 782/1549] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:11:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:35.833724 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840fa384-f62a-43f6-90cb-43028042d6c7 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:35.834013 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840fa384-f62a-43f6-90cb-43028042d6c7 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:35.834283 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840fa384-f62a-43f6-90cb-43028042d6c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:35.835645 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-4a7c4ae3-4d59-4b9f-97d5-4296f1e78207 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:35.836878 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-4a7c4ae3-4d59-4b9f-97d5-4296f1e78207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:35.845771 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 768/1550] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:11:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:35.846968 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff9d561-59b7-443d-8262-bdf6a175df53 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:35.847249 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff9d561-59b7-443d-8262-bdf6a175df53 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:35.847535 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff9d561-59b7-443d-8262-bdf6a175df53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:35.854801 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-840fa384-f62a-43f6-90cb-43028042d6c7 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:35.856280 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-840fa384-f62a-43f6-90cb-43028042d6c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:35.865358 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 783/1551] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:11:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:35.866138 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840fa384-f62a-43f6-90cb-43028042d6c7 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:35.869682 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-1ff9d561-59b7-443d-8262-bdf6a175df53 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:35.871393 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-1ff9d561-59b7-443d-8262-bdf6a175df53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:35.876713 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840fa384-f62a-43f6-90cb-43028042d6c7 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:35.879731 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 769/1552] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:11:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:35.880517 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff9d561-59b7-443d-8262-bdf6a175df53 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:35.881265 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12323e0d-5eb7-495e-9166-91b30384a633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:35.881902 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12323e0d-5eb7-495e-9166-91b30384a633 admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:35.882176 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12323e0d-5eb7-495e-9166-91b30384a633 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:35.882446 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12323e0d-5eb7-495e-9166-91b30384a633 admin admin] PATH_INFO: `/v3/domains` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:35.883080 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12323e0d-5eb7-495e-9166-91b30384a633 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:11:35.883379 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12323e0d-5eb7-495e-9166-91b30384a633 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:35.884964 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12323e0d-5eb7-495e-9166-91b30384a633 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:35.891607 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff9d561-59b7-443d-8262-bdf6a175df53 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:35.896240 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ef66f5-8544-4632-9ba2-26519bda59e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:35.896834 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ef66f5-8544-4632-9ba2-26519bda59e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:35.897111 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ef66f5-8544-4632-9ba2-26519bda59e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:35.897409 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ef66f5-8544-4632-9ba2-26519bda59e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:35.897554 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 784/1553] 10.222.0.49 () {58 vars in 1153 bytes} [Thu Sep 29 02:11:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:11:35.898057 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ef66f5-8544-4632-9ba2-26519bda59e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:11:35.898241 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12323e0d-5eb7-495e-9166-91b30384a633 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:35.898359 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ef66f5-8544-4632-9ba2-26519bda59e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:35.899972 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ef66f5-8544-4632-9ba2-26519bda59e5 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:35.913603 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 770/1554] 10.222.0.49 () {58 vars in 1153 bytes} [Thu Sep 29 02:11:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:11:35.915173 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00137c6d-f8d2-49ce-b789-82735293cb7f None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:35.915640 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00137c6d-f8d2-49ce-b789-82735293cb7f None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:35.916078 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00137c6d-f8d2-49ce-b789-82735293cb7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:35.918443 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12323e0d-5eb7-495e-9166-91b30384a633 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:35.923101 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c014c7-cd07-47df-82b4-bb3efe703d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:35.923707 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c014c7-cd07-47df-82b4-bb3efe703d04 admin admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:35.923997 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c014c7-cd07-47df-82b4-bb3efe703d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:35.924273 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c014c7-cd07-47df-82b4-bb3efe703d04 admin admin] PATH_INFO: `/v3/projects` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:35.924908 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c014c7-cd07-47df-82b4-bb3efe703d04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:35.926880 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c014c7-cd07-47df-82b4-bb3efe703d04 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:35.936643 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-00137c6d-f8d2-49ce-b789-82735293cb7f None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:35.937908 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-00137c6d-f8d2-49ce-b789-82735293cb7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:35.946025 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 771/1555] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:11:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:35.951043 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d763e-baf9-483a-9bbe-231ba8a5256f None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:35.951330 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d763e-baf9-483a-9bbe-231ba8a5256f None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:35.951743 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d763e-baf9-483a-9bbe-231ba8a5256f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:35.972196 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 785/1556] 10.222.0.49 () {60 vars in 1153 bytes} [Thu Sep 29 02:11:35 2022] POST /identity/v3/projects => generated 371 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:11:35.972196 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c014c7-cd07-47df-82b4-bb3efe703d04 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:35.972510 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-404d763e-baf9-483a-9bbe-231ba8a5256f None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:35.973112 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-404d763e-baf9-483a-9bbe-231ba8a5256f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:36.032051 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c014c7-cd07-47df-82b4-bb3efe703d04 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:36.034172 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 772/1557] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:11:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:36.035387 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bee1f0-2c4d-4b37-9ea7-4f0e4faf631a None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:36.035870 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bee1f0-2c4d-4b37-9ea7-4f0e4faf631a None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:36.036045 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bee1f0-2c4d-4b37-9ea7-4f0e4faf631a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:36.038065 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388967e2-88c4-42b9-b0d2-7c9b7db66fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:36.038767 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388967e2-88c4-42b9-b0d2-7c9b7db66fbd admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:36.039031 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388967e2-88c4-42b9-b0d2-7c9b7db66fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:36.039293 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388967e2-88c4-42b9-b0d2-7c9b7db66fbd admin admin] PATH_INFO: `/v3/domains` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:36.039920 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388967e2-88c4-42b9-b0d2-7c9b7db66fbd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:11:36.040222 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388967e2-88c4-42b9-b0d2-7c9b7db66fbd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:36.041902 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388967e2-88c4-42b9-b0d2-7c9b7db66fbd admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:36.054717 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 786/1558] 10.222.0.49 () {58 vars in 1153 bytes} [Thu Sep 29 02:11:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:11:36.055759 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-58bee1f0-2c4d-4b37-9ea7-4f0e4faf631a None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:36.055986 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd89484-d1a3-4a4b-b29a-b1e852d7452a None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:36.056289 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd89484-d1a3-4a4b-b29a-b1e852d7452a None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:36.056551 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd89484-d1a3-4a4b-b29a-b1e852d7452a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:36.056908 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-58bee1f0-2c4d-4b37-9ea7-4f0e4faf631a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:36.066052 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 773/1559] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:11:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:36.066883 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bee1f0-2c4d-4b37-9ea7-4f0e4faf631a None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:36.076652 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bee1f0-2c4d-4b37-9ea7-4f0e4faf631a None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:36.076816 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-acd89484-d1a3-4a4b-b29a-b1e852d7452a None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:36.077960 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-acd89484-d1a3-4a4b-b29a-b1e852d7452a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:36.082665 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c916f49-0ad7-4748-afbb-6ae725694bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:36.083263 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c916f49-0ad7-4748-afbb-6ae725694bb0 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:36.083544 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c916f49-0ad7-4748-afbb-6ae725694bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:36.083817 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c916f49-0ad7-4748-afbb-6ae725694bb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:36.084449 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c916f49-0ad7-4748-afbb-6ae725694bb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:36.085499 dv-cinder-740146-21-smb devstack@keystone.service[81649]: WARNING py.warnings [None req-2c916f49-0ad7-4748-afbb-6ae725694bb0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 29 02:11:36.085499 dv-cinder-740146-21-smb devstack@keystone.service[81649]: warnings.warn(msg) Sep 29 02:11:36.085499 dv-cinder-740146-21-smb devstack@keystone.service[81649]: Sep 29 02:11:36.086693 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c916f49-0ad7-4748-afbb-6ae725694bb0 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:36.087274 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 787/1560] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:11:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:36.087879 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd89484-d1a3-4a4b-b29a-b1e852d7452a None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:36.098226 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd89484-d1a3-4a4b-b29a-b1e852d7452a None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:36.104192 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ca4a67-a9be-4990-8a34-53211e61314d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:36.105352 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ca4a67-a9be-4990-8a34-53211e61314d admin admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:36.105752 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ca4a67-a9be-4990-8a34-53211e61314d admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:36.106067 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ca4a67-a9be-4990-8a34-53211e61314d admin admin] PATH_INFO: `/v3/projects` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:36.106898 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ca4a67-a9be-4990-8a34-53211e61314d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:36.109139 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ca4a67-a9be-4990-8a34-53211e61314d admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:36.115092 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 774/1561] 10.222.0.49 () {60 vars in 1153 bytes} [Thu Sep 29 02:11:36 2022] POST /identity/v3/projects => generated 393 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:11:36.115998 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c916f49-0ad7-4748-afbb-6ae725694bb0 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:36.137899 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 788/1562] 10.222.0.49 () {60 vars in 1153 bytes} [Thu Sep 29 02:11:36 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:11:36.138724 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ca4a67-a9be-4990-8a34-53211e61314d admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:36.178482 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:11:36.181128 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c916f49-0ad7-4748-afbb-6ae725694bb0 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:36.192102 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:11:36.206990 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ca4a67-a9be-4990-8a34-53211e61314d admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:36.213369 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c2ea81-4dec-4d0a-9021-aa45df5be594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:36.214413 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c2ea81-4dec-4d0a-9021-aa45df5be594 admin admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:36.214932 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c2ea81-4dec-4d0a-9021-aa45df5be594 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:36.215269 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c2ea81-4dec-4d0a-9021-aa45df5be594 admin admin] PATH_INFO: `/v3/users` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:36.216330 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c2ea81-4dec-4d0a-9021-aa45df5be594 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:36.217445 dv-cinder-740146-21-smb devstack@keystone.service[81648]: WARNING py.warnings [None req-45c2ea81-4dec-4d0a-9021-aa45df5be594 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 29 02:11:36.217445 dv-cinder-740146-21-smb devstack@keystone.service[81648]: warnings.warn(msg) Sep 29 02:11:36.217445 dv-cinder-740146-21-smb devstack@keystone.service[81648]: Sep 29 02:11:36.219090 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c2ea81-4dec-4d0a-9021-aa45df5be594 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:36.242596 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 789/1563] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 02:11:36 2022] POST /identity/v3/users => generated 286 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:11:36.243553 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c2ea81-4dec-4d0a-9021-aa45df5be594 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:36.245438 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0929fad-12cd-4479-a32a-e22c66dd3854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:36.246838 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0929fad-12cd-4479-a32a-e22c66dd3854 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:36.247116 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0929fad-12cd-4479-a32a-e22c66dd3854 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:36.247391 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0929fad-12cd-4479-a32a-e22c66dd3854 admin admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:36.248040 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0929fad-12cd-4479-a32a-e22c66dd3854 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:11:36.248335 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0929fad-12cd-4479-a32a-e22c66dd3854 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:36.249952 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0929fad-12cd-4479-a32a-e22c66dd3854 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:36.253874 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c2ea81-4dec-4d0a-9021-aa45df5be594 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:36.258442 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c312fe12-e7cc-4537-946f-6198c296dbd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:36.259035 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c312fe12-e7cc-4537-946f-6198c296dbd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:36.259316 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c312fe12-e7cc-4537-946f-6198c296dbd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:36.259589 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c312fe12-e7cc-4537-946f-6198c296dbd6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:36.260253 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c312fe12-e7cc-4537-946f-6198c296dbd6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:11:36.260554 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c312fe12-e7cc-4537-946f-6198c296dbd6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:36.261675 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 775/1564] 10.222.0.49 () {58 vars in 1153 bytes} [Thu Sep 29 02:11:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:11:36.262511 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c312fe12-e7cc-4537-946f-6198c296dbd6 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:36.263016 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0929fad-12cd-4479-a32a-e22c66dd3854 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:36.276630 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 790/1565] 10.222.0.49 () {58 vars in 1153 bytes} [Thu Sep 29 02:11:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:11:36.277777 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c312fe12-e7cc-4537-946f-6198c296dbd6 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:36.278418 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0929fad-12cd-4479-a32a-e22c66dd3854 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:36.283261 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02040a70-6147-44b8-babd-e2001fbad37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:36.283869 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02040a70-6147-44b8-babd-e2001fbad37d admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:36.284137 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02040a70-6147-44b8-babd-e2001fbad37d admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:36.284403 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02040a70-6147-44b8-babd-e2001fbad37d admin admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:36.285030 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02040a70-6147-44b8-babd-e2001fbad37d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:36.286951 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02040a70-6147-44b8-babd-e2001fbad37d admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:36.292646 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c312fe12-e7cc-4537-946f-6198c296dbd6 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:36.298037 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae685e7-d8e2-489c-a252-a602bc063d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:36.298629 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae685e7-d8e2-489c-a252-a602bc063d9f admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:36.298913 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae685e7-d8e2-489c-a252-a602bc063d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:36.299177 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae685e7-d8e2-489c-a252-a602bc063d9f admin admin] PATH_INFO: `/v3/domains` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:36.299815 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae685e7-d8e2-489c-a252-a602bc063d9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:11:36.300110 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae685e7-d8e2-489c-a252-a602bc063d9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:36.301735 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae685e7-d8e2-489c-a252-a602bc063d9f admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:36.314478 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 791/1566] 10.222.0.49 () {58 vars in 1153 bytes} [Thu Sep 29 02:11:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:11:36.315285 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae685e7-d8e2-489c-a252-a602bc063d9f admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:36.319207 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 776/1567] 10.222.0.49 () {60 vars in 1153 bytes} [Thu Sep 29 02:11:36 2022] POST /identity/v3/projects => generated 389 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:11:36.319207 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02040a70-6147-44b8-babd-e2001fbad37d admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:36.331279 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae685e7-d8e2-489c-a252-a602bc063d9f admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:36.385303 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02040a70-6147-44b8-babd-e2001fbad37d admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:36.387384 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d5814f-22e4-45bd-9408-030e56ec6f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:36.387992 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d5814f-22e4-45bd-9408-030e56ec6f6d admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:36.388268 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d5814f-22e4-45bd-9408-030e56ec6f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:36.388540 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d5814f-22e4-45bd-9408-030e56ec6f6d admin admin] PATH_INFO: `/v3/domains` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:36.389179 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d5814f-22e4-45bd-9408-030e56ec6f6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:11:36.389507 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d5814f-22e4-45bd-9408-030e56ec6f6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:36.390798 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba27de5f-6891-4496-95be-385caebacf34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:36.391133 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d5814f-22e4-45bd-9408-030e56ec6f6d admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:36.391389 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba27de5f-6891-4496-95be-385caebacf34 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:36.391667 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba27de5f-6891-4496-95be-385caebacf34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:36.391934 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba27de5f-6891-4496-95be-385caebacf34 admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:36.392556 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba27de5f-6891-4496-95be-385caebacf34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:36.394473 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba27de5f-6891-4496-95be-385caebacf34 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:36.403862 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 792/1568] 10.222.0.49 () {58 vars in 1153 bytes} [Thu Sep 29 02:11:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:11:36.404728 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d5814f-22e4-45bd-9408-030e56ec6f6d admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:36.414671 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d5814f-22e4-45bd-9408-030e56ec6f6d admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:36.419843 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6f54c3-d90b-4aa3-8092-a391d794d27f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:36.420435 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f54c3-d90b-4aa3-8092-a391d794d27f admin admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:36.420713 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f54c3-d90b-4aa3-8092-a391d794d27f admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:36.420987 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f54c3-d90b-4aa3-8092-a391d794d27f admin admin] PATH_INFO: `/v3/users` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:36.421639 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6f54c3-d90b-4aa3-8092-a391d794d27f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:36.423609 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6f54c3-d90b-4aa3-8092-a391d794d27f admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:36.427139 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 777/1569] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 02:11:36 2022] POST /identity/v3/users => generated 297 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:11:36.427139 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba27de5f-6891-4496-95be-385caebacf34 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:36.439879 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba27de5f-6891-4496-95be-385caebacf34 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:36.445295 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c00b776-f93d-4352-aa68-c939c7fc657c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:36.445938 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c00b776-f93d-4352-aa68-c939c7fc657c admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:36.446301 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c00b776-f93d-4352-aa68-c939c7fc657c admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:36.446618 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c00b776-f93d-4352-aa68-c939c7fc657c admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:36.447266 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c00b776-f93d-4352-aa68-c939c7fc657c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:36.451235 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 793/1570] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 02:11:36 2022] POST /identity/v3/users => generated 292 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:11:36.451235 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6f54c3-d90b-4aa3-8092-a391d794d27f admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:36.451476 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c00b776-f93d-4352-aa68-c939c7fc657c admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:36.458462 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6f54c3-d90b-4aa3-8092-a391d794d27f admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:36.462802 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 778/1571] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:11:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:11:36.462802 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c00b776-f93d-4352-aa68-c939c7fc657c admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:36.463397 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322a1b1a-4412-40dc-89c0-4787723513fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:36.463986 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a1b1a-4412-40dc-89c0-4787723513fb admin admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:36.464269 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a1b1a-4412-40dc-89c0-4787723513fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:36.464541 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a1b1a-4412-40dc-89c0-4787723513fb admin admin] PATH_INFO: `/v3/projects` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:36.465784 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322a1b1a-4412-40dc-89c0-4787723513fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:36.468024 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322a1b1a-4412-40dc-89c0-4787723513fb admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:36.472456 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c00b776-f93d-4352-aa68-c939c7fc657c admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:36.483509 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f0368b-bccf-4c1a-8b5e-a3e3ef6e6d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:36.484259 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0368b-bccf-4c1a-8b5e-a3e3ef6e6d6f admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:36.484545 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0368b-bccf-4c1a-8b5e-a3e3ef6e6d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:36.485183 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0368b-bccf-4c1a-8b5e-a3e3ef6e6d6f admin admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:36.486276 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f0368b-bccf-4c1a-8b5e-a3e3ef6e6d6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:36.488985 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f0368b-bccf-4c1a-8b5e-a3e3ef6e6d6f admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:36.504987 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 794/1572] 10.222.0.49 () {60 vars in 1153 bytes} [Thu Sep 29 02:11:36 2022] POST /identity/v3/projects => generated 367 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:11:36.510499 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322a1b1a-4412-40dc-89c0-4787723513fb admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:36.521330 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 779/1573] 10.222.0.49 () {60 vars in 1153 bytes} [Thu Sep 29 02:11:36 2022] POST /identity/v3/projects => generated 379 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:11:36.522310 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f0368b-bccf-4c1a-8b5e-a3e3ef6e6d6f admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:36.568671 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:11:36.572640 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:11:36.582001 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322a1b1a-4412-40dc-89c0-4787723513fb admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:36.593804 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f0368b-bccf-4c1a-8b5e-a3e3ef6e6d6f admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:36.599509 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19edd43d-be73-4e73-9ec8-69ce4278bdca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:36.600109 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19edd43d-be73-4e73-9ec8-69ce4278bdca admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:36.600381 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19edd43d-be73-4e73-9ec8-69ce4278bdca admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:36.600640 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19edd43d-be73-4e73-9ec8-69ce4278bdca admin admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:36.601287 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19edd43d-be73-4e73-9ec8-69ce4278bdca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:36.603223 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19edd43d-be73-4e73-9ec8-69ce4278bdca admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:36.630250 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 780/1574] 10.222.0.49 () {60 vars in 1153 bytes} [Thu Sep 29 02:11:36 2022] POST /identity/v3/projects => generated 363 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:11:36.631131 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19edd43d-be73-4e73-9ec8-69ce4278bdca admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:36.646019 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14307f5-3ed8-40d5-bf54-d53c41c72182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:36.646782 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14307f5-3ed8-40d5-bf54-d53c41c72182 admin admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:36.647069 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14307f5-3ed8-40d5-bf54-d53c41c72182 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:36.647368 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14307f5-3ed8-40d5-bf54-d53c41c72182 admin admin] PATH_INFO: `/v3/users` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:36.648113 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14307f5-3ed8-40d5-bf54-d53c41c72182 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:36.650161 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14307f5-3ed8-40d5-bf54-d53c41c72182 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:36.673097 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 795/1575] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 02:11:36 2022] POST /identity/v3/users => generated 295 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:11:36.673963 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14307f5-3ed8-40d5-bf54-d53c41c72182 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:36.683200 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14307f5-3ed8-40d5-bf54-d53c41c72182 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:36.702084 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19edd43d-be73-4e73-9ec8-69ce4278bdca admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:36.707115 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ce92e0-1134-4049-b99e-7dfbc7bcd49f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:36.707768 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ce92e0-1134-4049-b99e-7dfbc7bcd49f admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:36.708051 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ce92e0-1134-4049-b99e-7dfbc7bcd49f admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:36.708349 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ce92e0-1134-4049-b99e-7dfbc7bcd49f admin admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:36.708984 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ce92e0-1134-4049-b99e-7dfbc7bcd49f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:36.710900 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ce92e0-1134-4049-b99e-7dfbc7bcd49f admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:36.739153 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 781/1576] 10.222.0.49 () {60 vars in 1153 bytes} [Thu Sep 29 02:11:36 2022] POST /identity/v3/projects => generated 381 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:11:36.739981 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ce92e0-1134-4049-b99e-7dfbc7bcd49f admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:36.742493 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf917dc-4ff0-4117-a6be-336c1a59d7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:36.742889 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf917dc-4ff0-4117-a6be-336c1a59d7ad admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:36.743172 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf917dc-4ff0-4117-a6be-336c1a59d7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:36.743448 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf917dc-4ff0-4117-a6be-336c1a59d7ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:36.744157 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf917dc-4ff0-4117-a6be-336c1a59d7ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:36.746635 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf917dc-4ff0-4117-a6be-336c1a59d7ad admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:36.757711 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 796/1577] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:11:36 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:11:36.758491 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf917dc-4ff0-4117-a6be-336c1a59d7ad admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:36.769068 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf917dc-4ff0-4117-a6be-336c1a59d7ad admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:36.803640 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ce92e0-1134-4049-b99e-7dfbc7bcd49f admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:36.808275 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af2e1d6-bf17-4d51-acb1-e6c1fb76e7f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:36.809787 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af2e1d6-bf17-4d51-acb1-e6c1fb76e7f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:36.810071 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af2e1d6-bf17-4d51-acb1-e6c1fb76e7f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:36.810348 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af2e1d6-bf17-4d51-acb1-e6c1fb76e7f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:36.810992 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af2e1d6-bf17-4d51-acb1-e6c1fb76e7f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:36.812593 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af2e1d6-bf17-4d51-acb1-e6c1fb76e7f8 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:36.822559 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 782/1578] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:11:36 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:11:36.823157 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af2e1d6-bf17-4d51-acb1-e6c1fb76e7f8 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:36.827409 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbce91f1-dfe7-4a6c-8026-c82b809030c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:36.828021 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce91f1-dfe7-4a6c-8026-c82b809030c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:36.828299 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce91f1-dfe7-4a6c-8026-c82b809030c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:36.828566 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce91f1-dfe7-4a6c-8026-c82b809030c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:36.829217 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbce91f1-dfe7-4a6c-8026-c82b809030c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:36.830812 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbce91f1-dfe7-4a6c-8026-c82b809030c1 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:36.833484 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af2e1d6-bf17-4d51-acb1-e6c1fb76e7f8 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:36.838088 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0734ee0-ec7f-4e16-82c9-07029e618845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:36.838673 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0734ee0-ec7f-4e16-82c9-07029e618845 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:36.838950 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0734ee0-ec7f-4e16-82c9-07029e618845 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:36.839242 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0734ee0-ec7f-4e16-82c9-07029e618845 admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:36.840415 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0734ee0-ec7f-4e16-82c9-07029e618845 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:36.841104 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 797/1579] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:11:36 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:11:36.841909 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbce91f1-dfe7-4a6c-8026-c82b809030c1 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:36.842748 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0734ee0-ec7f-4e16-82c9-07029e618845 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:36.852395 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbce91f1-dfe7-4a6c-8026-c82b809030c1 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:36.857878 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bc22f9-fc48-4fb5-9a35-a535d39da3db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:36.858599 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc22f9-fc48-4fb5-9a35-a535d39da3db admin admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:36.859008 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc22f9-fc48-4fb5-9a35-a535d39da3db admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:36.859372 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc22f9-fc48-4fb5-9a35-a535d39da3db admin admin] PATH_INFO: `/v3/users` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:36.860705 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bc22f9-fc48-4fb5-9a35-a535d39da3db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:36.862663 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bc22f9-fc48-4fb5-9a35-a535d39da3db admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:36.865264 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 783/1580] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 02:11:36 2022] POST /identity/v3/users => generated 284 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:11:36.866184 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0734ee0-ec7f-4e16-82c9-07029e618845 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:36.877435 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0734ee0-ec7f-4e16-82c9-07029e618845 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:36.882165 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865a97c8-0ef4-46ea-a76e-fb0ce0ffc33c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:36.882762 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865a97c8-0ef4-46ea-a76e-fb0ce0ffc33c admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:36.883039 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865a97c8-0ef4-46ea-a76e-fb0ce0ffc33c admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:36.883316 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865a97c8-0ef4-46ea-a76e-fb0ce0ffc33c admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:36.883949 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865a97c8-0ef4-46ea-a76e-fb0ce0ffc33c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:36.887865 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 798/1581] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 02:11:36 2022] POST /identity/v3/users => generated 290 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:11:36.887865 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bc22f9-fc48-4fb5-9a35-a535d39da3db admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:36.888094 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865a97c8-0ef4-46ea-a76e-fb0ce0ffc33c admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:36.892707 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:11:36.897024 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bc22f9-fc48-4fb5-9a35-a535d39da3db admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:36.904338 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3561d742-dd00-4935-a969-659b3fbe12ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:36.904979 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3561d742-dd00-4935-a969-659b3fbe12ca admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:36.905262 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3561d742-dd00-4935-a969-659b3fbe12ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:36.905892 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3561d742-dd00-4935-a969-659b3fbe12ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:36.906557 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3561d742-dd00-4935-a969-659b3fbe12ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:36.910212 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3561d742-dd00-4935-a969-659b3fbe12ca admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:36.915357 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 784/1582] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 02:11:36 2022] POST /identity/v3/users => generated 282 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:11:36.916050 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865a97c8-0ef4-46ea-a76e-fb0ce0ffc33c admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:36.922508 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 799/1583] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:11:36 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:11:36.923340 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3561d742-dd00-4935-a969-659b3fbe12ca admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:36.929348 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865a97c8-0ef4-46ea-a76e-fb0ce0ffc33c admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:36.933972 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3561d742-dd00-4935-a969-659b3fbe12ca admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:36.934712 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0ad9a2-e18c-4e69-9eac-f2d5fab2516d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:36.935530 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0ad9a2-e18c-4e69-9eac-f2d5fab2516d admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:36.935696 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0ad9a2-e18c-4e69-9eac-f2d5fab2516d admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:36.935871 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0ad9a2-e18c-4e69-9eac-f2d5fab2516d admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:36.936506 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0ad9a2-e18c-4e69-9eac-f2d5fab2516d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:36.938513 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0ad9a2-e18c-4e69-9eac-f2d5fab2516d admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:36.939532 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a458f2-e2ef-4233-a2b0-f6c845476f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:36.940142 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a458f2-e2ef-4233-a2b0-f6c845476f6f admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:36.940449 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a458f2-e2ef-4233-a2b0-f6c845476f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:36.940728 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a458f2-e2ef-4233-a2b0-f6c845476f6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:36.941394 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a458f2-e2ef-4233-a2b0-f6c845476f6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:36.942972 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a458f2-e2ef-4233-a2b0-f6c845476f6f admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:36.950311 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=89,keystone:INSERT=11 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:11:36.955452 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 800/1584] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:11:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:11:36.956727 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a458f2-e2ef-4233-a2b0-f6c845476f6f admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:36.965094 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 785/1585] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 02:11:36 2022] POST /identity/v3/users => generated 291 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:11:36.965946 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0ad9a2-e18c-4e69-9eac-f2d5fab2516d admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:36.971434 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a458f2-e2ef-4233-a2b0-f6c845476f6f admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:36.976252 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0ad9a2-e18c-4e69-9eac-f2d5fab2516d admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:36.976540 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d960e5c-0411-45d8-b338-a6dbe987f550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:36.977205 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d960e5c-0411-45d8-b338-a6dbe987f550 admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:36.977554 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d960e5c-0411-45d8-b338-a6dbe987f550 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:36.977849 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d960e5c-0411-45d8-b338-a6dbe987f550 admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:36.978551 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d960e5c-0411-45d8-b338-a6dbe987f550 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:36.980928 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d960e5c-0411-45d8-b338-a6dbe987f550 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:36.981684 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c566d5e-0ad3-4165-a346-f3774b42e3e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:36.982332 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c566d5e-0ad3-4165-a346-f3774b42e3e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:36.982608 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c566d5e-0ad3-4165-a346-f3774b42e3e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:36.982879 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c566d5e-0ad3-4165-a346-f3774b42e3e5 admin admin] PATH_INFO: `/v3/projects/46addcb5f16048cf89ecaa7cc14816eb/users/f4fddfaae2854f8da663482b4191dec3/roles/f157f905c9c94ccfbfb46e52d443e8f2` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:36.991606 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 801/1586] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:11:36 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:11:36.992517 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d960e5c-0411-45d8-b338-a6dbe987f550 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:37.002272 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c566d5e-0ad3-4165-a346-f3774b42e3e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46addcb5f16048cf89ecaa7cc14816eb, user_id=f4fddfaae2854f8da663482b4191dec3, role_id=f157f905c9c94ccfbfb46e52d443e8f2)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:37.002536 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d960e5c-0411-45d8-b338-a6dbe987f550 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:37.003309 dv-cinder-740146-21-smb devstack@keystone.service[81649]: WARNING py.warnings [None req-0c566d5e-0ad3-4165-a346-f3774b42e3e5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 29 02:11:37.003309 dv-cinder-740146-21-smb devstack@keystone.service[81649]: warnings.warn(msg) Sep 29 02:11:37.003309 dv-cinder-740146-21-smb devstack@keystone.service[81649]: Sep 29 02:11:37.005254 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c566d5e-0ad3-4165-a346-f3774b42e3e5 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:37.007852 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5454f517-bdce-4450-ac9e-bf049c2ad1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:37.008434 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5454f517-bdce-4450-ac9e-bf049c2ad1bb admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:37.008714 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5454f517-bdce-4450-ac9e-bf049c2ad1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:37.008990 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5454f517-bdce-4450-ac9e-bf049c2ad1bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:37.009762 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5454f517-bdce-4450-ac9e-bf049c2ad1bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:37.012886 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5454f517-bdce-4450-ac9e-bf049c2ad1bb admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:37.019516 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 786/1587] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:11:36 2022] PUT /identity/v3/projects/46addcb5f16048cf89ecaa7cc14816eb/users/f4fddfaae2854f8da663482b4191dec3/roles/f157f905c9c94ccfbfb46e52d443e8f2 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:11:37.020824 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c566d5e-0ad3-4165-a346-f3774b42e3e5 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:37.035633 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 802/1588] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:11:36 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:11:37.035633 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5454f517-bdce-4450-ac9e-bf049c2ad1bb admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:37.046695 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5454f517-bdce-4450-ac9e-bf049c2ad1bb admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:37.094417 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c566d5e-0ad3-4165-a346-f3774b42e3e5 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:37.099345 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f7a761-d891-435f-a4f9-867292312cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:37.099991 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f7a761-d891-435f-a4f9-867292312cbe admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:37.100274 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f7a761-d891-435f-a4f9-867292312cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:37.100554 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f7a761-d891-435f-a4f9-867292312cbe admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:37.101200 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f7a761-d891-435f-a4f9-867292312cbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:37.103050 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f7a761-d891-435f-a4f9-867292312cbe admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:37.103389 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e20bb8c-6105-4966-bd32-bcc9deaef052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:37.104002 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e20bb8c-6105-4966-bd32-bcc9deaef052 admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:37.104297 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e20bb8c-6105-4966-bd32-bcc9deaef052 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:37.104545 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e20bb8c-6105-4966-bd32-bcc9deaef052 admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:37.105870 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e20bb8c-6105-4966-bd32-bcc9deaef052 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:37.107726 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e20bb8c-6105-4966-bd32-bcc9deaef052 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:37.114333 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 787/1589] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:11:37 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:11:37.115260 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f7a761-d891-435f-a4f9-867292312cbe admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:37.118127 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 803/1590] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:11:37 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:11:37.118745 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e20bb8c-6105-4966-bd32-bcc9deaef052 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:37.128904 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f7a761-d891-435f-a4f9-867292312cbe admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:37.129629 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e20bb8c-6105-4966-bd32-bcc9deaef052 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:37.133629 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a459a1de-eb20-4cfa-9010-e96bf4bd6566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:37.134155 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8fcaa7-158c-4c11-90d8-8b2e658dfa63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:37.134273 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a459a1de-eb20-4cfa-9010-e96bf4bd6566 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:37.134532 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a459a1de-eb20-4cfa-9010-e96bf4bd6566 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:37.134792 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8fcaa7-158c-4c11-90d8-8b2e658dfa63 admin admin] REQUEST_METHOD: `PUT` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:37.134903 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a459a1de-eb20-4cfa-9010-e96bf4bd6566 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:37.135067 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8fcaa7-158c-4c11-90d8-8b2e658dfa63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:37.135342 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8fcaa7-158c-4c11-90d8-8b2e658dfa63 admin admin] PATH_INFO: `/v3/projects/b407de2089554e13839d51f270c3adf1/users/f167598e4a354a21b89825f2cbe8ff2d/roles/f157f905c9c94ccfbfb46e52d443e8f2` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:37.135453 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a459a1de-eb20-4cfa-9010-e96bf4bd6566 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:37.137503 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a459a1de-eb20-4cfa-9010-e96bf4bd6566 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:37.148655 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 788/1591] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:11:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:11:37.148655 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a459a1de-eb20-4cfa-9010-e96bf4bd6566 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:37.151751 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8fcaa7-158c-4c11-90d8-8b2e658dfa63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b407de2089554e13839d51f270c3adf1, user_id=f167598e4a354a21b89825f2cbe8ff2d, role_id=f157f905c9c94ccfbfb46e52d443e8f2)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:37.154668 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8fcaa7-158c-4c11-90d8-8b2e658dfa63 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:37.161010 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a459a1de-eb20-4cfa-9010-e96bf4bd6566 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:37.166355 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbacaab-f7bc-47aa-8ebc-adebf5d71321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:37.167023 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbacaab-f7bc-47aa-8ebc-adebf5d71321 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:37.167343 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbacaab-f7bc-47aa-8ebc-adebf5d71321 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:37.168204 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbacaab-f7bc-47aa-8ebc-adebf5d71321 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:37.169004 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 804/1592] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:11:37 2022] PUT /identity/v3/projects/b407de2089554e13839d51f270c3adf1/users/f167598e4a354a21b89825f2cbe8ff2d/roles/f157f905c9c94ccfbfb46e52d443e8f2 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:11:37.169262 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbacaab-f7bc-47aa-8ebc-adebf5d71321 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:37.170892 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbacaab-f7bc-47aa-8ebc-adebf5d71321 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:37.173404 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8fcaa7-158c-4c11-90d8-8b2e658dfa63 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:37.184441 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 789/1593] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:11:37 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:11:37.186628 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb00fb39-aa8f-4490-93de-3a94ffa3e4b6 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:37.186914 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb00fb39-aa8f-4490-93de-3a94ffa3e4b6 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:37.187189 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb00fb39-aa8f-4490-93de-3a94ffa3e4b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:37.214626 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-eb00fb39-aa8f-4490-93de-3a94ffa3e4b6 None None] MFA Rules not processed for user `f4fddfaae2854f8da663482b4191dec3`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:37.215942 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-eb00fb39-aa8f-4490-93de-3a94ffa3e4b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:37.239827 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8fcaa7-158c-4c11-90d8-8b2e658dfa63 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:37.245426 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8581669-718d-4468-a973-e771890aadac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:37.246910 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8581669-718d-4468-a973-e771890aadac admin admin] REQUEST_METHOD: `PUT` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:37.247187 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8581669-718d-4468-a973-e771890aadac admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:37.247924 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8581669-718d-4468-a973-e771890aadac admin admin] PATH_INFO: `/v3/projects/1765f90d50914c75bf5c10c43bc688e9/users/f68a35fdeeea469f873ec50671fc35f0/roles/f157f905c9c94ccfbfb46e52d443e8f2` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:37.262847 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8581669-718d-4468-a973-e771890aadac admin admin] RBAC: Authorizing `identity:create_grant(project_id=1765f90d50914c75bf5c10c43bc688e9, user_id=f68a35fdeeea469f873ec50671fc35f0, role_id=f157f905c9c94ccfbfb46e52d443e8f2)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:37.265535 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8581669-718d-4468-a973-e771890aadac admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:37.279027 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 805/1594] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:11:37 2022] PUT /identity/v3/projects/1765f90d50914c75bf5c10c43bc688e9/users/f68a35fdeeea469f873ec50671fc35f0/roles/f157f905c9c94ccfbfb46e52d443e8f2 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:11:37.285826 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 790/1595] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:11:37 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:37.285826 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb00fb39-aa8f-4490-93de-3a94ffa3e4b6 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:37.286076 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8581669-718d-4468-a973-e771890aadac admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:37.297783 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb00fb39-aa8f-4490-93de-3a94ffa3e4b6 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:37.306507 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:11:37.342820 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:11:37.358544 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8581669-718d-4468-a973-e771890aadac admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:37.363028 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263aec84-3a48-46f2-b3f7-1f22bc25b81a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:37.363636 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263aec84-3a48-46f2-b3f7-1f22bc25b81a admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:37.363918 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263aec84-3a48-46f2-b3f7-1f22bc25b81a admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:37.364186 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263aec84-3a48-46f2-b3f7-1f22bc25b81a admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:37.364827 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263aec84-3a48-46f2-b3f7-1f22bc25b81a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:37.366444 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263aec84-3a48-46f2-b3f7-1f22bc25b81a admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:37.369221 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a15f59c-4ac5-4c46-bd53-a87958d09c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:37.369866 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15f59c-4ac5-4c46-bd53-a87958d09c16 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:37.370145 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15f59c-4ac5-4c46-bd53-a87958d09c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:37.370463 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15f59c-4ac5-4c46-bd53-a87958d09c16 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:37.371252 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a15f59c-4ac5-4c46-bd53-a87958d09c16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:37.373051 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a15f59c-4ac5-4c46-bd53-a87958d09c16 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:37.376407 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 806/1596] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:11:37 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:11:37.377250 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263aec84-3a48-46f2-b3f7-1f22bc25b81a admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:37.387651 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 791/1597] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:11:37 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:11:37.387651 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a15f59c-4ac5-4c46-bd53-a87958d09c16 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:37.390062 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263aec84-3a48-46f2-b3f7-1f22bc25b81a admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:37.395222 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407b733a-620b-4080-b13d-2b33015d43c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:37.395381 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a15f59c-4ac5-4c46-bd53-a87958d09c16 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:37.395932 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407b733a-620b-4080-b13d-2b33015d43c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:37.396216 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407b733a-620b-4080-b13d-2b33015d43c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:37.396617 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407b733a-620b-4080-b13d-2b33015d43c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:37.397348 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407b733a-620b-4080-b13d-2b33015d43c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:37.399032 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407b733a-620b-4080-b13d-2b33015d43c7 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:37.399887 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9a3333-6510-4abe-800e-35e8a8ce7f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:37.400777 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9a3333-6510-4abe-800e-35e8a8ce7f05 admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:37.401053 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9a3333-6510-4abe-800e-35e8a8ce7f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:37.401332 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9a3333-6510-4abe-800e-35e8a8ce7f05 admin admin] PATH_INFO: `/v3/projects/bb1caf7cbae44c41bce39e486a20f6eb/users/3a68abb5f8ab421cb6044c9a9f579ba6/roles/f157f905c9c94ccfbfb46e52d443e8f2` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:37.411190 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 807/1598] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:11:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:11:37.412643 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cda51d-d105-4f26-847e-08eb5c2048bb None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:37.412952 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cda51d-d105-4f26-847e-08eb5c2048bb None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:37.413250 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cda51d-d105-4f26-847e-08eb5c2048bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:37.417011 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9a3333-6510-4abe-800e-35e8a8ce7f05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb1caf7cbae44c41bce39e486a20f6eb, user_id=3a68abb5f8ab421cb6044c9a9f579ba6, role_id=f157f905c9c94ccfbfb46e52d443e8f2)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:37.419916 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9a3333-6510-4abe-800e-35e8a8ce7f05 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:37.434585 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-74cda51d-d105-4f26-847e-08eb5c2048bb None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:37.435610 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 792/1599] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:11:37 2022] PUT /identity/v3/projects/bb1caf7cbae44c41bce39e486a20f6eb/users/3a68abb5f8ab421cb6044c9a9f579ba6/roles/f157f905c9c94ccfbfb46e52d443e8f2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:11:37.435981 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-74cda51d-d105-4f26-847e-08eb5c2048bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:37.436553 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9a3333-6510-4abe-800e-35e8a8ce7f05 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:37.499769 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 808/1600] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:11:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:37.499769 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b986ec-409c-4484-9a9b-09b62dde6040 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:37.499769 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b986ec-409c-4484-9a9b-09b62dde6040 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:37.499769 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b986ec-409c-4484-9a9b-09b62dde6040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:37.500222 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9a3333-6510-4abe-800e-35e8a8ce7f05 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:37.505215 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d814cb-97c3-4a8c-9dd1-61a0b333d17b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:37.505938 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d814cb-97c3-4a8c-9dd1-61a0b333d17b admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:37.506215 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d814cb-97c3-4a8c-9dd1-61a0b333d17b admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:37.506491 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d814cb-97c3-4a8c-9dd1-61a0b333d17b admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:37.507130 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d814cb-97c3-4a8c-9dd1-61a0b333d17b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:37.508718 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d814cb-97c3-4a8c-9dd1-61a0b333d17b admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:37.517118 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-19b986ec-409c-4484-9a9b-09b62dde6040 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:37.518357 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-19b986ec-409c-4484-9a9b-09b62dde6040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:37.519031 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 793/1601] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:11:37 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:11:37.520239 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d845cb-f62d-491f-8119-eb8ff5ce3ace None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:37.520524 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d845cb-f62d-491f-8119-eb8ff5ce3ace None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:37.520790 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d845cb-f62d-491f-8119-eb8ff5ce3ace None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:37.522492 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 794/1602] 10.222.0.49 () {54 vars in 961 bytes} [Thu Sep 29 02:11:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:11:37.522850 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d845cb-f62d-491f-8119-eb8ff5ce3ace None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:37.530675 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 809/1603] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:11:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:37.531452 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b986ec-409c-4484-9a9b-09b62dde6040 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:37.538882 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d845cb-f62d-491f-8119-eb8ff5ce3ace None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:37.543967 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae92cad7-9416-4111-9d5f-a96d39bba7a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:37.544611 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae92cad7-9416-4111-9d5f-a96d39bba7a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:37.544837 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b986ec-409c-4484-9a9b-09b62dde6040 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:37.544953 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae92cad7-9416-4111-9d5f-a96d39bba7a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:37.545142 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae92cad7-9416-4111-9d5f-a96d39bba7a6 admin admin] PATH_INFO: `/v3/projects/47888d7711c64be18ca04d3179c3f022/users/0adecdbf28a949c48ac62bdb012bfac3/roles/f157f905c9c94ccfbfb46e52d443e8f2` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:37.549453 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8ecc06-f18e-4c0c-a961-bb3fd734635c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:37.550093 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8ecc06-f18e-4c0c-a961-bb3fd734635c admin admin] REQUEST_METHOD: `PUT` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:37.550369 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8ecc06-f18e-4c0c-a961-bb3fd734635c admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:37.550640 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8ecc06-f18e-4c0c-a961-bb3fd734635c admin admin] PATH_INFO: `/v3/projects/8584701589bf4c849d7eba7a7d3138e3/users/c7415274ccbd446fb4704389e1e68b9b/roles/f157f905c9c94ccfbfb46e52d443e8f2` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:37.560532 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae92cad7-9416-4111-9d5f-a96d39bba7a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47888d7711c64be18ca04d3179c3f022, user_id=0adecdbf28a949c48ac62bdb012bfac3, role_id=f157f905c9c94ccfbfb46e52d443e8f2)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:37.563232 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae92cad7-9416-4111-9d5f-a96d39bba7a6 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:37.566721 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8ecc06-f18e-4c0c-a961-bb3fd734635c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8584701589bf4c849d7eba7a7d3138e3, user_id=c7415274ccbd446fb4704389e1e68b9b, role_id=f157f905c9c94ccfbfb46e52d443e8f2)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:37.569468 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8ecc06-f18e-4c0c-a961-bb3fd734635c admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:37.579617 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 795/1604] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:11:37 2022] PUT /identity/v3/projects/47888d7711c64be18ca04d3179c3f022/users/0adecdbf28a949c48ac62bdb012bfac3/roles/f157f905c9c94ccfbfb46e52d443e8f2 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:11:37.580460 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae92cad7-9416-4111-9d5f-a96d39bba7a6 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:37.589417 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 810/1605] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:11:37 2022] PUT /identity/v3/projects/8584701589bf4c849d7eba7a7d3138e3/users/c7415274ccbd446fb4704389e1e68b9b/roles/f157f905c9c94ccfbfb46e52d443e8f2 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:11:37.591160 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eec1d3-9376-45a2-abb6-6d0c7050db52 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:37.591603 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eec1d3-9376-45a2-abb6-6d0c7050db52 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:37.591874 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eec1d3-9376-45a2-abb6-6d0c7050db52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:37.610275 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-79eec1d3-9376-45a2-abb6-6d0c7050db52 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:37.611389 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-79eec1d3-9376-45a2-abb6-6d0c7050db52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:37.649775 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae92cad7-9416-4111-9d5f-a96d39bba7a6 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:37.672083 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 811/1606] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:11:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:37.673052 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eec1d3-9376-45a2-abb6-6d0c7050db52 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:37.673885 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:11:37.687836 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:11:37.710683 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736d4fc1-f1d0-4321-b7dd-5ab7fca97ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:37.711336 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d4fc1-f1d0-4321-b7dd-5ab7fca97ec8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:37.711610 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d4fc1-f1d0-4321-b7dd-5ab7fca97ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:37.711877 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d4fc1-f1d0-4321-b7dd-5ab7fca97ec8 admin admin] PATH_INFO: `/v3/projects/be4b4cf1cbfe4040b409e61915d0ba53/users/eea7e0dc2ad248ad8ccf570c1de61b86/roles/f157f905c9c94ccfbfb46e52d443e8f2` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:37.726042 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736d4fc1-f1d0-4321-b7dd-5ab7fca97ec8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be4b4cf1cbfe4040b409e61915d0ba53, user_id=eea7e0dc2ad248ad8ccf570c1de61b86, role_id=f157f905c9c94ccfbfb46e52d443e8f2)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:37.729477 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736d4fc1-f1d0-4321-b7dd-5ab7fca97ec8 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:37.733243 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eec1d3-9376-45a2-abb6-6d0c7050db52 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:37.737716 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6e4218-0bfe-45c3-a1b9-5ed0a64ef09e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:37.738387 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e4218-0bfe-45c3-a1b9-5ed0a64ef09e service neutron] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:37.738673 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e4218-0bfe-45c3-a1b9-5ed0a64ef09e service neutron] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:37.739002 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e4218-0bfe-45c3-a1b9-5ed0a64ef09e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:37.743956 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 796/1607] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:11:37 2022] PUT /identity/v3/projects/be4b4cf1cbfe4040b409e61915d0ba53/users/eea7e0dc2ad248ad8ccf570c1de61b86/roles/f157f905c9c94ccfbfb46e52d443e8f2 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:11:37.744741 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736d4fc1-f1d0-4321-b7dd-5ab7fca97ec8 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:37.749147 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6e4218-0bfe-45c3-a1b9-5ed0a64ef09e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:37.750617 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6e4218-0bfe-45c3-a1b9-5ed0a64ef09e service neutron] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:37.762348 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 812/1608] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:11:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:11:37.764439 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70767b84-3671-4478-b1c8-fb7001b0eb81 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:37.764956 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70767b84-3671-4478-b1c8-fb7001b0eb81 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:37.765242 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70767b84-3671-4478-b1c8-fb7001b0eb81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:37.812077 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-70767b84-3671-4478-b1c8-fb7001b0eb81 None None] MFA Rules not processed for user `f3325a7111d447f4a9cf00c672d5420f`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:37.813615 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-70767b84-3671-4478-b1c8-fb7001b0eb81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:37.824573 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736d4fc1-f1d0-4321-b7dd-5ab7fca97ec8 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:37.830142 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e573ef-0ee4-44bd-bd59-dd7c8521a63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:37.830803 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e573ef-0ee4-44bd-bd59-dd7c8521a63b admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:37.831079 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e573ef-0ee4-44bd-bd59-dd7c8521a63b admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:37.831347 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e573ef-0ee4-44bd-bd59-dd7c8521a63b admin admin] PATH_INFO: `/v3/projects/c6f0464ff4cf4b8cbf41dcf993ff9bee/users/d5f7e17eb44b43048a2009358a69466c/roles/f157f905c9c94ccfbfb46e52d443e8f2` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:37.851356 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e573ef-0ee4-44bd-bd59-dd7c8521a63b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6f0464ff4cf4b8cbf41dcf993ff9bee, user_id=d5f7e17eb44b43048a2009358a69466c, role_id=f157f905c9c94ccfbfb46e52d443e8f2)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:37.855085 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e573ef-0ee4-44bd-bd59-dd7c8521a63b admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:37.882501 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 797/1609] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:11:37 2022] PUT /identity/v3/projects/c6f0464ff4cf4b8cbf41dcf993ff9bee/users/d5f7e17eb44b43048a2009358a69466c/roles/f157f905c9c94ccfbfb46e52d443e8f2 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:11:37.882501 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e573ef-0ee4-44bd-bd59-dd7c8521a63b admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:37.911884 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 813/1610] 10.222.0.49 () {58 vars in 1058 bytes} [Thu Sep 29 02:11:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:37.913177 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc4d3c-6d7d-41fb-b989-db0e5bbfdf1e None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:37.913565 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc4d3c-6d7d-41fb-b989-db0e5bbfdf1e None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:37.913910 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc4d3c-6d7d-41fb-b989-db0e5bbfdf1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:37.947792 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-13dc4d3c-6d7d-41fb-b989-db0e5bbfdf1e None None] MFA Rules not processed for user `0adecdbf28a949c48ac62bdb012bfac3`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:37.949203 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-13dc4d3c-6d7d-41fb-b989-db0e5bbfdf1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:37.960019 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e573ef-0ee4-44bd-bd59-dd7c8521a63b admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:37.966194 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5ba9de-6ff1-437b-95c7-9db807f9579f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:37.966909 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ba9de-6ff1-437b-95c7-9db807f9579f service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:37.967237 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ba9de-6ff1-437b-95c7-9db807f9579f service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:37.967578 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ba9de-6ff1-437b-95c7-9db807f9579f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:38.025813 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:11:38.039115 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 814/1611] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:11:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:38.040806 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8654a8c8-3303-4d19-b5fb-5c7513e79a35 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:38.041494 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8654a8c8-3303-4d19-b5fb-5c7513e79a35 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:38.041494 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8654a8c8-3303-4d19-b5fb-5c7513e79a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:38.053697 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5ba9de-6ff1-437b-95c7-9db807f9579f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:38.055281 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5ba9de-6ff1-437b-95c7-9db807f9579f service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:38.061545 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-8654a8c8-3303-4d19-b5fb-5c7513e79a35 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:38.063597 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-8654a8c8-3303-4d19-b5fb-5c7513e79a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:38.071799 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 798/1612] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:11:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:11:38.076322 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 815/1613] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:11:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:38.076322 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e223225-9352-455e-b5b4-b7327e3e90fd None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:38.076322 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e223225-9352-455e-b5b4-b7327e3e90fd None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:38.076322 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e223225-9352-455e-b5b4-b7327e3e90fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:38.076766 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5ba9de-6ff1-437b-95c7-9db807f9579f service neutron] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:38.094723 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5ba9de-6ff1-437b-95c7-9db807f9579f service neutron] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:38.099938 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04630a5-476c-4610-90a9-686923794fa0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:38.100580 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04630a5-476c-4610-90a9-686923794fa0 service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:38.100866 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04630a5-476c-4610-90a9-686923794fa0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:38.101169 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04630a5-476c-4610-90a9-686923794fa0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:38.114153 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04630a5-476c-4610-90a9-686923794fa0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:38.115665 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04630a5-476c-4610-90a9-686923794fa0 service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:38.118086 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-6e223225-9352-455e-b5b4-b7327e3e90fd None None] MFA Rules not processed for user `eea7e0dc2ad248ad8ccf570c1de61b86`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:38.119321 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-6e223225-9352-455e-b5b4-b7327e3e90fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:38.125437 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:11:38.129973 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 799/1614] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:11:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:11:38.131243 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf43cc-80e9-4da6-879d-f04bf0190830 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:38.131527 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf43cc-80e9-4da6-879d-f04bf0190830 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:38.131788 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf43cc-80e9-4da6-879d-f04bf0190830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:38.163849 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-cfaf43cc-80e9-4da6-879d-f04bf0190830 None None] MFA Rules not processed for user `d5f7e17eb44b43048a2009358a69466c`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:38.165129 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-cfaf43cc-80e9-4da6-879d-f04bf0190830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:38.192304 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 816/1615] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:11:38 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:38.192935 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e223225-9352-455e-b5b4-b7327e3e90fd None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:38.245361 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 800/1616] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:11:38 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:38.250235 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaf43cc-80e9-4da6-879d-f04bf0190830 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:38.267186 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaf43cc-80e9-4da6-879d-f04bf0190830 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:38.274824 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a173e59-0c3b-4c13-85bb-c3f9c263bfd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:38.275998 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a173e59-0c3b-4c13-85bb-c3f9c263bfd5 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:38.276435 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a173e59-0c3b-4c13-85bb-c3f9c263bfd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:38.277823 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a173e59-0c3b-4c13-85bb-c3f9c263bfd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:38.279356 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a173e59-0c3b-4c13-85bb-c3f9c263bfd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:38.282803 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a173e59-0c3b-4c13-85bb-c3f9c263bfd5 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:38.295514 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e223225-9352-455e-b5b4-b7327e3e90fd None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:38.301975 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0ae994-666e-45f0-a8c0-9f29e4fa05f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3325a7111d447f4a9cf00c672d5420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:38.302758 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0ae994-666e-45f0-a8c0-9f29e4fa05f4 service nova] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:38.303042 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0ae994-666e-45f0-a8c0-9f29e4fa05f4 service nova] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:38.303315 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0ae994-666e-45f0-a8c0-9f29e4fa05f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:38.325531 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 801/1617] 10.222.0.49 () {60 vars in 1153 bytes} [Thu Sep 29 02:11:38 2022] POST /identity/v3/projects => generated 367 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:11:38.326829 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a173e59-0c3b-4c13-85bb-c3f9c263bfd5 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:38.330044 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-6a173e59-0c3b-4c13-85bb-c3f9c263bfd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:38.419744 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0ae994-666e-45f0-a8c0-9f29e4fa05f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:38.421400 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0ae994-666e-45f0-a8c0-9f29e4fa05f4 service nova] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:38.444019 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a173e59-0c3b-4c13-85bb-c3f9c263bfd5 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:38.449155 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9c7e3a-2f15-42cb-a9a4-8096a043ffce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:38.449978 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c7e3a-2f15-42cb-a9a4-8096a043ffce service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:38.450536 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c7e3a-2f15-42cb-a9a4-8096a043ffce service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:38.450908 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c7e3a-2f15-42cb-a9a4-8096a043ffce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:38.452637 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 817/1618] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:11:38 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:11:38.455040 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0ae994-666e-45f0-a8c0-9f29e4fa05f4 service nova] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:38.527589 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:11:38.549685 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9c7e3a-2f15-42cb-a9a4-8096a043ffce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:38.551648 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9c7e3a-2f15-42cb-a9a4-8096a043ffce service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:38.564110 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:11:38.569084 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 802/1619] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:11:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:11:38.570274 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9c7e3a-2f15-42cb-a9a4-8096a043ffce service neutron] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:38.577435 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0ae994-666e-45f0-a8c0-9f29e4fa05f4 service nova] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:38.596316 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9c7e3a-2f15-42cb-a9a4-8096a043ffce service neutron] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:38.606695 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c328b204-fb55-4422-878f-3b2c8ec54e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:38.611157 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c328b204-fb55-4422-878f-3b2c8ec54e3c admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:38.611528 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c328b204-fb55-4422-878f-3b2c8ec54e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:38.611881 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c328b204-fb55-4422-878f-3b2c8ec54e3c admin admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:38.612755 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c328b204-fb55-4422-878f-3b2c8ec54e3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:38.617703 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c328b204-fb55-4422-878f-3b2c8ec54e3c admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:38.655249 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08ea985-967c-4989-9c77-27b754ed0350 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75135b856134ba4b9ccac337886f682', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:38.655249 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08ea985-967c-4989-9c77-27b754ed0350 service cinder] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:38.655249 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08ea985-967c-4989-9c77-27b754ed0350 service cinder] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:38.655249 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08ea985-967c-4989-9c77-27b754ed0350 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:38.681723 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 803/1620] 10.222.0.49 () {60 vars in 1153 bytes} [Thu Sep 29 02:11:38 2022] POST /identity/v3/projects => generated 381 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:11:38.682769 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c328b204-fb55-4422-878f-3b2c8ec54e3c admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:38.800212 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08ea985-967c-4989-9c77-27b754ed0350 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:38.803080 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08ea985-967c-4989-9c77-27b754ed0350 service cinder] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:38.827258 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 818/1621] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:11:38 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:11:38.829152 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08ea985-967c-4989-9c77-27b754ed0350 service cinder] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:38.856247 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08ea985-967c-4989-9c77-27b754ed0350 service cinder] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:38.863268 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c328b204-fb55-4422-878f-3b2c8ec54e3c admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:38.871900 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6bd487-b95f-408d-b9eb-61c2cd550f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:38.872290 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6bd487-b95f-408d-b9eb-61c2cd550f82 admin admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:38.872744 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6bd487-b95f-408d-b9eb-61c2cd550f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:38.873087 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6bd487-b95f-408d-b9eb-61c2cd550f82 admin admin] PATH_INFO: `/v3/users` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:38.874088 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6bd487-b95f-408d-b9eb-61c2cd550f82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:38.877748 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6bd487-b95f-408d-b9eb-61c2cd550f82 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:38.882648 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f164c625-bd4e-48b1-8d51-c00fe47fe020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:38.886434 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f164c625-bd4e-48b1-8d51-c00fe47fe020 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:38.888896 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f164c625-bd4e-48b1-8d51-c00fe47fe020 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:38.889504 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f164c625-bd4e-48b1-8d51-c00fe47fe020 admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:38.890256 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f164c625-bd4e-48b1-8d51-c00fe47fe020 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:38.896460 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f164c625-bd4e-48b1-8d51-c00fe47fe020 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:38.918965 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 819/1622] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 02:11:38 2022] POST /identity/v3/users => generated 297 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:11:38.925374 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6bd487-b95f-408d-b9eb-61c2cd550f82 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:38.955220 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 804/1623] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 02:11:38 2022] POST /identity/v3/users => generated 290 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:11:38.959069 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f164c625-bd4e-48b1-8d51-c00fe47fe020 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:38.962174 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6bd487-b95f-408d-b9eb-61c2cd550f82 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:38.969686 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25817487-6649-48fc-86de-68f5d48b74ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:38.971087 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25817487-6649-48fc-86de-68f5d48b74ec admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:38.971590 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25817487-6649-48fc-86de-68f5d48b74ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:38.972002 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25817487-6649-48fc-86de-68f5d48b74ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:38.972986 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25817487-6649-48fc-86de-68f5d48b74ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:38.975428 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25817487-6649-48fc-86de-68f5d48b74ec admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:38.983968 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f164c625-bd4e-48b1-8d51-c00fe47fe020 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:38.992743 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 820/1624] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:11:38 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:11:38.994090 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25817487-6649-48fc-86de-68f5d48b74ec admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:39.002086 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afe9855-ac7b-4ede-be5b-884a6d2e0943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:39.002946 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe9855-ac7b-4ede-be5b-884a6d2e0943 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:39.003393 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe9855-ac7b-4ede-be5b-884a6d2e0943 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:39.003824 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe9855-ac7b-4ede-be5b-884a6d2e0943 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:39.004747 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afe9855-ac7b-4ede-be5b-884a6d2e0943 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:39.009164 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afe9855-ac7b-4ede-be5b-884a6d2e0943 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:39.009717 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25817487-6649-48fc-86de-68f5d48b74ec admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:39.016822 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629986b1-c5f8-425e-bb59-3f640f22e1b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:39.017796 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629986b1-c5f8-425e-bb59-3f640f22e1b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:39.018181 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629986b1-c5f8-425e-bb59-3f640f22e1b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:39.018627 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629986b1-c5f8-425e-bb59-3f640f22e1b7 admin admin] PATH_INFO: `/v3/projects/6ca79f54e21e4ddbba51b286ec08d827/users/22a301a4837b4103a1356e4ab8b61d2f/roles/fe9bbc67742f4f5893f39b18eb31d59a` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:39.038464 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629986b1-c5f8-425e-bb59-3f640f22e1b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ca79f54e21e4ddbba51b286ec08d827, user_id=22a301a4837b4103a1356e4ab8b61d2f, role_id=fe9bbc67742f4f5893f39b18eb31d59a)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:39.039686 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 805/1625] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:11:38 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:11:39.045327 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629986b1-c5f8-425e-bb59-3f640f22e1b7 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:39.046879 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afe9855-ac7b-4ede-be5b-884a6d2e0943 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:39.071247 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 821/1626] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:11:38 2022] PUT /identity/v3/projects/6ca79f54e21e4ddbba51b286ec08d827/users/22a301a4837b4103a1356e4ab8b61d2f/roles/fe9bbc67742f4f5893f39b18eb31d59a => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:11:39.072291 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629986b1-c5f8-425e-bb59-3f640f22e1b7 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:39.083567 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afe9855-ac7b-4ede-be5b-884a6d2e0943 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:39.181463 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629986b1-c5f8-425e-bb59-3f640f22e1b7 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:39.196959 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63accbc-5572-42d4-be2b-35c219be0fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:39.200993 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63accbc-5572-42d4-be2b-35c219be0fab admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:39.201332 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63accbc-5572-42d4-be2b-35c219be0fab admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:39.201607 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63accbc-5572-42d4-be2b-35c219be0fab admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:39.203445 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63accbc-5572-42d4-be2b-35c219be0fab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:39.227444 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e25ce25-22ab-4545-9cf7-4056ab1ce823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:39.228704 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e25ce25-22ab-4545-9cf7-4056ab1ce823 admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:39.229034 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e25ce25-22ab-4545-9cf7-4056ab1ce823 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:39.229374 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e25ce25-22ab-4545-9cf7-4056ab1ce823 admin admin] PATH_INFO: `/v3/projects/4268cd859828434f9a646ba7d24e6402/users/8d26dc5c3dcb428aacecf5a9fec88d7a/roles/fe9bbc67742f4f5893f39b18eb31d59a` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:39.234263 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63accbc-5572-42d4-be2b-35c219be0fab admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:39.237220 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:11:39.257668 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e25ce25-22ab-4545-9cf7-4056ab1ce823 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4268cd859828434f9a646ba7d24e6402, user_id=8d26dc5c3dcb428aacecf5a9fec88d7a, role_id=fe9bbc67742f4f5893f39b18eb31d59a)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:39.262569 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e25ce25-22ab-4545-9cf7-4056ab1ce823 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:39.266763 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 822/1627] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:11:39 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:11:39.271047 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eaa5fb-d482-4c03-be6e-83c25c794eca None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:39.271821 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eaa5fb-d482-4c03-be6e-83c25c794eca None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:39.273289 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eaa5fb-d482-4c03-be6e-83c25c794eca None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:39.277718 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 823/1628] 10.222.0.49 () {54 vars in 912 bytes} [Thu Sep 29 02:11:39 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:11:39.279646 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eaa5fb-d482-4c03-be6e-83c25c794eca None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:39.289030 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 806/1629] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:11:39 2022] PUT /identity/v3/projects/4268cd859828434f9a646ba7d24e6402/users/8d26dc5c3dcb428aacecf5a9fec88d7a/roles/fe9bbc67742f4f5893f39b18eb31d59a => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:11:39.294229 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c7e57-3d10-4c1e-ac64-508a613fad84 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:39.294888 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c7e57-3d10-4c1e-ac64-508a613fad84 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:39.295364 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c7e57-3d10-4c1e-ac64-508a613fad84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:39.336635 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-f01c7e57-3d10-4c1e-ac64-508a613fad84 None None] MFA Rules not processed for user `f3325a7111d447f4a9cf00c672d5420f`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:39.338009 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-f01c7e57-3d10-4c1e-ac64-508a613fad84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:39.389766 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:11:39.390992 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eaa5fb-d482-4c03-be6e-83c25c794eca None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:39.398136 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b7661e-de90-4e26-81c9-29154c6ed720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:39.399354 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b7661e-de90-4e26-81c9-29154c6ed720 admin admin] REQUEST_METHOD: `PUT` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:39.399776 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b7661e-de90-4e26-81c9-29154c6ed720 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:39.400388 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b7661e-de90-4e26-81c9-29154c6ed720 admin admin] PATH_INFO: `/v3/projects/6ca79f54e21e4ddbba51b286ec08d827/users/22a301a4837b4103a1356e4ab8b61d2f/roles/fe9bbc67742f4f5893f39b18eb31d59a` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:39.403309 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b7661e-de90-4e26-81c9-29154c6ed720 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ca79f54e21e4ddbba51b286ec08d827, user_id=22a301a4837b4103a1356e4ab8b61d2f, role_id=fe9bbc67742f4f5893f39b18eb31d59a)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:39.407703 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b7661e-de90-4e26-81c9-29154c6ed720 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:39.426575 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 824/1630] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:11:39 2022] PUT /identity/v3/projects/6ca79f54e21e4ddbba51b286ec08d827/users/22a301a4837b4103a1356e4ab8b61d2f/roles/fe9bbc67742f4f5893f39b18eb31d59a => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:11:39.437745 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b7661e-de90-4e26-81c9-29154c6ed720 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:39.504465 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 807/1631] 10.222.0.49 () {58 vars in 1009 bytes} [Thu Sep 29 02:11:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:39.505966 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4048bc8f-04ce-4e54-8702-3599d0d2071a None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:39.506269 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4048bc8f-04ce-4e54-8702-3599d0d2071a None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:39.506549 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4048bc8f-04ce-4e54-8702-3599d0d2071a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:39.575977 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-4048bc8f-04ce-4e54-8702-3599d0d2071a None None] MFA Rules not processed for user `22a301a4837b4103a1356e4ab8b61d2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:39.577442 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-4048bc8f-04ce-4e54-8702-3599d0d2071a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:39.587592 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b7661e-de90-4e26-81c9-29154c6ed720 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:39.601994 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ff51cb-b363-4245-ac41-280b24113ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:39.605559 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ff51cb-b363-4245-ac41-280b24113ebd admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:39.605880 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ff51cb-b363-4245-ac41-280b24113ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:39.606155 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ff51cb-b363-4245-ac41-280b24113ebd admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:39.606817 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ff51cb-b363-4245-ac41-280b24113ebd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:39.612787 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ff51cb-b363-4245-ac41-280b24113ebd admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:39.647395 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 825/1632] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:11:39 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:11:39.649636 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ff51cb-b363-4245-ac41-280b24113ebd admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:39.733638 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 808/1633] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:11:39 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:39.733638 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4048bc8f-04ce-4e54-8702-3599d0d2071a None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:39.735756 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ff51cb-b363-4245-ac41-280b24113ebd admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:39.747290 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bd5b5f-f035-4626-b8d0-fa317932fda8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75135b856134ba4b9ccac337886f682', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:39.753064 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd5b5f-f035-4626-b8d0-fa317932fda8 service cinder] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:39.753064 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd5b5f-f035-4626-b8d0-fa317932fda8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:39.753064 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd5b5f-f035-4626-b8d0-fa317932fda8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:39.757612 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4048bc8f-04ce-4e54-8702-3599d0d2071a None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:39.767259 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ba4358-4804-495c-afc8-868e3120d3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:39.767988 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba4358-4804-495c-afc8-868e3120d3ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:39.768270 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba4358-4804-495c-afc8-868e3120d3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:39.768548 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba4358-4804-495c-afc8-868e3120d3ab admin admin] PATH_INFO: `/v3/projects/4268cd859828434f9a646ba7d24e6402/users/8d26dc5c3dcb428aacecf5a9fec88d7a/roles/fe9bbc67742f4f5893f39b18eb31d59a` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:39.774807 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ba4358-4804-495c-afc8-868e3120d3ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=4268cd859828434f9a646ba7d24e6402, user_id=8d26dc5c3dcb428aacecf5a9fec88d7a, role_id=fe9bbc67742f4f5893f39b18eb31d59a)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:39.778330 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ba4358-4804-495c-afc8-868e3120d3ab admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:39.801858 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 809/1634] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:11:39 2022] PUT /identity/v3/projects/4268cd859828434f9a646ba7d24e6402/users/8d26dc5c3dcb428aacecf5a9fec88d7a/roles/fe9bbc67742f4f5893f39b18eb31d59a => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:11:39.812667 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b865ee-34ed-4366-b5e7-305403bf6441 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:39.812954 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b865ee-34ed-4366-b5e7-305403bf6441 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:39.813232 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b865ee-34ed-4366-b5e7-305403bf6441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:39.830157 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:11:39.870247 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bd5b5f-f035-4626-b8d0-fa317932fda8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:39.873622 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bd5b5f-f035-4626-b8d0-fa317932fda8 service cinder] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:39.883366 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-32b865ee-34ed-4366-b5e7-305403bf6441 None None] MFA Rules not processed for user `8d26dc5c3dcb428aacecf5a9fec88d7a`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:39.884622 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-32b865ee-34ed-4366-b5e7-305403bf6441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:39.921220 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 826/1635] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:11:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:11:39.940382 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bd5b5f-f035-4626-b8d0-fa317932fda8 service cinder] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:39.953675 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bd5b5f-f035-4626-b8d0-fa317932fda8 service cinder] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:40.069766 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 810/1636] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:11:39 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:40.088676 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc83b46-d63d-48af-8c02-5432db9b09b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75135b856134ba4b9ccac337886f682', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:40.089658 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc83b46-d63d-48af-8c02-5432db9b09b3 service cinder] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:40.090162 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc83b46-d63d-48af-8c02-5432db9b09b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:40.090930 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc83b46-d63d-48af-8c02-5432db9b09b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:40.227136 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc83b46-d63d-48af-8c02-5432db9b09b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:40.229591 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc83b46-d63d-48af-8c02-5432db9b09b3 service cinder] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:40.265303 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 827/1637] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:11:39 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:11:40.460286 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b865ee-34ed-4366-b5e7-305403bf6441 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:40.481900 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b865ee-34ed-4366-b5e7-305403bf6441 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:40.489283 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ed3abd-5298-43ba-ba50-565171832217 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75135b856134ba4b9ccac337886f682', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:40.490123 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ed3abd-5298-43ba-ba50-565171832217 service cinder] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:40.491271 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ed3abd-5298-43ba-ba50-565171832217 service cinder] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:40.491635 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ed3abd-5298-43ba-ba50-565171832217 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:40.517692 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ed3abd-5298-43ba-ba50-565171832217 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:40.519626 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ed3abd-5298-43ba-ba50-565171832217 service cinder] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:40.548194 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 811/1638] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:11:40 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:11:40.871551 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc83b46-d63d-48af-8c02-5432db9b09b3 service cinder] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:40.885365 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc83b46-d63d-48af-8c02-5432db9b09b3 service cinder] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:40.894397 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fce53fb-78ee-47b2-8f5a-b2dab49fd3a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75135b856134ba4b9ccac337886f682', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:40.896872 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce53fb-78ee-47b2-8f5a-b2dab49fd3a1 service cinder] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:40.897557 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce53fb-78ee-47b2-8f5a-b2dab49fd3a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:40.898368 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce53fb-78ee-47b2-8f5a-b2dab49fd3a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:40.931722 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ed3abd-5298-43ba-ba50-565171832217 service cinder] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:40.936304 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:11:40.944370 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ed3abd-5298-43ba-ba50-565171832217 service cinder] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:40.955099 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8ed971-d0e7-4bf0-93a2-59d798aff45b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75135b856134ba4b9ccac337886f682', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:40.955865 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8ed971-d0e7-4bf0-93a2-59d798aff45b service cinder] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:40.956066 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8ed971-d0e7-4bf0-93a2-59d798aff45b service cinder] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:40.956348 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8ed971-d0e7-4bf0-93a2-59d798aff45b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:41.062596 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fce53fb-78ee-47b2-8f5a-b2dab49fd3a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:41.067698 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fce53fb-78ee-47b2-8f5a-b2dab49fd3a1 service cinder] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:41.089696 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8ed971-d0e7-4bf0-93a2-59d798aff45b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:41.091194 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8ed971-d0e7-4bf0-93a2-59d798aff45b service cinder] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:41.101807 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 828/1639] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:11:40 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:11:41.111321 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 812/1640] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:11:40 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 29 02:11:41.344913 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43857711-7578-4608-b1e9-dcd93d4234de None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:41.345576 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43857711-7578-4608-b1e9-dcd93d4234de None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:41.346105 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43857711-7578-4608-b1e9-dcd93d4234de None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:41.349208 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 829/1641] 10.222.0.49 () {54 vars in 961 bytes} [Thu Sep 29 02:11:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:11:41.358669 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ede1c6f-3d88-4500-9377-b661bb34cc83 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:41.358958 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ede1c6f-3d88-4500-9377-b661bb34cc83 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:41.359230 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ede1c6f-3d88-4500-9377-b661bb34cc83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:41.407543 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-9ede1c6f-3d88-4500-9377-b661bb34cc83 None None] MFA Rules not processed for user `f3325a7111d447f4a9cf00c672d5420f`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:41.409687 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-9ede1c6f-3d88-4500-9377-b661bb34cc83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:41.590507 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 813/1642] 10.222.0.49 () {58 vars in 1058 bytes} [Thu Sep 29 02:11:41 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:41.596440 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e59eb-6eca-4963-910d-1b5a816e800a None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:41.596821 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e59eb-6eca-4963-910d-1b5a816e800a None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:41.597060 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e59eb-6eca-4963-910d-1b5a816e800a None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:41.598982 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 830/1643] 10.222.0.49 () {54 vars in 912 bytes} [Thu Sep 29 02:11:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:11:41.604863 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31beb1-b829-4d5a-8b88-786f6a0de686 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:41.605438 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31beb1-b829-4d5a-8b88-786f6a0de686 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:41.605780 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31beb1-b829-4d5a-8b88-786f6a0de686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:41.669956 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-3c31beb1-b829-4d5a-8b88-786f6a0de686 None None] MFA Rules not processed for user `f3325a7111d447f4a9cf00c672d5420f`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:41.674860 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-3c31beb1-b829-4d5a-8b88-786f6a0de686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:41.710151 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 814/1644] 10.222.0.49 () {58 vars in 1009 bytes} [Thu Sep 29 02:11:41 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:41.744156 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9e59eb-6eca-4963-910d-1b5a816e800a None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:41.765942 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9e59eb-6eca-4963-910d-1b5a816e800a None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:41.775645 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2964b1-752b-4e95-a3e1-aef138f5ffc4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75135b856134ba4b9ccac337886f682', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:41.776274 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2964b1-752b-4e95-a3e1-aef138f5ffc4 service cinder] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:41.780058 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2964b1-752b-4e95-a3e1-aef138f5ffc4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:41.781003 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2964b1-752b-4e95-a3e1-aef138f5ffc4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:41.812092 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2964b1-752b-4e95-a3e1-aef138f5ffc4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:41.814884 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2964b1-752b-4e95-a3e1-aef138f5ffc4 service cinder] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:41.857756 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 831/1645] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:11:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:11:43.707676 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c31beb1-b829-4d5a-8b88-786f6a0de686 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:43.985074 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c31beb1-b829-4d5a-8b88-786f6a0de686 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:44.006608 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa603fce-c20c-43b4-975c-6acea7fc059a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:44.007353 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa603fce-c20c-43b4-975c-6acea7fc059a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:44.007733 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa603fce-c20c-43b4-975c-6acea7fc059a admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:44.008109 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa603fce-c20c-43b4-975c-6acea7fc059a admin admin] PATH_INFO: `/v3/users/f4fddfaae2854f8da663482b4191dec3` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:44.010111 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa603fce-c20c-43b4-975c-6acea7fc059a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4fddfaae2854f8da663482b4191dec3)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:44.011324 dv-cinder-740146-21-smb devstack@keystone.service[81649]: WARNING py.warnings [None req-aa603fce-c20c-43b4-975c-6acea7fc059a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 29 02:11:44.011324 dv-cinder-740146-21-smb devstack@keystone.service[81649]: warnings.warn(msg) Sep 29 02:11:44.011324 dv-cinder-740146-21-smb devstack@keystone.service[81649]: Sep 29 02:11:44.015972 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa603fce-c20c-43b4-975c-6acea7fc059a admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:44.124637 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:11:44.176255 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-aa603fce-c20c-43b4-975c-6acea7fc059a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4fddfaae2854f8da663482b4191dec3'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:44.178751 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-aa603fce-c20c-43b4-975c-6acea7fc059a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4fddfaae2854f8da663482b4191dec3'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:44.246770 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-aa603fce-c20c-43b4-975c-6acea7fc059a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4fddfaae2854f8da663482b4191dec3'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:44.268521 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-aa603fce-c20c-43b4-975c-6acea7fc059a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4fddfaae2854f8da663482b4191dec3'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:44.270918 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-aa603fce-c20c-43b4-975c-6acea7fc059a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4fddfaae2854f8da663482b4191dec3'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:44.330797 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 815/1646] 10.222.0.49 () {58 vars in 1224 bytes} [Thu Sep 29 02:11:43 2022] DELETE /identity/v3/users/f4fddfaae2854f8da663482b4191dec3 => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:11:44.335308 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1304b26c-477e-44c2-b3b1-2d17268cc73a None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:44.335844 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1304b26c-477e-44c2-b3b1-2d17268cc73a None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:44.336064 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1304b26c-477e-44c2-b3b1-2d17268cc73a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:44.349279 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:11:44.406492 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-1304b26c-477e-44c2-b3b1-2d17268cc73a None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:44.406492 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-1304b26c-477e-44c2-b3b1-2d17268cc73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:44.717011 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 832/1647] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:11:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:44.752908 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa603fce-c20c-43b4-975c-6acea7fc059a admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:44.755493 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-aa603fce-c20c-43b4-975c-6acea7fc059a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:45.038857 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa603fce-c20c-43b4-975c-6acea7fc059a admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:45.050639 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85187452-e603-4e3f-8920-5bb7a5c08cb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:45.051289 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85187452-e603-4e3f-8920-5bb7a5c08cb0 service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:45.051571 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85187452-e603-4e3f-8920-5bb7a5c08cb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:45.051843 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85187452-e603-4e3f-8920-5bb7a5c08cb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:45.091343 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85187452-e603-4e3f-8920-5bb7a5c08cb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:45.098509 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85187452-e603-4e3f-8920-5bb7a5c08cb0 service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:45.142632 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 816/1648] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:11:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:11:47.187672 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1304b26c-477e-44c2-b3b1-2d17268cc73a None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:47.190440 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-1304b26c-477e-44c2-b3b1-2d17268cc73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:47.219315 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1304b26c-477e-44c2-b3b1-2d17268cc73a None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:47.238574 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673b58af-4abc-4080-b34f-1c3c13ccc642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:47.239519 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673b58af-4abc-4080-b34f-1c3c13ccc642 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:47.242368 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673b58af-4abc-4080-b34f-1c3c13ccc642 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:47.243192 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673b58af-4abc-4080-b34f-1c3c13ccc642 admin admin] PATH_INFO: `/v3/projects/46addcb5f16048cf89ecaa7cc14816eb` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:47.248664 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673b58af-4abc-4080-b34f-1c3c13ccc642 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46addcb5f16048cf89ecaa7cc14816eb)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:47.250093 dv-cinder-740146-21-smb devstack@keystone.service[81648]: WARNING py.warnings [None req-673b58af-4abc-4080-b34f-1c3c13ccc642 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 29 02:11:47.250093 dv-cinder-740146-21-smb devstack@keystone.service[81648]: warnings.warn(msg) Sep 29 02:11:47.250093 dv-cinder-740146-21-smb devstack@keystone.service[81648]: Sep 29 02:11:47.255944 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673b58af-4abc-4080-b34f-1c3c13ccc642 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:47.594036 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-673b58af-4abc-4080-b34f-1c3c13ccc642 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46addcb5f16048cf89ecaa7cc14816eb', 'request_id': 'req-673b58af-4abc-4080-b34f-1c3c13ccc642'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:47.654874 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-673b58af-4abc-4080-b34f-1c3c13ccc642 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46addcb5f16048cf89ecaa7cc14816eb', 'request_id': 'req-673b58af-4abc-4080-b34f-1c3c13ccc642'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:47.687002 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-673b58af-4abc-4080-b34f-1c3c13ccc642 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46addcb5f16048cf89ecaa7cc14816eb', 'request_id': 'req-673b58af-4abc-4080-b34f-1c3c13ccc642'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:47.725463 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-673b58af-4abc-4080-b34f-1c3c13ccc642 admin admin] The token cache is being invalidate because project 46addcb5f16048cf89ecaa7cc14816eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81648) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:11:47.726138 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-673b58af-4abc-4080-b34f-1c3c13ccc642 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:47.727873 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-673b58af-4abc-4080-b34f-1c3c13ccc642 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:47.736242 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 833/1649] 10.222.0.49 () {58 vars in 1233 bytes} [Thu Sep 29 02:11:47 2022] DELETE /identity/v3/projects/46addcb5f16048cf89ecaa7cc14816eb => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:11:47.737659 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52faab7c-7858-4774-b1dc-da597a896703 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:47.738556 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52faab7c-7858-4774-b1dc-da597a896703 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:47.739246 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52faab7c-7858-4774-b1dc-da597a896703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:47.815896 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-52faab7c-7858-4774-b1dc-da597a896703 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:47.820885 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-52faab7c-7858-4774-b1dc-da597a896703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:48.089824 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 817/1650] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:11:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 29 02:11:48.091843 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cdc9a2-fd99-4dd2-884f-fbc35f6aa284 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:48.093203 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cdc9a2-fd99-4dd2-884f-fbc35f6aa284 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:48.093741 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cdc9a2-fd99-4dd2-884f-fbc35f6aa284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:48.161379 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-f5cdc9a2-fd99-4dd2-884f-fbc35f6aa284 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:48.162927 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-f5cdc9a2-fd99-4dd2-884f-fbc35f6aa284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:48.192421 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 834/1651] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:11:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:48.193890 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52faab7c-7858-4774-b1dc-da597a896703 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:48.210386 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52faab7c-7858-4774-b1dc-da597a896703 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:48.232978 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcefe4a-e1de-4e03-a68e-b96a50f12d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:48.233625 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcefe4a-e1de-4e03-a68e-b96a50f12d1f admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:48.233908 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcefe4a-e1de-4e03-a68e-b96a50f12d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:48.234208 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcefe4a-e1de-4e03-a68e-b96a50f12d1f admin admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:48.236891 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcefe4a-e1de-4e03-a68e-b96a50f12d1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:11:48.237200 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcefe4a-e1de-4e03-a68e-b96a50f12d1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:48.242915 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcefe4a-e1de-4e03-a68e-b96a50f12d1f admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:48.300221 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 818/1652] 10.222.0.49 () {58 vars in 1153 bytes} [Thu Sep 29 02:11:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:11:48.303717 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cdc9a2-fd99-4dd2-884f-fbc35f6aa284 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:48.339673 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cdc9a2-fd99-4dd2-884f-fbc35f6aa284 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:48.367965 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3fe350-a7d9-416b-8839-723c32241ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:48.369395 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3fe350-a7d9-416b-8839-723c32241ee1 admin admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:48.370271 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3fe350-a7d9-416b-8839-723c32241ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:48.371255 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3fe350-a7d9-416b-8839-723c32241ee1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:48.373563 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3fe350-a7d9-416b-8839-723c32241ee1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:48.378740 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3fe350-a7d9-416b-8839-723c32241ee1 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:48.514938 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcefe4a-e1de-4e03-a68e-b96a50f12d1f admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:48.518296 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 835/1653] 10.222.0.49 () {60 vars in 1153 bytes} [Thu Sep 29 02:11:48 2022] POST /identity/v3/projects => generated 373 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:11:48.545049 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcefe4a-e1de-4e03-a68e-b96a50f12d1f admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:48.717443 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:11:48.817042 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5996e09c-ef57-4d13-b5fe-70e92beaac53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:48.817709 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5996e09c-ef57-4d13-b5fe-70e92beaac53 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:48.818149 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5996e09c-ef57-4d13-b5fe-70e92beaac53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:48.819355 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5996e09c-ef57-4d13-b5fe-70e92beaac53 admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:48.820138 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5996e09c-ef57-4d13-b5fe-70e92beaac53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:48.827659 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5996e09c-ef57-4d13-b5fe-70e92beaac53 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:48.920574 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3fe350-a7d9-416b-8839-723c32241ee1 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:48.921492 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 819/1654] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 02:11:48 2022] POST /identity/v3/users => generated 287 bytes in 407 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:11:48.941230 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3fe350-a7d9-416b-8839-723c32241ee1 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:48.955612 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b028d225-2faf-4619-ae53-3d502a2344ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:48.956810 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028d225-2faf-4619-ae53-3d502a2344ff admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:48.958952 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028d225-2faf-4619-ae53-3d502a2344ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:48.959960 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028d225-2faf-4619-ae53-3d502a2344ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:48.962838 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b028d225-2faf-4619-ae53-3d502a2344ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:48.978866 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b028d225-2faf-4619-ae53-3d502a2344ff admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:49.017543 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 836/1655] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:11:48 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:11:49.019624 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5996e09c-ef57-4d13-b5fe-70e92beaac53 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:49.031195 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5996e09c-ef57-4d13-b5fe-70e92beaac53 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:49.063640 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a987b-8c90-48b6-bd30-7a8be783384e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:49.064210 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a987b-8c90-48b6-bd30-7a8be783384e admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:49.064489 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a987b-8c90-48b6-bd30-7a8be783384e admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:49.072769 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a987b-8c90-48b6-bd30-7a8be783384e admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:49.078846 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9a987b-8c90-48b6-bd30-7a8be783384e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:49.080636 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9a987b-8c90-48b6-bd30-7a8be783384e admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:49.119817 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 820/1656] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:11:49 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:11:49.120250 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b028d225-2faf-4619-ae53-3d502a2344ff admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:49.130445 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b028d225-2faf-4619-ae53-3d502a2344ff admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:49.169371 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab9aa0d-187b-4e7b-b7bd-a74f02735426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:49.170080 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab9aa0d-187b-4e7b-b7bd-a74f02735426 admin admin] REQUEST_METHOD: `PUT` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:49.170357 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab9aa0d-187b-4e7b-b7bd-a74f02735426 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:49.172401 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab9aa0d-187b-4e7b-b7bd-a74f02735426 admin admin] PATH_INFO: `/v3/projects/359107a5c1714262aa3f85a9f1c60f3c/users/41a442c666bb4f30b9cf86d06a293521/roles/f157f905c9c94ccfbfb46e52d443e8f2` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:49.228339 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab9aa0d-187b-4e7b-b7bd-a74f02735426 admin admin] RBAC: Authorizing `identity:create_grant(project_id=359107a5c1714262aa3f85a9f1c60f3c, user_id=41a442c666bb4f30b9cf86d06a293521, role_id=f157f905c9c94ccfbfb46e52d443e8f2)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:49.240273 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab9aa0d-187b-4e7b-b7bd-a74f02735426 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:49.282216 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 837/1657] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:11:49 2022] PUT /identity/v3/projects/359107a5c1714262aa3f85a9f1c60f3c/users/41a442c666bb4f30b9cf86d06a293521/roles/f157f905c9c94ccfbfb46e52d443e8f2 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:11:49.294591 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d184a7-72f5-49bf-bd3a-7aadf240e66e None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:49.295374 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d184a7-72f5-49bf-bd3a-7aadf240e66e None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:49.296004 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d184a7-72f5-49bf-bd3a-7aadf240e66e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:49.369767 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-b3d184a7-72f5-49bf-bd3a-7aadf240e66e None None] MFA Rules not processed for user `41a442c666bb4f30b9cf86d06a293521`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:49.373666 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-b3d184a7-72f5-49bf-bd3a-7aadf240e66e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:49.481806 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab9aa0d-187b-4e7b-b7bd-a74f02735426 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:49.484192 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-8ab9aa0d-187b-4e7b-b7bd-a74f02735426 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:49.545065 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:11:49.546995 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 821/1658] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:11:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:49.551678 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d184a7-72f5-49bf-bd3a-7aadf240e66e None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:49.686447 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab9aa0d-187b-4e7b-b7bd-a74f02735426 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:49.704738 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70d7d12-a1ee-4f7b-b18a-c261768a9ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:49.706105 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70d7d12-a1ee-4f7b-b18a-c261768a9ef9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:49.707200 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70d7d12-a1ee-4f7b-b18a-c261768a9ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:49.707782 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70d7d12-a1ee-4f7b-b18a-c261768a9ef9 admin admin] PATH_INFO: `/v3/users/0adecdbf28a949c48ac62bdb012bfac3` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:49.718084 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70d7d12-a1ee-4f7b-b18a-c261768a9ef9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0adecdbf28a949c48ac62bdb012bfac3)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:49.730268 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70d7d12-a1ee-4f7b-b18a-c261768a9ef9 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:49.782245 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d184a7-72f5-49bf-bd3a-7aadf240e66e None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:49.799087 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5a1a0b-b59e-4f74-be7f-f29f52a4ede7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:49.801760 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a1a0b-b59e-4f74-be7f-f29f52a4ede7 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:49.802460 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a1a0b-b59e-4f74-be7f-f29f52a4ede7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:49.802996 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a1a0b-b59e-4f74-be7f-f29f52a4ede7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:49.805285 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5a1a0b-b59e-4f74-be7f-f29f52a4ede7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:49.811233 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5a1a0b-b59e-4f74-be7f-f29f52a4ede7 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:49.910629 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 822/1659] 10.222.0.49 () {60 vars in 1153 bytes} [Thu Sep 29 02:11:49 2022] POST /identity/v3/projects => generated 373 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:11:49.911772 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-a70d7d12-a1ee-4f7b-b18a-c261768a9ef9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0adecdbf28a949c48ac62bdb012bfac3'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:49.912515 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-a70d7d12-a1ee-4f7b-b18a-c261768a9ef9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0adecdbf28a949c48ac62bdb012bfac3'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:49.914329 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5a1a0b-b59e-4f74-be7f-f29f52a4ede7 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:49.916731 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-5c5a1a0b-b59e-4f74-be7f-f29f52a4ede7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:49.965926 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-a70d7d12-a1ee-4f7b-b18a-c261768a9ef9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0adecdbf28a949c48ac62bdb012bfac3'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:50.005201 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-a70d7d12-a1ee-4f7b-b18a-c261768a9ef9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0adecdbf28a949c48ac62bdb012bfac3'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:50.009979 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-a70d7d12-a1ee-4f7b-b18a-c261768a9ef9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0adecdbf28a949c48ac62bdb012bfac3'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:50.047111 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 838/1660] 10.222.0.49 () {58 vars in 1224 bytes} [Thu Sep 29 02:11:49 2022] DELETE /identity/v3/users/0adecdbf28a949c48ac62bdb012bfac3 => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:11:50.051445 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e8566-bd1b-421f-928e-4533eec747a4 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:50.051887 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e8566-bd1b-421f-928e-4533eec747a4 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:50.052930 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e8566-bd1b-421f-928e-4533eec747a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:50.058280 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:11:50.113638 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-651e8566-bd1b-421f-928e-4533eec747a4 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:50.115085 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-651e8566-bd1b-421f-928e-4533eec747a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:50.181737 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5a1a0b-b59e-4f74-be7f-f29f52a4ede7 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:50.311398 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 839/1661] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:11:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:50.314585 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3288ea-c743-46ae-867c-2b28efe80eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:50.315226 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3288ea-c743-46ae-867c-2b28efe80eb4 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:50.315581 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3288ea-c743-46ae-867c-2b28efe80eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:50.315938 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3288ea-c743-46ae-867c-2b28efe80eb4 admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:50.317623 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3288ea-c743-46ae-867c-2b28efe80eb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:50.319841 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3288ea-c743-46ae-867c-2b28efe80eb4 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:50.335051 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651e8566-bd1b-421f-928e-4533eec747a4 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:50.337710 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-651e8566-bd1b-421f-928e-4533eec747a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:50.373910 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 823/1662] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 02:11:49 2022] POST /identity/v3/users => generated 293 bytes in 460 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:11:50.378893 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3288ea-c743-46ae-867c-2b28efe80eb4 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:50.415223 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3288ea-c743-46ae-867c-2b28efe80eb4 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:50.436185 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf84eb8-70a9-47b0-991d-2a384f0c991a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:50.436936 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf84eb8-70a9-47b0-991d-2a384f0c991a admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:50.437214 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf84eb8-70a9-47b0-991d-2a384f0c991a admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:50.437508 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf84eb8-70a9-47b0-991d-2a384f0c991a admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:50.440165 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf84eb8-70a9-47b0-991d-2a384f0c991a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:50.448583 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf84eb8-70a9-47b0-991d-2a384f0c991a admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:50.489098 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 824/1663] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:11:50 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:11:50.489511 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:11:50.492346 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf84eb8-70a9-47b0-991d-2a384f0c991a admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:50.521104 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf84eb8-70a9-47b0-991d-2a384f0c991a admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:50.525629 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651e8566-bd1b-421f-928e-4533eec747a4 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:50.532014 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28620908-59bf-4867-a475-d62a2dff1e6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:50.532864 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28620908-59bf-4867-a475-d62a2dff1e6b service neutron] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:50.533338 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28620908-59bf-4867-a475-d62a2dff1e6b service neutron] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:50.534582 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28620908-59bf-4867-a475-d62a2dff1e6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:50.539104 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cddab21-562a-46ff-bb0b-7d21b60a742c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:50.539768 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cddab21-562a-46ff-bb0b-7d21b60a742c admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:50.540068 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cddab21-562a-46ff-bb0b-7d21b60a742c admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:50.540696 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cddab21-562a-46ff-bb0b-7d21b60a742c admin admin] PATH_INFO: `/v3/projects/61bb7933e7f8451f88293c30b360c7bb/users/1ea7c1b36dff4d4eafbd579460622c7d/roles/fe9bbc67742f4f5893f39b18eb31d59a` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:50.554899 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28620908-59bf-4867-a475-d62a2dff1e6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:50.560126 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28620908-59bf-4867-a475-d62a2dff1e6b service neutron] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:50.596425 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cddab21-562a-46ff-bb0b-7d21b60a742c admin admin] RBAC: Authorizing `identity:create_grant(project_id=61bb7933e7f8451f88293c30b360c7bb, user_id=1ea7c1b36dff4d4eafbd579460622c7d, role_id=fe9bbc67742f4f5893f39b18eb31d59a)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:50.603260 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cddab21-562a-46ff-bb0b-7d21b60a742c admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:50.605718 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 840/1664] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:11:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:11:50.659948 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 825/1665] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:11:50 2022] PUT /identity/v3/projects/61bb7933e7f8451f88293c30b360c7bb/users/1ea7c1b36dff4d4eafbd579460622c7d/roles/fe9bbc67742f4f5893f39b18eb31d59a => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:11:50.665103 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28620908-59bf-4867-a475-d62a2dff1e6b service neutron] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:50.698566 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28620908-59bf-4867-a475-d62a2dff1e6b service neutron] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:50.847772 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abed277-3d25-4af7-96bf-5e3d795ec96c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:50.848429 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abed277-3d25-4af7-96bf-5e3d795ec96c admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:50.848710 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abed277-3d25-4af7-96bf-5e3d795ec96c admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:50.848982 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abed277-3d25-4af7-96bf-5e3d795ec96c admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:50.850671 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abed277-3d25-4af7-96bf-5e3d795ec96c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:50.857057 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abed277-3d25-4af7-96bf-5e3d795ec96c admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:50.876218 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 841/1666] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:11:50 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:11:50.880674 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cddab21-562a-46ff-bb0b-7d21b60a742c admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:50.895467 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cddab21-562a-46ff-bb0b-7d21b60a742c admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:50.923294 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71cc06f-013f-49f9-beb5-71ca96c24e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:50.926119 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71cc06f-013f-49f9-beb5-71ca96c24e6a admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:50.927812 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71cc06f-013f-49f9-beb5-71ca96c24e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:50.931703 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71cc06f-013f-49f9-beb5-71ca96c24e6a admin admin] PATH_INFO: `/v3/projects/61bb7933e7f8451f88293c30b360c7bb/users/1ea7c1b36dff4d4eafbd579460622c7d/roles/fe9bbc67742f4f5893f39b18eb31d59a` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:50.941681 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71cc06f-013f-49f9-beb5-71ca96c24e6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=61bb7933e7f8451f88293c30b360c7bb, user_id=1ea7c1b36dff4d4eafbd579460622c7d, role_id=fe9bbc67742f4f5893f39b18eb31d59a)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:50.954239 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71cc06f-013f-49f9-beb5-71ca96c24e6a admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:50.965876 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abed277-3d25-4af7-96bf-5e3d795ec96c admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:50.967965 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-5abed277-3d25-4af7-96bf-5e3d795ec96c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:50.993368 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 826/1667] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:11:50 2022] PUT /identity/v3/projects/61bb7933e7f8451f88293c30b360c7bb/users/1ea7c1b36dff4d4eafbd579460622c7d/roles/fe9bbc67742f4f5893f39b18eb31d59a => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:11:51.001084 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0415187-a921-4247-80f4-ebdc6b81750e None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:51.001596 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0415187-a921-4247-80f4-ebdc6b81750e None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:51.002041 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0415187-a921-4247-80f4-ebdc6b81750e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:51.002524 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abed277-3d25-4af7-96bf-5e3d795ec96c admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:51.090730 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1596203-c03f-4ebb-a912-34e0e716398d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:51.091391 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1596203-c03f-4ebb-a912-34e0e716398d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:51.091678 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1596203-c03f-4ebb-a912-34e0e716398d admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:51.092329 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1596203-c03f-4ebb-a912-34e0e716398d admin admin] PATH_INFO: `/v3/users/d5f7e17eb44b43048a2009358a69466c` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:51.093693 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1596203-c03f-4ebb-a912-34e0e716398d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5f7e17eb44b43048a2009358a69466c)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:51.096317 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1596203-c03f-4ebb-a912-34e0e716398d admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:51.109150 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-d0415187-a921-4247-80f4-ebdc6b81750e None None] MFA Rules not processed for user `1ea7c1b36dff4d4eafbd579460622c7d`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:51.111009 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-d0415187-a921-4247-80f4-ebdc6b81750e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:51.219886 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-e1596203-c03f-4ebb-a912-34e0e716398d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5f7e17eb44b43048a2009358a69466c'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:51.223817 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-e1596203-c03f-4ebb-a912-34e0e716398d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5f7e17eb44b43048a2009358a69466c'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:51.261589 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-e1596203-c03f-4ebb-a912-34e0e716398d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5f7e17eb44b43048a2009358a69466c'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:51.279092 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-e1596203-c03f-4ebb-a912-34e0e716398d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5f7e17eb44b43048a2009358a69466c'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:51.279941 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-e1596203-c03f-4ebb-a912-34e0e716398d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5f7e17eb44b43048a2009358a69466c'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:51.301653 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:11:51.329891 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 842/1668] 10.222.0.49 () {58 vars in 1224 bytes} [Thu Sep 29 02:11:50 2022] DELETE /identity/v3/users/d5f7e17eb44b43048a2009358a69466c => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:11:51.333773 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40662f0b-104e-4fd9-bc8c-b8653140a9e4 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:51.336925 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40662f0b-104e-4fd9-bc8c-b8653140a9e4 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:51.338129 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40662f0b-104e-4fd9-bc8c-b8653140a9e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:51.357092 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 827/1669] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:11:50 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 29 02:11:51.369602 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0415187-a921-4247-80f4-ebdc6b81750e None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:51.371646 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-d0415187-a921-4247-80f4-ebdc6b81750e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:51.380715 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:11:51.403624 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-40662f0b-104e-4fd9-bc8c-b8653140a9e4 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:51.405875 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-40662f0b-104e-4fd9-bc8c-b8653140a9e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:51.504702 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0415187-a921-4247-80f4-ebdc6b81750e None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:51.555195 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 843/1670] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:11:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:51.591029 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1020ec7-75f1-4af3-b075-8d495760b092 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75135b856134ba4b9ccac337886f682', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:51.592171 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1020ec7-75f1-4af3-b075-8d495760b092 service cinder] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:51.592691 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1020ec7-75f1-4af3-b075-8d495760b092 service cinder] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:51.593167 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1020ec7-75f1-4af3-b075-8d495760b092 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:51.681539 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1020ec7-75f1-4af3-b075-8d495760b092 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:51.684977 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1020ec7-75f1-4af3-b075-8d495760b092 service cinder] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:51.707344 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40662f0b-104e-4fd9-bc8c-b8653140a9e4 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:51.710937 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-40662f0b-104e-4fd9-bc8c-b8653140a9e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:51.725017 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 828/1671] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:11:51 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 29 02:11:51.827095 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1020ec7-75f1-4af3-b075-8d495760b092 service cinder] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:51.828803 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-c1020ec7-75f1-4af3-b075-8d495760b092 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:51.859774 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1020ec7-75f1-4af3-b075-8d495760b092 service cinder] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:51.883024 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36793c2b-db34-4e47-9d08-1598fd47c53d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:51.884551 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36793c2b-db34-4e47-9d08-1598fd47c53d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:51.886279 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36793c2b-db34-4e47-9d08-1598fd47c53d admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:51.886771 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36793c2b-db34-4e47-9d08-1598fd47c53d admin admin] PATH_INFO: `/v3/projects/47888d7711c64be18ca04d3179c3f022` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:51.889971 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36793c2b-db34-4e47-9d08-1598fd47c53d admin admin] RBAC: Authorizing `identity:delete_project(project_id=47888d7711c64be18ca04d3179c3f022)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:51.894109 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36793c2b-db34-4e47-9d08-1598fd47c53d admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:51.897033 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40662f0b-104e-4fd9-bc8c-b8653140a9e4 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:51.902912 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1ca3a1-9c3b-42ee-8f91-e1f7040e4562 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:51.903700 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1ca3a1-9c3b-42ee-8f91-e1f7040e4562 service neutron] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:51.904244 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1ca3a1-9c3b-42ee-8f91-e1f7040e4562 service neutron] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:51.904791 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1ca3a1-9c3b-42ee-8f91-e1f7040e4562 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:51.928118 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1ca3a1-9c3b-42ee-8f91-e1f7040e4562 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:51.930104 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1ca3a1-9c3b-42ee-8f91-e1f7040e4562 service neutron] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:51.951655 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 844/1672] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:11:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:11:51.953109 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fbdabc-dc69-4d57-864d-7bf301541dad None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:51.953563 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fbdabc-dc69-4d57-864d-7bf301541dad None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:51.953953 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fbdabc-dc69-4d57-864d-7bf301541dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:52.027849 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-36793c2b-db34-4e47-9d08-1598fd47c53d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47888d7711c64be18ca04d3179c3f022', 'request_id': 'req-36793c2b-db34-4e47-9d08-1598fd47c53d'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:52.039164 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-36793c2b-db34-4e47-9d08-1598fd47c53d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47888d7711c64be18ca04d3179c3f022', 'request_id': 'req-36793c2b-db34-4e47-9d08-1598fd47c53d'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:52.049162 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-28fbdabc-dc69-4d57-864d-7bf301541dad None None] MFA Rules not processed for user `f68a35fdeeea469f873ec50671fc35f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:52.052255 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-28fbdabc-dc69-4d57-864d-7bf301541dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:52.058968 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-36793c2b-db34-4e47-9d08-1598fd47c53d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47888d7711c64be18ca04d3179c3f022', 'request_id': 'req-36793c2b-db34-4e47-9d08-1598fd47c53d'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:52.062188 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:11:52.087097 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-36793c2b-db34-4e47-9d08-1598fd47c53d admin admin] The token cache is being invalidate because project 47888d7711c64be18ca04d3179c3f022 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81649) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:11:52.087413 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-36793c2b-db34-4e47-9d08-1598fd47c53d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:52.088053 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-36793c2b-db34-4e47-9d08-1598fd47c53d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:52.093102 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 829/1673] 10.222.0.49 () {58 vars in 1233 bytes} [Thu Sep 29 02:11:51 2022] DELETE /identity/v3/projects/47888d7711c64be18ca04d3179c3f022 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:11:52.095330 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36793c2b-db34-4e47-9d08-1598fd47c53d admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:52.096815 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-36793c2b-db34-4e47-9d08-1598fd47c53d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:52.270282 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 845/1674] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:11:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:52.271291 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fbdabc-dc69-4d57-864d-7bf301541dad None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:52.272698 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-28fbdabc-dc69-4d57-864d-7bf301541dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:52.333360 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36793c2b-db34-4e47-9d08-1598fd47c53d admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:52.347508 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f1df7d-7072-4026-844f-d5899df4fa78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:52.348212 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f1df7d-7072-4026-844f-d5899df4fa78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:52.350438 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f1df7d-7072-4026-844f-d5899df4fa78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:52.350805 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f1df7d-7072-4026-844f-d5899df4fa78 admin admin] PATH_INFO: `/v3/users/8d26dc5c3dcb428aacecf5a9fec88d7a` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:52.355011 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f1df7d-7072-4026-844f-d5899df4fa78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d26dc5c3dcb428aacecf5a9fec88d7a)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:52.359159 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f1df7d-7072-4026-844f-d5899df4fa78 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:52.408022 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:11:52.474910 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fbdabc-dc69-4d57-864d-7bf301541dad None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:52.510341 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-32f1df7d-7072-4026-844f-d5899df4fa78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d26dc5c3dcb428aacecf5a9fec88d7a'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:52.512882 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-32f1df7d-7072-4026-844f-d5899df4fa78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d26dc5c3dcb428aacecf5a9fec88d7a'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:52.513822 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860580f7-d984-4988-bd9f-8e3a5b9b2ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:52.514668 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860580f7-d984-4988-bd9f-8e3a5b9b2ed4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:52.515793 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860580f7-d984-4988-bd9f-8e3a5b9b2ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:52.517339 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860580f7-d984-4988-bd9f-8e3a5b9b2ed4 admin admin] PATH_INFO: `/v3/users/eea7e0dc2ad248ad8ccf570c1de61b86` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:52.521703 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860580f7-d984-4988-bd9f-8e3a5b9b2ed4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eea7e0dc2ad248ad8ccf570c1de61b86)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:52.531519 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860580f7-d984-4988-bd9f-8e3a5b9b2ed4 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:52.573962 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-32f1df7d-7072-4026-844f-d5899df4fa78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d26dc5c3dcb428aacecf5a9fec88d7a'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:52.599671 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-32f1df7d-7072-4026-844f-d5899df4fa78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d26dc5c3dcb428aacecf5a9fec88d7a'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:52.607296 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-32f1df7d-7072-4026-844f-d5899df4fa78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d26dc5c3dcb428aacecf5a9fec88d7a'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:52.644810 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 830/1675] 10.222.0.49 () {58 vars in 1224 bytes} [Thu Sep 29 02:11:52 2022] DELETE /identity/v3/users/8d26dc5c3dcb428aacecf5a9fec88d7a => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:11:52.644810 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f1df7d-7072-4026-844f-d5899df4fa78 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:52.648769 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-32f1df7d-7072-4026-844f-d5899df4fa78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:52.653417 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-860580f7-d984-4988-bd9f-8e3a5b9b2ed4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eea7e0dc2ad248ad8ccf570c1de61b86'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:52.653726 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-860580f7-d984-4988-bd9f-8e3a5b9b2ed4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eea7e0dc2ad248ad8ccf570c1de61b86'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:52.696172 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-860580f7-d984-4988-bd9f-8e3a5b9b2ed4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eea7e0dc2ad248ad8ccf570c1de61b86'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:52.738077 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-860580f7-d984-4988-bd9f-8e3a5b9b2ed4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eea7e0dc2ad248ad8ccf570c1de61b86'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:52.739449 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-860580f7-d984-4988-bd9f-8e3a5b9b2ed4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eea7e0dc2ad248ad8ccf570c1de61b86'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:52.774321 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 846/1676] 10.222.0.49 () {58 vars in 1224 bytes} [Thu Sep 29 02:11:52 2022] DELETE /identity/v3/users/eea7e0dc2ad248ad8ccf570c1de61b86 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:11:52.774321 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860580f7-d984-4988-bd9f-8e3a5b9b2ed4 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:52.774321 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-860580f7-d984-4988-bd9f-8e3a5b9b2ed4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:52.828970 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f1df7d-7072-4026-844f-d5899df4fa78 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:52.843164 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:11:52.971505 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860580f7-d984-4988-bd9f-8e3a5b9b2ed4 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:52.987466 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4787808d-0e76-459c-8e79-a55987aa99f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:52.988267 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4787808d-0e76-459c-8e79-a55987aa99f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:52.988607 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4787808d-0e76-459c-8e79-a55987aa99f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:52.989164 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4787808d-0e76-459c-8e79-a55987aa99f3 admin admin] PATH_INFO: `/v3/users/41a442c666bb4f30b9cf86d06a293521` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:52.990429 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4787808d-0e76-459c-8e79-a55987aa99f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41a442c666bb4f30b9cf86d06a293521)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:52.992746 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4787808d-0e76-459c-8e79-a55987aa99f3 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:53.002065 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362649ed-8254-4ff6-ab02-652402adc51b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3325a7111d447f4a9cf00c672d5420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:53.003260 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362649ed-8254-4ff6-ab02-652402adc51b service nova] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:53.003706 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362649ed-8254-4ff6-ab02-652402adc51b service nova] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:53.003988 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362649ed-8254-4ff6-ab02-652402adc51b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:53.008441 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-362649ed-8254-4ff6-ab02-652402adc51b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:53.145852 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-4787808d-0e76-459c-8e79-a55987aa99f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41a442c666bb4f30b9cf86d06a293521'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:53.146698 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-4787808d-0e76-459c-8e79-a55987aa99f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41a442c666bb4f30b9cf86d06a293521'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:53.161293 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:11:53.162015 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362649ed-8254-4ff6-ab02-652402adc51b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:53.168183 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362649ed-8254-4ff6-ab02-652402adc51b service nova] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:53.186945 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-4787808d-0e76-459c-8e79-a55987aa99f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41a442c666bb4f30b9cf86d06a293521'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:53.204210 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-4787808d-0e76-459c-8e79-a55987aa99f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41a442c666bb4f30b9cf86d06a293521'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:53.204947 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-4787808d-0e76-459c-8e79-a55987aa99f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41a442c666bb4f30b9cf86d06a293521'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:53.212470 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 831/1677] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:11:52 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 569 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:11:53.218046 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80e4b83-4d68-49e6-baa5-e562c4bd1c33 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:53.220588 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80e4b83-4d68-49e6-baa5-e562c4bd1c33 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:53.220874 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80e4b83-4d68-49e6-baa5-e562c4bd1c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:53.237528 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 847/1678] 10.222.0.49 () {58 vars in 1224 bytes} [Thu Sep 29 02:11:52 2022] DELETE /identity/v3/users/41a442c666bb4f30b9cf86d06a293521 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:11:53.242099 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99e2774-34af-48cc-8596-998fc1843fb2 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:53.242887 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99e2774-34af-48cc-8596-998fc1843fb2 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:53.243387 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99e2774-34af-48cc-8596-998fc1843fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:53.296548 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-d80e4b83-4d68-49e6-baa5-e562c4bd1c33 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:53.298633 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-d80e4b83-4d68-49e6-baa5-e562c4bd1c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:53.319428 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-f99e2774-34af-48cc-8596-998fc1843fb2 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:53.327151 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-f99e2774-34af-48cc-8596-998fc1843fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:53.462863 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 832/1679] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:11:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:53.491874 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80e4b83-4d68-49e6-baa5-e562c4bd1c33 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:53.493882 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-d80e4b83-4d68-49e6-baa5-e562c4bd1c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:53.500822 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 848/1680] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:11:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:53.540956 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99e2774-34af-48cc-8596-998fc1843fb2 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:53.543246 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-f99e2774-34af-48cc-8596-998fc1843fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:53.604958 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:11:53.623877 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80e4b83-4d68-49e6-baa5-e562c4bd1c33 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:53.634197 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b67836-f7ba-4de1-bd03-00d3c5bf75f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:53.637340 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b67836-f7ba-4de1-bd03-00d3c5bf75f6 service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:53.637726 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b67836-f7ba-4de1-bd03-00d3c5bf75f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:53.639405 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b67836-f7ba-4de1-bd03-00d3c5bf75f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:53.639840 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99e2774-34af-48cc-8596-998fc1843fb2 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:53.652864 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b7057e-5632-4d78-b90a-22b1987399c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:53.653622 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b7057e-5632-4d78-b90a-22b1987399c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:53.653955 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b7057e-5632-4d78-b90a-22b1987399c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:53.654355 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b7057e-5632-4d78-b90a-22b1987399c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:53.664229 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b67836-f7ba-4de1-bd03-00d3c5bf75f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:53.665944 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b67836-f7ba-4de1-bd03-00d3c5bf75f6 service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:53.680612 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b7057e-5632-4d78-b90a-22b1987399c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:53.682285 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b7057e-5632-4d78-b90a-22b1987399c9 service neutron] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:53.696172 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 833/1681] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:11:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:11:53.701173 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 849/1682] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:11:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:11:54.468860 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b67836-f7ba-4de1-bd03-00d3c5bf75f6 service neutron] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:54.470420 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-76b67836-f7ba-4de1-bd03-00d3c5bf75f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:54.493513 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b67836-f7ba-4de1-bd03-00d3c5bf75f6 service neutron] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:54.506078 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca131aab-3330-43c5-a6d7-5cb3ae5c91bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:54.507495 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca131aab-3330-43c5-a6d7-5cb3ae5c91bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:54.508381 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca131aab-3330-43c5-a6d7-5cb3ae5c91bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:54.508890 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca131aab-3330-43c5-a6d7-5cb3ae5c91bb admin admin] PATH_INFO: `/v3/projects/c6f0464ff4cf4b8cbf41dcf993ff9bee` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:54.512960 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca131aab-3330-43c5-a6d7-5cb3ae5c91bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6f0464ff4cf4b8cbf41dcf993ff9bee)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:54.515082 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca131aab-3330-43c5-a6d7-5cb3ae5c91bb admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:54.601994 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b7057e-5632-4d78-b90a-22b1987399c9 service neutron] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:54.605092 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-c5b7057e-5632-4d78-b90a-22b1987399c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:54.624857 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b7057e-5632-4d78-b90a-22b1987399c9 service neutron] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:54.632117 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-ca131aab-3330-43c5-a6d7-5cb3ae5c91bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6f0464ff4cf4b8cbf41dcf993ff9bee', 'request_id': 'req-ca131aab-3330-43c5-a6d7-5cb3ae5c91bb'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:54.658932 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-ca131aab-3330-43c5-a6d7-5cb3ae5c91bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6f0464ff4cf4b8cbf41dcf993ff9bee', 'request_id': 'req-ca131aab-3330-43c5-a6d7-5cb3ae5c91bb'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:54.677286 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-ca131aab-3330-43c5-a6d7-5cb3ae5c91bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6f0464ff4cf4b8cbf41dcf993ff9bee', 'request_id': 'req-ca131aab-3330-43c5-a6d7-5cb3ae5c91bb'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:54.732730 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-ca131aab-3330-43c5-a6d7-5cb3ae5c91bb admin admin] The token cache is being invalidate because project c6f0464ff4cf4b8cbf41dcf993ff9bee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81649) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:11:54.733732 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-ca131aab-3330-43c5-a6d7-5cb3ae5c91bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:54.735718 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-ca131aab-3330-43c5-a6d7-5cb3ae5c91bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:54.745704 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 834/1683] 10.222.0.49 () {58 vars in 1233 bytes} [Thu Sep 29 02:11:54 2022] DELETE /identity/v3/projects/c6f0464ff4cf4b8cbf41dcf993ff9bee => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:11:54.748388 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca131aab-3330-43c5-a6d7-5cb3ae5c91bb admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:54.759681 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-ca131aab-3330-43c5-a6d7-5cb3ae5c91bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:54.875122 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71c62a8-6b1e-41c8-b49d-d15735b5bdfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:54.875434 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71c62a8-6b1e-41c8-b49d-d15735b5bdfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:54.875719 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71c62a8-6b1e-41c8-b49d-d15735b5bdfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:54.876136 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71c62a8-6b1e-41c8-b49d-d15735b5bdfc admin admin] PATH_INFO: `/v3/projects/4268cd859828434f9a646ba7d24e6402` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:54.877878 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71c62a8-6b1e-41c8-b49d-d15735b5bdfc admin admin] RBAC: Authorizing `identity:delete_project(project_id=4268cd859828434f9a646ba7d24e6402)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:54.884291 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71c62a8-6b1e-41c8-b49d-d15735b5bdfc admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:54.925888 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:11:54.971592 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca131aab-3330-43c5-a6d7-5cb3ae5c91bb admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:55.036618 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-c71c62a8-6b1e-41c8-b49d-d15735b5bdfc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4268cd859828434f9a646ba7d24e6402', 'request_id': 'req-c71c62a8-6b1e-41c8-b49d-d15735b5bdfc'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:55.062853 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-c71c62a8-6b1e-41c8-b49d-d15735b5bdfc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4268cd859828434f9a646ba7d24e6402', 'request_id': 'req-c71c62a8-6b1e-41c8-b49d-d15735b5bdfc'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:55.109968 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-c71c62a8-6b1e-41c8-b49d-d15735b5bdfc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4268cd859828434f9a646ba7d24e6402', 'request_id': 'req-c71c62a8-6b1e-41c8-b49d-d15735b5bdfc'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:55.176731 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-c71c62a8-6b1e-41c8-b49d-d15735b5bdfc admin admin] The token cache is being invalidate because project 4268cd859828434f9a646ba7d24e6402 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81648) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:11:55.184515 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-c71c62a8-6b1e-41c8-b49d-d15735b5bdfc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:55.187681 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-c71c62a8-6b1e-41c8-b49d-d15735b5bdfc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:55.193968 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 850/1684] 10.222.0.49 () {58 vars in 1233 bytes} [Thu Sep 29 02:11:54 2022] DELETE /identity/v3/projects/4268cd859828434f9a646ba7d24e6402 => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:11:55.197993 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d135403-179d-4b5e-a572-9a3a36a81cac None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:55.197993 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d135403-179d-4b5e-a572-9a3a36a81cac None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:55.197993 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d135403-179d-4b5e-a572-9a3a36a81cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:55.303145 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b53a3ac-b4ef-4b96-a225-c9decc019caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:55.303815 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b53a3ac-b4ef-4b96-a225-c9decc019caf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:55.304095 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b53a3ac-b4ef-4b96-a225-c9decc019caf admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:55.304367 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b53a3ac-b4ef-4b96-a225-c9decc019caf admin admin] PATH_INFO: `/v3/users/22a301a4837b4103a1356e4ab8b61d2f` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:55.313749 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b53a3ac-b4ef-4b96-a225-c9decc019caf admin admin] RBAC: Authorizing `identity:delete_user(user_id=22a301a4837b4103a1356e4ab8b61d2f)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:55.321369 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b53a3ac-b4ef-4b96-a225-c9decc019caf admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:55.335115 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-7d135403-179d-4b5e-a572-9a3a36a81cac None None] MFA Rules not processed for user `f167598e4a354a21b89825f2cbe8ff2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:55.336959 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-7d135403-179d-4b5e-a572-9a3a36a81cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:55.424152 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:11:55.503468 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-5b53a3ac-b4ef-4b96-a225-c9decc019caf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22a301a4837b4103a1356e4ab8b61d2f'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:55.511862 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-5b53a3ac-b4ef-4b96-a225-c9decc019caf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22a301a4837b4103a1356e4ab8b61d2f'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:55.569191 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-5b53a3ac-b4ef-4b96-a225-c9decc019caf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22a301a4837b4103a1356e4ab8b61d2f'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:55.592214 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-5b53a3ac-b4ef-4b96-a225-c9decc019caf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22a301a4837b4103a1356e4ab8b61d2f'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:55.594060 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-5b53a3ac-b4ef-4b96-a225-c9decc019caf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22a301a4837b4103a1356e4ab8b61d2f'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:55.634303 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 835/1685] 10.222.0.49 () {58 vars in 1224 bytes} [Thu Sep 29 02:11:54 2022] DELETE /identity/v3/users/22a301a4837b4103a1356e4ab8b61d2f => generated 0 bytes in 888 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:11:55.636898 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 851/1686] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:11:55 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 442 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:55.639029 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3593f3-4b85-47cf-b03d-ac2aa914f258 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:55.639324 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3593f3-4b85-47cf-b03d-ac2aa914f258 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:55.639602 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3593f3-4b85-47cf-b03d-ac2aa914f258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:55.645766 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d135403-179d-4b5e-a572-9a3a36a81cac None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:55.647301 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-7d135403-179d-4b5e-a572-9a3a36a81cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:55.690958 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d135403-179d-4b5e-a572-9a3a36a81cac None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:55.706185 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-bf3593f3-4b85-47cf-b03d-ac2aa914f258 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:55.708984 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-bf3593f3-4b85-47cf-b03d-ac2aa914f258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:55.857244 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86410e53-ed9a-4dc9-b09e-a77616443e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:55.860351 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86410e53-ed9a-4dc9-b09e-a77616443e9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:55.860726 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86410e53-ed9a-4dc9-b09e-a77616443e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:55.869508 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 836/1687] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:11:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:55.870351 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86410e53-ed9a-4dc9-b09e-a77616443e9b admin admin] PATH_INFO: `/v3/projects/be4b4cf1cbfe4040b409e61915d0ba53` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:55.870448 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3593f3-4b85-47cf-b03d-ac2aa914f258 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:55.870519 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86410e53-ed9a-4dc9-b09e-a77616443e9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=be4b4cf1cbfe4040b409e61915d0ba53)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:55.870598 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-bf3593f3-4b85-47cf-b03d-ac2aa914f258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:55.870665 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86410e53-ed9a-4dc9-b09e-a77616443e9b admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:55.883372 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3593f3-4b85-47cf-b03d-ac2aa914f258 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:55.900964 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbb6ddc-8c55-4719-be36-358982c98720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:55.901987 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb6ddc-8c55-4719-be36-358982c98720 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:55.902275 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb6ddc-8c55-4719-be36-358982c98720 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:55.902554 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb6ddc-8c55-4719-be36-358982c98720 admin admin] PATH_INFO: `/v3/projects/359107a5c1714262aa3f85a9f1c60f3c` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:55.906669 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbb6ddc-8c55-4719-be36-358982c98720 admin admin] RBAC: Authorizing `identity:delete_project(project_id=359107a5c1714262aa3f85a9f1c60f3c)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:55.909123 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbb6ddc-8c55-4719-be36-358982c98720 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:55.962420 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:11:55.981740 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-86410e53-ed9a-4dc9-b09e-a77616443e9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be4b4cf1cbfe4040b409e61915d0ba53', 'request_id': 'req-86410e53-ed9a-4dc9-b09e-a77616443e9b'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:56.001591 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-86410e53-ed9a-4dc9-b09e-a77616443e9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be4b4cf1cbfe4040b409e61915d0ba53', 'request_id': 'req-86410e53-ed9a-4dc9-b09e-a77616443e9b'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:56.017691 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-86410e53-ed9a-4dc9-b09e-a77616443e9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be4b4cf1cbfe4040b409e61915d0ba53', 'request_id': 'req-86410e53-ed9a-4dc9-b09e-a77616443e9b'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:56.041004 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-86410e53-ed9a-4dc9-b09e-a77616443e9b admin admin] The token cache is being invalidate because project be4b4cf1cbfe4040b409e61915d0ba53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81648) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:11:56.041944 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-86410e53-ed9a-4dc9-b09e-a77616443e9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:56.042679 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-86410e53-ed9a-4dc9-b09e-a77616443e9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:56.049526 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-1bbb6ddc-8c55-4719-be36-358982c98720 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '359107a5c1714262aa3f85a9f1c60f3c', 'request_id': 'req-1bbb6ddc-8c55-4719-be36-358982c98720'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:56.055848 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 852/1688] 10.222.0.49 () {58 vars in 1233 bytes} [Thu Sep 29 02:11:55 2022] DELETE /identity/v3/projects/be4b4cf1cbfe4040b409e61915d0ba53 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:11:56.061692 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f06da7-bcf4-41c4-99fb-a6f470f577c7 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:56.061978 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f06da7-bcf4-41c4-99fb-a6f470f577c7 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:56.062257 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f06da7-bcf4-41c4-99fb-a6f470f577c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:56.063866 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-1bbb6ddc-8c55-4719-be36-358982c98720 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '359107a5c1714262aa3f85a9f1c60f3c', 'request_id': 'req-1bbb6ddc-8c55-4719-be36-358982c98720'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:56.075477 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-1bbb6ddc-8c55-4719-be36-358982c98720 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '359107a5c1714262aa3f85a9f1c60f3c', 'request_id': 'req-1bbb6ddc-8c55-4719-be36-358982c98720'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:56.091855 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-1bbb6ddc-8c55-4719-be36-358982c98720 admin admin] The token cache is being invalidate because project 359107a5c1714262aa3f85a9f1c60f3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81649) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:11:56.092152 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-1bbb6ddc-8c55-4719-be36-358982c98720 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:56.093183 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-1bbb6ddc-8c55-4719-be36-358982c98720 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:56.095434 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 837/1689] 10.222.0.49 () {58 vars in 1233 bytes} [Thu Sep 29 02:11:55 2022] DELETE /identity/v3/projects/359107a5c1714262aa3f85a9f1c60f3c => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:11:56.096936 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b960b797-15a4-4ef2-af52-136e0a7f288b None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:56.097272 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b960b797-15a4-4ef2-af52-136e0a7f288b None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:56.097584 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b960b797-15a4-4ef2-af52-136e0a7f288b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:56.106456 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-43f06da7-bcf4-41c4-99fb-a6f470f577c7 None None] MFA Rules not processed for user `f167598e4a354a21b89825f2cbe8ff2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:56.111948 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-43f06da7-bcf4-41c4-99fb-a6f470f577c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:56.176171 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-b960b797-15a4-4ef2-af52-136e0a7f288b None None] MFA Rules not processed for user `c7415274ccbd446fb4704389e1e68b9b`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:56.179538 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-b960b797-15a4-4ef2-af52-136e0a7f288b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:56.196542 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:11:56.302499 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 853/1690] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:11:56 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:56.313072 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a6da7b-19b4-40c6-947f-5a9d23cf1d5e None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:56.313406 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a6da7b-19b4-40c6-947f-5a9d23cf1d5e None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:56.313687 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a6da7b-19b4-40c6-947f-5a9d23cf1d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:56.353865 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 838/1691] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:11:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:56.353865 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb73ef1-b472-462d-9659-b657f40dea55 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:56.353865 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb73ef1-b472-462d-9659-b657f40dea55 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:56.353865 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb73ef1-b472-462d-9659-b657f40dea55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:56.357908 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-53a6da7b-19b4-40c6-947f-5a9d23cf1d5e None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:56.359264 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-53a6da7b-19b4-40c6-947f-5a9d23cf1d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:56.403835 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-7cb73ef1-b472-462d-9659-b657f40dea55 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:56.405286 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-7cb73ef1-b472-462d-9659-b657f40dea55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:56.538029 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 854/1692] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:11:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:56.539009 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a6da7b-19b4-40c6-947f-5a9d23cf1d5e None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:56.544551 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-53a6da7b-19b4-40c6-947f-5a9d23cf1d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:56.586955 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a6da7b-19b4-40c6-947f-5a9d23cf1d5e None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:56.600190 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 839/1693] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:11:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:56.601205 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb73ef1-b472-462d-9659-b657f40dea55 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:56.605848 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-7cb73ef1-b472-462d-9659-b657f40dea55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:56.608903 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060c97ed-26bf-4c59-80d4-6af8d2c72c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:56.610958 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c97ed-26bf-4c59-80d4-6af8d2c72c58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:56.611236 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c97ed-26bf-4c59-80d4-6af8d2c72c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:56.611505 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c97ed-26bf-4c59-80d4-6af8d2c72c58 admin admin] PATH_INFO: `/v3/users/1ea7c1b36dff4d4eafbd579460622c7d` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:56.615012 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060c97ed-26bf-4c59-80d4-6af8d2c72c58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ea7c1b36dff4d4eafbd579460622c7d)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:56.622266 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060c97ed-26bf-4c59-80d4-6af8d2c72c58 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:56.755917 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-060c97ed-26bf-4c59-80d4-6af8d2c72c58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ea7c1b36dff4d4eafbd579460622c7d'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:56.760900 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-060c97ed-26bf-4c59-80d4-6af8d2c72c58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ea7c1b36dff4d4eafbd579460622c7d'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:56.796934 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-060c97ed-26bf-4c59-80d4-6af8d2c72c58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ea7c1b36dff4d4eafbd579460622c7d'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:56.801430 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:11:56.813441 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-060c97ed-26bf-4c59-80d4-6af8d2c72c58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ea7c1b36dff4d4eafbd579460622c7d'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:56.814532 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-060c97ed-26bf-4c59-80d4-6af8d2c72c58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ea7c1b36dff4d4eafbd579460622c7d'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:56.826900 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb73ef1-b472-462d-9659-b657f40dea55 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:56.834230 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a019af2-2600-4519-9699-bf61fbce2b25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3325a7111d447f4a9cf00c672d5420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:56.835008 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a019af2-2600-4519-9699-bf61fbce2b25 service nova] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:56.835823 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a019af2-2600-4519-9699-bf61fbce2b25 service nova] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:56.836095 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a019af2-2600-4519-9699-bf61fbce2b25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:56.841275 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-6a019af2-2600-4519-9699-bf61fbce2b25 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:56.851119 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 855/1694] 10.222.0.49 () {58 vars in 1224 bytes} [Thu Sep 29 02:11:56 2022] DELETE /identity/v3/users/1ea7c1b36dff4d4eafbd579460622c7d => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:11:56.851119 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a9cd5a-2d61-454f-94ee-887065ffc10e None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:56.851119 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a9cd5a-2d61-454f-94ee-887065ffc10e None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:56.851119 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a9cd5a-2d61-454f-94ee-887065ffc10e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:56.874415 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a019af2-2600-4519-9699-bf61fbce2b25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:56.876539 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a019af2-2600-4519-9699-bf61fbce2b25 service nova] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:56.888750 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 840/1695] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:11:56 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:11:56.903155 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a019af2-2600-4519-9699-bf61fbce2b25 service nova] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:56.906020 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-6a019af2-2600-4519-9699-bf61fbce2b25 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:56.934538 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-95a9cd5a-2d61-454f-94ee-887065ffc10e None None] MFA Rules not processed for user `c7415274ccbd446fb4704389e1e68b9b`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:56.939069 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-95a9cd5a-2d61-454f-94ee-887065ffc10e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:56.944007 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a019af2-2600-4519-9699-bf61fbce2b25 service nova] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:57.023455 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:11:57.094017 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17ebe73-62d8-4266-ad64-5583fb6e9882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:57.094737 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17ebe73-62d8-4266-ad64-5583fb6e9882 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:57.095779 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17ebe73-62d8-4266-ad64-5583fb6e9882 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:57.096486 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17ebe73-62d8-4266-ad64-5583fb6e9882 admin admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:57.097909 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17ebe73-62d8-4266-ad64-5583fb6e9882 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:11:57.099584 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17ebe73-62d8-4266-ad64-5583fb6e9882 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:57.102165 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17ebe73-62d8-4266-ad64-5583fb6e9882 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:57.113689 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 856/1696] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:11:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:57.115386 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d32a69-6c8e-4a5c-9b7b-be24ea931c03 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:57.118597 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d32a69-6c8e-4a5c-9b7b-be24ea931c03 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:57.118941 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d32a69-6c8e-4a5c-9b7b-be24ea931c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:57.143821 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 841/1697] 10.222.0.49 () {58 vars in 1153 bytes} [Thu Sep 29 02:11:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:11:57.146086 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17ebe73-62d8-4266-ad64-5583fb6e9882 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:57.154199 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-a17ebe73-62d8-4266-ad64-5583fb6e9882 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:57.164398 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-b0d32a69-6c8e-4a5c-9b7b-be24ea931c03 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:57.170520 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-b0d32a69-6c8e-4a5c-9b7b-be24ea931c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:57.183109 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17ebe73-62d8-4266-ad64-5583fb6e9882 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:57.189405 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 857/1698] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:11:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:57.189405 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d32a69-6c8e-4a5c-9b7b-be24ea931c03 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:57.194251 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-b0d32a69-6c8e-4a5c-9b7b-be24ea931c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:57.201561 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5776d72e-95c9-491e-86a0-cdc0a1cf5672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:57.202216 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5776d72e-95c9-491e-86a0-cdc0a1cf5672 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:57.202497 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5776d72e-95c9-491e-86a0-cdc0a1cf5672 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:57.202764 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5776d72e-95c9-491e-86a0-cdc0a1cf5672 admin admin] PATH_INFO: `/v3/projects/6ca79f54e21e4ddbba51b286ec08d827` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:57.203940 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5776d72e-95c9-491e-86a0-cdc0a1cf5672 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ca79f54e21e4ddbba51b286ec08d827)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:57.206895 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5776d72e-95c9-491e-86a0-cdc0a1cf5672 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:57.317597 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-5776d72e-95c9-491e-86a0-cdc0a1cf5672 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ca79f54e21e4ddbba51b286ec08d827', 'request_id': 'req-5776d72e-95c9-491e-86a0-cdc0a1cf5672'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:57.326543 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-5776d72e-95c9-491e-86a0-cdc0a1cf5672 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ca79f54e21e4ddbba51b286ec08d827', 'request_id': 'req-5776d72e-95c9-491e-86a0-cdc0a1cf5672'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:57.343936 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-5776d72e-95c9-491e-86a0-cdc0a1cf5672 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ca79f54e21e4ddbba51b286ec08d827', 'request_id': 'req-5776d72e-95c9-491e-86a0-cdc0a1cf5672'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:57.359942 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d32a69-6c8e-4a5c-9b7b-be24ea931c03 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:57.367516 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-5776d72e-95c9-491e-86a0-cdc0a1cf5672 admin admin] The token cache is being invalidate because project 6ca79f54e21e4ddbba51b286ec08d827 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81649) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:11:57.367829 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-5776d72e-95c9-491e-86a0-cdc0a1cf5672 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:57.368560 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-5776d72e-95c9-491e-86a0-cdc0a1cf5672 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:57.373706 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 842/1699] 10.222.0.49 () {58 vars in 1233 bytes} [Thu Sep 29 02:11:57 2022] DELETE /identity/v3/projects/6ca79f54e21e4ddbba51b286ec08d827 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:11:57.373706 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5776d72e-95c9-491e-86a0-cdc0a1cf5672 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:57.373706 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-5776d72e-95c9-491e-86a0-cdc0a1cf5672 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:57.504379 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5776d72e-95c9-491e-86a0-cdc0a1cf5672 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:57.510663 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad50a6a3-8008-4047-ad6e-3699494678f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:57.511563 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad50a6a3-8008-4047-ad6e-3699494678f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:57.512562 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad50a6a3-8008-4047-ad6e-3699494678f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:57.512852 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad50a6a3-8008-4047-ad6e-3699494678f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:57.515349 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad50a6a3-8008-4047-ad6e-3699494678f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:57.519682 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad50a6a3-8008-4047-ad6e-3699494678f1 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:57.539414 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45db706d-977a-4df2-91c0-cd8b14a89ca3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3325a7111d447f4a9cf00c672d5420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:57.540052 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db706d-977a-4df2-91c0-cd8b14a89ca3 service nova] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:57.540333 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db706d-977a-4df2-91c0-cd8b14a89ca3 service nova] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:57.540606 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db706d-977a-4df2-91c0-cd8b14a89ca3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:57.546942 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-45db706d-977a-4df2-91c0-cd8b14a89ca3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:57.571089 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 843/1700] 10.222.0.49 () {60 vars in 1153 bytes} [Thu Sep 29 02:11:57 2022] POST /identity/v3/projects => generated 373 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:11:57.571089 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad50a6a3-8008-4047-ad6e-3699494678f1 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:57.572441 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-ad50a6a3-8008-4047-ad6e-3699494678f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:57.574188 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=98 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:11:57.659894 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:11:57.667241 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45db706d-977a-4df2-91c0-cd8b14a89ca3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:57.669006 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45db706d-977a-4df2-91c0-cd8b14a89ca3 service nova] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:57.692722 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 858/1701] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:11:57 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:11:57.694361 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b254bfd-4c4c-4260-b4e1-601b1fab3bb0 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:57.694654 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b254bfd-4c4c-4260-b4e1-601b1fab3bb0 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:57.694932 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b254bfd-4c4c-4260-b4e1-601b1fab3bb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:57.718853 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad50a6a3-8008-4047-ad6e-3699494678f1 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:57.742247 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d146f73-6df8-42bb-8036-c52caf611887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:57.743258 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d146f73-6df8-42bb-8036-c52caf611887 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:57.743758 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d146f73-6df8-42bb-8036-c52caf611887 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:57.744234 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d146f73-6df8-42bb-8036-c52caf611887 admin admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:57.745712 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d146f73-6df8-42bb-8036-c52caf611887 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:11:57.746218 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d146f73-6df8-42bb-8036-c52caf611887 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:57.746473 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-1b254bfd-4c4c-4260-b4e1-601b1fab3bb0 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:57.747736 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-1b254bfd-4c4c-4260-b4e1-601b1fab3bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:57.748483 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d146f73-6df8-42bb-8036-c52caf611887 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:57.755962 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 859/1702] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:11:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:57.757228 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c362ae1-1c53-4ddb-ac67-d890ee0d9256 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:57.757540 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c362ae1-1c53-4ddb-ac67-d890ee0d9256 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:57.757815 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c362ae1-1c53-4ddb-ac67-d890ee0d9256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:57.767523 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 844/1703] 10.222.0.49 () {58 vars in 1153 bytes} [Thu Sep 29 02:11:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:11:57.768995 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d146f73-6df8-42bb-8036-c52caf611887 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:57.781403 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d146f73-6df8-42bb-8036-c52caf611887 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:57.786778 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4e8039-7f9a-4891-8449-e42fc2dee42b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:57.787522 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4e8039-7f9a-4891-8449-e42fc2dee42b admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:57.787892 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4e8039-7f9a-4891-8449-e42fc2dee42b admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:57.788265 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4e8039-7f9a-4891-8449-e42fc2dee42b admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:57.789099 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4e8039-7f9a-4891-8449-e42fc2dee42b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:57.792191 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4e8039-7f9a-4891-8449-e42fc2dee42b admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:57.825711 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-6c362ae1-1c53-4ddb-ac67-d890ee0d9256 None None] MFA Rules not processed for user `3a68abb5f8ab421cb6044c9a9f579ba6`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:57.826958 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-6c362ae1-1c53-4ddb-ac67-d890ee0d9256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:57.860061 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 845/1704] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 02:11:57 2022] POST /identity/v3/users => generated 287 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:11:57.863164 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a4cb93-de8b-4fa9-b0e7-9686788b2994 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:57.863519 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a4cb93-de8b-4fa9-b0e7-9686788b2994 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:57.866377 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a4cb93-de8b-4fa9-b0e7-9686788b2994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:57.911994 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-48a4cb93-de8b-4fa9-b0e7-9686788b2994 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:57.914377 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-48a4cb93-de8b-4fa9-b0e7-9686788b2994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:57.944877 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 846/1705] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:11:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:57.948693 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a4cb93-de8b-4fa9-b0e7-9686788b2994 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:57.960331 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 860/1706] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:11:57 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:57.962238 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddfb56d-ef49-48da-a61f-7356f05d3749 None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:57.962482 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddfb56d-ef49-48da-a61f-7356f05d3749 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:57.963298 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddfb56d-ef49-48da-a61f-7356f05d3749 None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:57.973370 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 861/1707] 10.222.0.49 () {54 vars in 912 bytes} [Thu Sep 29 02:11:57 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:11:57.974339 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddfb56d-ef49-48da-a61f-7356f05d3749 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:58.004714 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a4cb93-de8b-4fa9-b0e7-9686788b2994 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:58.006814 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddfb56d-ef49-48da-a61f-7356f05d3749 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:58.013170 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4712809-715c-4e84-a880-6c0e67f5885c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:58.014433 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4712809-715c-4e84-a880-6c0e67f5885c admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:58.014948 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4712809-715c-4e84-a880-6c0e67f5885c admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:58.015558 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4712809-715c-4e84-a880-6c0e67f5885c admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:58.016540 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4712809-715c-4e84-a880-6c0e67f5885c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:58.017780 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faaaecf-c444-445e-8fd5-e248a83b14d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:58.018817 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4712809-715c-4e84-a880-6c0e67f5885c admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:58.020927 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faaaecf-c444-445e-8fd5-e248a83b14d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:58.021172 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faaaecf-c444-445e-8fd5-e248a83b14d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:58.024117 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faaaecf-c444-445e-8fd5-e248a83b14d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:58.025134 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faaaecf-c444-445e-8fd5-e248a83b14d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:58.037274 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faaaecf-c444-445e-8fd5-e248a83b14d8 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:58.053917 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 862/1708] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:11:57 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:11:58.055020 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4712809-715c-4e84-a880-6c0e67f5885c admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:58.069984 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4712809-715c-4e84-a880-6c0e67f5885c admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:58.077780 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef8f348-f0fa-433b-b8c8-9d1af075e348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:58.078931 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef8f348-f0fa-433b-b8c8-9d1af075e348 admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:58.079347 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef8f348-f0fa-433b-b8c8-9d1af075e348 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:58.079904 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef8f348-f0fa-433b-b8c8-9d1af075e348 admin admin] PATH_INFO: `/v3/domains` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:58.080870 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef8f348-f0fa-433b-b8c8-9d1af075e348 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:11:58.081336 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef8f348-f0fa-433b-b8c8-9d1af075e348 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:58.083551 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef8f348-f0fa-433b-b8c8-9d1af075e348 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:58.101127 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 847/1709] 10.222.0.49 () {60 vars in 1153 bytes} [Thu Sep 29 02:11:57 2022] POST /identity/v3/projects => generated 391 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:11:58.102458 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d2ee1-9742-4951-b3fd-8bb189bd3013 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:58.102746 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d2ee1-9742-4951-b3fd-8bb189bd3013 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:58.103019 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d2ee1-9742-4951-b3fd-8bb189bd3013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:58.105133 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 863/1710] 10.222.0.49 () {58 vars in 1153 bytes} [Thu Sep 29 02:11:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:11:58.106502 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef8f348-f0fa-433b-b8c8-9d1af075e348 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:58.135587 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef8f348-f0fa-433b-b8c8-9d1af075e348 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:58.199125 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-859d2ee1-9742-4951-b3fd-8bb189bd3013 None None] MFA Rules not processed for user `2053f823bd3c4098a43c299890c1f733`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:58.200377 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-859d2ee1-9742-4951-b3fd-8bb189bd3013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:58.310825 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e1ba9b-8d38-47bc-9bad-55dc72e18629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:58.311454 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e1ba9b-8d38-47bc-9bad-55dc72e18629 admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:58.312541 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e1ba9b-8d38-47bc-9bad-55dc72e18629 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:58.312833 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e1ba9b-8d38-47bc-9bad-55dc72e18629 admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:58.314767 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e1ba9b-8d38-47bc-9bad-55dc72e18629 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:58.320629 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e1ba9b-8d38-47bc-9bad-55dc72e18629 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:58.352550 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 864/1711] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:11:58 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:11:58.353875 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e1ba9b-8d38-47bc-9bad-55dc72e18629 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:58.355802 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 848/1712] 10.222.0.49 () {58 vars in 1009 bytes} [Thu Sep 29 02:11:58 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:58.356655 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859d2ee1-9742-4951-b3fd-8bb189bd3013 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:58.382943 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e1ba9b-8d38-47bc-9bad-55dc72e18629 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:58.385923 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859d2ee1-9742-4951-b3fd-8bb189bd3013 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:58.388163 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a87de32-e503-48fa-bcca-d4c978b3d4de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:58.388986 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a87de32-e503-48fa-bcca-d4c978b3d4de admin admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:58.389534 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a87de32-e503-48fa-bcca-d4c978b3d4de admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:58.389877 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a87de32-e503-48fa-bcca-d4c978b3d4de admin admin] PATH_INFO: `/v3/users` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:58.391447 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a87de32-e503-48fa-bcca-d4c978b3d4de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:58.392906 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a87de32-e503-48fa-bcca-d4c978b3d4de admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:58.396151 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f5d7b8-f0c7-4d35-a557-1ee350b982d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:58.396789 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f5d7b8-f0c7-4d35-a557-1ee350b982d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:58.397071 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f5d7b8-f0c7-4d35-a557-1ee350b982d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:58.397368 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f5d7b8-f0c7-4d35-a557-1ee350b982d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:58.398019 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f5d7b8-f0c7-4d35-a557-1ee350b982d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:58.400211 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f5d7b8-f0c7-4d35-a557-1ee350b982d0 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:58.411699 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:11:58.437763 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 865/1713] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 02:11:58 2022] POST /identity/v3/users => generated 296 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:11:58.439912 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a87de32-e503-48fa-bcca-d4c978b3d4de admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:58.442355 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-5a87de32-e503-48fa-bcca-d4c978b3d4de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:58.466063 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 849/1714] 10.222.0.49 () {60 vars in 1153 bytes} [Thu Sep 29 02:11:58 2022] POST /identity/v3/projects => generated 363 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:11:58.467446 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc57d99b-2ebb-4d7a-928a-9164243bb80f None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:58.467737 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc57d99b-2ebb-4d7a-928a-9164243bb80f None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:58.467834 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a87de32-e503-48fa-bcca-d4c978b3d4de admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:58.468010 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc57d99b-2ebb-4d7a-928a-9164243bb80f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:58.487204 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-dc57d99b-2ebb-4d7a-928a-9164243bb80f None None] MFA Rules not processed for user `f68a35fdeeea469f873ec50671fc35f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:58.488501 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-dc57d99b-2ebb-4d7a-928a-9164243bb80f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:58.553782 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 850/1715] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:11:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:58.555116 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc57d99b-2ebb-4d7a-928a-9164243bb80f None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:58.560713 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dad16d6-d471-4801-9a3b-02558b333441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:58.561525 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dad16d6-d471-4801-9a3b-02558b333441 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:58.562978 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dad16d6-d471-4801-9a3b-02558b333441 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:58.563330 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dad16d6-d471-4801-9a3b-02558b333441 admin admin] PATH_INFO: `/v3/projects/61bb7933e7f8451f88293c30b360c7bb` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:58.565260 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dad16d6-d471-4801-9a3b-02558b333441 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61bb7933e7f8451f88293c30b360c7bb)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:58.567520 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dad16d6-d471-4801-9a3b-02558b333441 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:58.570888 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc57d99b-2ebb-4d7a-928a-9164243bb80f None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:58.576703 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ff184c-cb0a-4678-a8f5-c3cf4c2d5acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:58.577486 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff184c-cb0a-4678-a8f5-c3cf4c2d5acc admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:58.577845 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff184c-cb0a-4678-a8f5-c3cf4c2d5acc admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:58.578200 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff184c-cb0a-4678-a8f5-c3cf4c2d5acc admin admin] PATH_INFO: `/v3/projects/93f0a445590941e088a4d13d9e9b904f/users/d94f9f739ade490e9e96b24d296a0e94/roles/f157f905c9c94ccfbfb46e52d443e8f2` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:58.580705 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:11:58.600847 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ff184c-cb0a-4678-a8f5-c3cf4c2d5acc admin admin] RBAC: Authorizing `identity:create_grant(project_id=93f0a445590941e088a4d13d9e9b904f, user_id=d94f9f739ade490e9e96b24d296a0e94, role_id=f157f905c9c94ccfbfb46e52d443e8f2)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:58.603832 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ff184c-cb0a-4678-a8f5-c3cf4c2d5acc admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:58.624745 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 851/1716] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:11:58 2022] PUT /identity/v3/projects/93f0a445590941e088a4d13d9e9b904f/users/d94f9f739ade490e9e96b24d296a0e94/roles/f157f905c9c94ccfbfb46e52d443e8f2 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:11:58.624745 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42ac91a-012c-4ba7-8866-29722fd02626 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:58.624745 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42ac91a-012c-4ba7-8866-29722fd02626 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:58.624745 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42ac91a-012c-4ba7-8866-29722fd02626 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:58.624745 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 852/1717] 10.222.0.49 () {54 vars in 912 bytes} [Thu Sep 29 02:11:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:11:58.625620 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42ac91a-012c-4ba7-8866-29722fd02626 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:58.627397 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-d42ac91a-012c-4ba7-8866-29722fd02626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:58.628886 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-8dad16d6-d471-4801-9a3b-02558b333441 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61bb7933e7f8451f88293c30b360c7bb', 'request_id': 'req-8dad16d6-d471-4801-9a3b-02558b333441'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:58.637455 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-8dad16d6-d471-4801-9a3b-02558b333441 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61bb7933e7f8451f88293c30b360c7bb', 'request_id': 'req-8dad16d6-d471-4801-9a3b-02558b333441'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:58.647502 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-8dad16d6-d471-4801-9a3b-02558b333441 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61bb7933e7f8451f88293c30b360c7bb', 'request_id': 'req-8dad16d6-d471-4801-9a3b-02558b333441'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:58.662101 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-8dad16d6-d471-4801-9a3b-02558b333441 admin admin] The token cache is being invalidate because project 61bb7933e7f8451f88293c30b360c7bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81648) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:11:58.662387 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-8dad16d6-d471-4801-9a3b-02558b333441 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:58.663159 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-8dad16d6-d471-4801-9a3b-02558b333441 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:11:58.665287 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 866/1718] 10.222.0.49 () {58 vars in 1233 bytes} [Thu Sep 29 02:11:58 2022] DELETE /identity/v3/projects/61bb7933e7f8451f88293c30b360c7bb => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:11:58.671277 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dad16d6-d471-4801-9a3b-02558b333441 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:58.679727 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-8dad16d6-d471-4801-9a3b-02558b333441 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:58.698290 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42ac91a-012c-4ba7-8866-29722fd02626 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:58.703348 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264ad18a-9c21-4041-bcc0-aca05ea70eb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:58.704066 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264ad18a-9c21-4041-bcc0-aca05ea70eb2 service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:58.704410 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264ad18a-9c21-4041-bcc0-aca05ea70eb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:58.704739 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264ad18a-9c21-4041-bcc0-aca05ea70eb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:58.707463 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-264ad18a-9c21-4041-bcc0-aca05ea70eb2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:58.720410 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264ad18a-9c21-4041-bcc0-aca05ea70eb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:58.722354 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264ad18a-9c21-4041-bcc0-aca05ea70eb2 service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:58.736190 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 853/1719] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:11:58 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:11:58.738059 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264ad18a-9c21-4041-bcc0-aca05ea70eb2 service neutron] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:58.748946 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-264ad18a-9c21-4041-bcc0-aca05ea70eb2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:58.766582 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dad16d6-d471-4801-9a3b-02558b333441 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:58.809381 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:11:58.854561 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264ad18a-9c21-4041-bcc0-aca05ea70eb2 service neutron] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:58.862047 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8178a940-ec19-49dc-8aa3-957060adb046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:58.862841 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8178a940-ec19-49dc-8aa3-957060adb046 admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:58.862952 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08cb4f3-59fc-4359-9949-103dfb3eb6a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:58.863176 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8178a940-ec19-49dc-8aa3-957060adb046 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:58.863452 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8178a940-ec19-49dc-8aa3-957060adb046 admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:58.863984 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08cb4f3-59fc-4359-9949-103dfb3eb6a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:58.864091 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8178a940-ec19-49dc-8aa3-957060adb046 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:58.864437 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08cb4f3-59fc-4359-9949-103dfb3eb6a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:58.864809 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08cb4f3-59fc-4359-9949-103dfb3eb6a0 admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:58.865770 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08cb4f3-59fc-4359-9949-103dfb3eb6a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:58.866154 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8178a940-ec19-49dc-8aa3-957060adb046 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:58.867941 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08cb4f3-59fc-4359-9949-103dfb3eb6a0 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:58.884003 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 867/1720] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:11:58 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:11:58.884304 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6508bd0a-8fc2-483c-9dd7-a2f22cce8c93 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:58.884608 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6508bd0a-8fc2-483c-9dd7-a2f22cce8c93 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:58.886611 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6508bd0a-8fc2-483c-9dd7-a2f22cce8c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:58.911712 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 854/1721] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 02:11:58 2022] POST /identity/v3/users => generated 282 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:11:58.911712 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2b706-bc45-4da6-82fc-8bbbc5964235 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:58.911712 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2b706-bc45-4da6-82fc-8bbbc5964235 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:58.911712 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2b706-bc45-4da6-82fc-8bbbc5964235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:58.922238 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-6508bd0a-8fc2-483c-9dd7-a2f22cce8c93 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:58.923747 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-6508bd0a-8fc2-483c-9dd7-a2f22cce8c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:58.937510 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 868/1722] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:11:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:58.937510 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8055938c-8321-41b8-abd1-247c1ea2cb90 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:58.937510 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8055938c-8321-41b8-abd1-247c1ea2cb90 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:58.937510 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8055938c-8321-41b8-abd1-247c1ea2cb90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:58.937904 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-8ae2b706-bc45-4da6-82fc-8bbbc5964235 None None] MFA Rules not processed for user `2053f823bd3c4098a43c299890c1f733`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:58.939383 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-8ae2b706-bc45-4da6-82fc-8bbbc5964235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:58.947246 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 855/1723] 10.222.0.49 () {58 vars in 1009 bytes} [Thu Sep 29 02:11:58 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:58.948559 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae2b706-bc45-4da6-82fc-8bbbc5964235 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:58.965982 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae2b706-bc45-4da6-82fc-8bbbc5964235 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:58.966350 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-8055938c-8321-41b8-abd1-247c1ea2cb90 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:58.967728 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-8055938c-8321-41b8-abd1-247c1ea2cb90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:58.972029 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec962e4-6479-4e65-9712-c60845874b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:58.972767 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec962e4-6479-4e65-9712-c60845874b4f admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:58.973707 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec962e4-6479-4e65-9712-c60845874b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:58.974384 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec962e4-6479-4e65-9712-c60845874b4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:58.974849 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec962e4-6479-4e65-9712-c60845874b4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:58.976844 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec962e4-6479-4e65-9712-c60845874b4f admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:58.983970 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 869/1724] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:11:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:58.983970 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8055938c-8321-41b8-abd1-247c1ea2cb90 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:58.991525 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 856/1725] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:11:58 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:11:58.992592 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec962e4-6479-4e65-9712-c60845874b4f admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:58.993273 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8055938c-8321-41b8-abd1-247c1ea2cb90 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:58.995475 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-dec962e4-6479-4e65-9712-c60845874b4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:58.999730 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bdd0e9-08c2-4dfd-b960-22fd3d14e666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:59.000450 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bdd0e9-08c2-4dfd-b960-22fd3d14e666 admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:59.000728 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bdd0e9-08c2-4dfd-b960-22fd3d14e666 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:59.001515 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bdd0e9-08c2-4dfd-b960-22fd3d14e666 admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:59.003104 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bdd0e9-08c2-4dfd-b960-22fd3d14e666 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:59.004855 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bdd0e9-08c2-4dfd-b960-22fd3d14e666 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:59.011325 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec962e4-6479-4e65-9712-c60845874b4f admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:59.016187 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45940a8-33ac-4eeb-bd2b-562d3764d51f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:59.016925 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45940a8-33ac-4eeb-bd2b-562d3764d51f service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:59.017478 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45940a8-33ac-4eeb-bd2b-562d3764d51f service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:59.017906 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45940a8-33ac-4eeb-bd2b-562d3764d51f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:59.018939 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 870/1726] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:11:58 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:11:59.020631 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a9914e-e393-4df8-bb9f-4b74ebfdf671 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:59.021214 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a9914e-e393-4df8-bb9f-4b74ebfdf671 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:59.021872 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a9914e-e393-4df8-bb9f-4b74ebfdf671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:59.032836 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45940a8-33ac-4eeb-bd2b-562d3764d51f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:59.034479 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45940a8-33ac-4eeb-bd2b-562d3764d51f service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:59.051159 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-e8a9914e-e393-4df8-bb9f-4b74ebfdf671 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:59.051609 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 857/1727] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:11:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:11:59.052522 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45940a8-33ac-4eeb-bd2b-562d3764d51f service neutron] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:59.052818 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-e8a9914e-e393-4df8-bb9f-4b74ebfdf671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:59.067966 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 871/1728] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:11:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:59.068138 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45940a8-33ac-4eeb-bd2b-562d3764d51f service neutron] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:59.068240 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a9914e-e393-4df8-bb9f-4b74ebfdf671 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:59.068240 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-e8a9914e-e393-4df8-bb9f-4b74ebfdf671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:59.072655 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad39bc7-d532-4191-b5ff-8ecdc015fe9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:59.073512 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad39bc7-d532-4191-b5ff-8ecdc015fe9b admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:59.074062 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad39bc7-d532-4191-b5ff-8ecdc015fe9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:59.074590 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad39bc7-d532-4191-b5ff-8ecdc015fe9b admin admin] PATH_INFO: `/v3/projects/22839ad03cae4035be0a3edf3bcdb495/users/b63214efce86478b8e18b0efa08ee51d/roles/f157f905c9c94ccfbfb46e52d443e8f2` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:59.083772 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a9914e-e393-4df8-bb9f-4b74ebfdf671 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:59.087699 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3787beb9-2ba7-4254-b382-bbc648563653 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:59.089587 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3787beb9-2ba7-4254-b382-bbc648563653 service neutron] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:59.089975 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3787beb9-2ba7-4254-b382-bbc648563653 service neutron] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:59.090344 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3787beb9-2ba7-4254-b382-bbc648563653 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:59.100843 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad39bc7-d532-4191-b5ff-8ecdc015fe9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=22839ad03cae4035be0a3edf3bcdb495, user_id=b63214efce86478b8e18b0efa08ee51d, role_id=f157f905c9c94ccfbfb46e52d443e8f2)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:59.101125 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3787beb9-2ba7-4254-b382-bbc648563653 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:59.102790 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3787beb9-2ba7-4254-b382-bbc648563653 service neutron] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:59.104883 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad39bc7-d532-4191-b5ff-8ecdc015fe9b admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:59.114787 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 872/1729] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:11:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:11:59.127593 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 858/1730] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:11:59 2022] PUT /identity/v3/projects/22839ad03cae4035be0a3edf3bcdb495/users/b63214efce86478b8e18b0efa08ee51d/roles/f157f905c9c94ccfbfb46e52d443e8f2 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:11:59.134989 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3787beb9-2ba7-4254-b382-bbc648563653 service neutron] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:59.139349 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad39bc7-d532-4191-b5ff-8ecdc015fe9b admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:59.164662 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:11:59.167032 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3787beb9-2ba7-4254-b382-bbc648563653 service neutron] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:59.225456 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad39bc7-d532-4191-b5ff-8ecdc015fe9b admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:59.232122 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c443d4-a607-4784-b784-97b53e849881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:59.233713 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c443d4-a607-4784-b784-97b53e849881 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:59.234250 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c443d4-a607-4784-b784-97b53e849881 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:59.234704 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c443d4-a607-4784-b784-97b53e849881 admin admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:59.235771 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c443d4-a607-4784-b784-97b53e849881 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:11:59.236217 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c443d4-a607-4784-b784-97b53e849881 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:59.242774 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c443d4-a607-4784-b784-97b53e849881 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:59.273548 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 859/1731] 10.222.0.49 () {58 vars in 1153 bytes} [Thu Sep 29 02:11:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:11:59.276912 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7bf4f2-e207-47df-bd7e-0c8d9dd8e990 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:59.277454 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7bf4f2-e207-47df-bd7e-0c8d9dd8e990 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:59.277866 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7bf4f2-e207-47df-bd7e-0c8d9dd8e990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:59.342294 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-9b7bf4f2-e207-47df-bd7e-0c8d9dd8e990 None None] MFA Rules not processed for user `b63214efce86478b8e18b0efa08ee51d`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:11:59.343755 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-9b7bf4f2-e207-47df-bd7e-0c8d9dd8e990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:59.366953 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b897f2-ff4f-4762-ad85-fed9472c1c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:59.367728 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b897f2-ff4f-4762-ad85-fed9472c1c44 admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:59.368121 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b897f2-ff4f-4762-ad85-fed9472c1c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:59.368499 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b897f2-ff4f-4762-ad85-fed9472c1c44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:59.370248 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b897f2-ff4f-4762-ad85-fed9472c1c44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:59.376380 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b897f2-ff4f-4762-ad85-fed9472c1c44 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:59.395355 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 873/1732] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:11:59 2022] GET /identity/v3/roles => generated 1420 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:11:59.397343 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b897f2-ff4f-4762-ad85-fed9472c1c44 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:59.417027 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b897f2-ff4f-4762-ad85-fed9472c1c44 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:59.423378 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9659f053-920b-4727-8d79-aecca139b0e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:59.423820 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9659f053-920b-4727-8d79-aecca139b0e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:59.424209 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9659f053-920b-4727-8d79-aecca139b0e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:59.424486 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9659f053-920b-4727-8d79-aecca139b0e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:59.425229 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9659f053-920b-4727-8d79-aecca139b0e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:59.427464 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9659f053-920b-4727-8d79-aecca139b0e6 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:59.442722 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 860/1733] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:11:59 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:11:59.443627 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7bf4f2-e207-47df-bd7e-0c8d9dd8e990 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:59.445120 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-9b7bf4f2-e207-47df-bd7e-0c8d9dd8e990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:59.482790 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 874/1734] 10.222.0.49 () {60 vars in 1153 bytes} [Thu Sep 29 02:11:59 2022] POST /identity/v3/projects => generated 365 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:11:59.483865 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9659f053-920b-4727-8d79-aecca139b0e6 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:59.571253 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7bf4f2-e207-47df-bd7e-0c8d9dd8e990 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:59.624886 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:11:59.630121 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9659f053-920b-4727-8d79-aecca139b0e6 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:59.655790 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bce9dff-53b2-40e3-930d-05b80d243f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:59.656553 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce9dff-53b2-40e3-930d-05b80d243f83 admin admin] REQUEST_METHOD: `PUT` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:59.656769 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce9dff-53b2-40e3-930d-05b80d243f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:59.657061 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce9dff-53b2-40e3-930d-05b80d243f83 admin admin] PATH_INFO: `/v3/projects/3943215a39c54da2b460600c0fdd850f/users/ea1a24d2169a4106ac58dbd4a368e082/roles/f157f905c9c94ccfbfb46e52d443e8f2` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:59.705261 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bce9dff-53b2-40e3-930d-05b80d243f83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3943215a39c54da2b460600c0fdd850f, user_id=ea1a24d2169a4106ac58dbd4a368e082, role_id=f157f905c9c94ccfbfb46e52d443e8f2)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:59.708368 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bce9dff-53b2-40e3-930d-05b80d243f83 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:59.735322 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:11:59.738178 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 875/1735] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:11:59 2022] PUT /identity/v3/projects/3943215a39c54da2b460600c0fdd850f/users/ea1a24d2169a4106ac58dbd4a368e082/roles/f157f905c9c94ccfbfb46e52d443e8f2 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:11:59.739859 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bce9dff-53b2-40e3-930d-05b80d243f83 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:59.786262 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dc9006-06aa-4665-b908-d0b7fa49024e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3325a7111d447f4a9cf00c672d5420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:59.787710 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dc9006-06aa-4665-b908-d0b7fa49024e service nova] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:59.801134 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dc9006-06aa-4665-b908-d0b7fa49024e service nova] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:59.801606 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dc9006-06aa-4665-b908-d0b7fa49024e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:59.811128 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-16dc9006-06aa-4665-b908-d0b7fa49024e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:59.864610 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bce9dff-53b2-40e3-930d-05b80d243f83 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:11:59.872804 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9b05de-7cb4-426b-a077-9d364655d0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:11:59.873699 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9b05de-7cb4-426b-a077-9d364655d0f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:11:59.875024 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9b05de-7cb4-426b-a077-9d364655d0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:11:59.876565 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9b05de-7cb4-426b-a077-9d364655d0f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:11:59.877418 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9b05de-7cb4-426b-a077-9d364655d0f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:59.881141 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9b05de-7cb4-426b-a077-9d364655d0f2 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:11:59.937212 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 876/1736] 10.222.0.49 () {60 vars in 1153 bytes} [Thu Sep 29 02:11:59 2022] POST /identity/v3/projects => generated 393 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:11:59.939965 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9b05de-7cb4-426b-a077-9d364655d0f2 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:11:59.944403 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-4e9b05de-7cb4-426b-a077-9d364655d0f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:11:59.984733 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dc9006-06aa-4665-b908-d0b7fa49024e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:11:59.992804 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dc9006-06aa-4665-b908-d0b7fa49024e service nova] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:00.028216 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 861/1737] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:11:59 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 585 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:12:00.029349 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dc9006-06aa-4665-b908-d0b7fa49024e service nova] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:00.063904 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dc9006-06aa-4665-b908-d0b7fa49024e service nova] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:00.064617 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9b05de-7cb4-426b-a077-9d364655d0f2 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:00.075481 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dd8c8a-01a9-426c-82de-b60519cd2266 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cbb39731a6b42e2a6647d6134b5c7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:00.076299 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dd8c8a-01a9-426c-82de-b60519cd2266 service placement] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:00.076488 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dd8c8a-01a9-426c-82de-b60519cd2266 service placement] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:00.076788 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dd8c8a-01a9-426c-82de-b60519cd2266 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:00.079158 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-c2dd8c8a-01a9-426c-82de-b60519cd2266 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:00.099450 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dd8c8a-01a9-426c-82de-b60519cd2266 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:00.102170 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dd8c8a-01a9-426c-82de-b60519cd2266 service placement] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:00.121495 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 877/1738] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:11:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:12:00.123303 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69370ded-3173-4c99-a083-4d4c3b84429f None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:00.123303 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69370ded-3173-4c99-a083-4d4c3b84429f None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:00.123690 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69370ded-3173-4c99-a083-4d4c3b84429f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:00.193554 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-69370ded-3173-4c99-a083-4d4c3b84429f None None] MFA Rules not processed for user `ea1a24d2169a4106ac58dbd4a368e082`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:00.199506 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-69370ded-3173-4c99-a083-4d4c3b84429f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:00.229518 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3b838f-5137-4736-8383-89c293eafeac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:00.235613 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b838f-5137-4736-8383-89c293eafeac admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:00.236105 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b838f-5137-4736-8383-89c293eafeac admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:00.236584 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b838f-5137-4736-8383-89c293eafeac admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:00.237410 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3b838f-5137-4736-8383-89c293eafeac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:00.242201 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3b838f-5137-4736-8383-89c293eafeac admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:00.295231 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 862/1739] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 02:12:00 2022] POST /identity/v3/users => generated 283 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:00.296518 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3b838f-5137-4736-8383-89c293eafeac admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:00.320845 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3b838f-5137-4736-8383-89c293eafeac admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:00.337862 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f31646f-7c4c-4202-998f-eb7a4e8be3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:00.341050 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f31646f-7c4c-4202-998f-eb7a4e8be3d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:00.341627 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f31646f-7c4c-4202-998f-eb7a4e8be3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:00.342078 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f31646f-7c4c-4202-998f-eb7a4e8be3d3 admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:00.343245 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f31646f-7c4c-4202-998f-eb7a4e8be3d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:00.345736 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f31646f-7c4c-4202-998f-eb7a4e8be3d3 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:00.363548 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:00.396617 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 863/1740] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 02:12:00 2022] POST /identity/v3/users => generated 303 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:00.398409 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f31646f-7c4c-4202-998f-eb7a4e8be3d3 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:00.420685 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f31646f-7c4c-4202-998f-eb7a4e8be3d3 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:00.436278 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee4c109-59a2-4d9a-841e-e4bc867ddd77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:00.440889 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee4c109-59a2-4d9a-841e-e4bc867ddd77 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:00.441153 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee4c109-59a2-4d9a-841e-e4bc867ddd77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:00.441433 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee4c109-59a2-4d9a-841e-e4bc867ddd77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:00.442716 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee4c109-59a2-4d9a-841e-e4bc867ddd77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:00.443134 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 878/1741] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:12:00 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:00.444286 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69370ded-3173-4c99-a083-4d4c3b84429f None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:00.446584 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee4c109-59a2-4d9a-841e-e4bc867ddd77 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:00.483704 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 864/1742] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:00 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:00.487392 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69370ded-3173-4c99-a083-4d4c3b84429f None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:00.489823 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee4c109-59a2-4d9a-841e-e4bc867ddd77 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:00.499643 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39289c8-95ae-4ee9-9231-e603367e63b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:00.500396 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39289c8-95ae-4ee9-9231-e603367e63b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:00.500687 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39289c8-95ae-4ee9-9231-e603367e63b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:00.500963 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39289c8-95ae-4ee9-9231-e603367e63b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:00.501642 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39289c8-95ae-4ee9-9231-e603367e63b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:00.503285 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39289c8-95ae-4ee9-9231-e603367e63b7 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:00.519097 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee4c109-59a2-4d9a-841e-e4bc867ddd77 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:00.535228 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe11539-43a4-464c-87b7-ae82177b9af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:00.535886 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe11539-43a4-464c-87b7-ae82177b9af8 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:00.536166 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe11539-43a4-464c-87b7-ae82177b9af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:00.536536 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe11539-43a4-464c-87b7-ae82177b9af8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:00.540692 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 879/1743] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:00 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:00.541560 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe11539-43a4-464c-87b7-ae82177b9af8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:00.543566 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe11539-43a4-464c-87b7-ae82177b9af8 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:00.546522 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39289c8-95ae-4ee9-9231-e603367e63b7 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:00.580496 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39289c8-95ae-4ee9-9231-e603367e63b7 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:00.594063 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849dfbdd-c408-4cb0-95ca-1bbe301d784d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:00.594741 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849dfbdd-c408-4cb0-95ca-1bbe301d784d admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:00.595022 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849dfbdd-c408-4cb0-95ca-1bbe301d784d admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:00.595290 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849dfbdd-c408-4cb0-95ca-1bbe301d784d admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:00.595941 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849dfbdd-c408-4cb0-95ca-1bbe301d784d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:00.600785 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849dfbdd-c408-4cb0-95ca-1bbe301d784d admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:00.630429 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 865/1744] 10.222.0.49 () {60 vars in 1153 bytes} [Thu Sep 29 02:12:00 2022] POST /identity/v3/projects => generated 365 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:00.635941 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe11539-43a4-464c-87b7-ae82177b9af8 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:00.654102 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 880/1745] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:00 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:00.655069 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849dfbdd-c408-4cb0-95ca-1bbe301d784d admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:00.688859 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849dfbdd-c408-4cb0-95ca-1bbe301d784d admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:00.709925 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:00.839880 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe11539-43a4-464c-87b7-ae82177b9af8 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:00.855948 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8500db66-40c7-4720-b3ad-c2e20c1e61fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:00.860432 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8500db66-40c7-4720-b3ad-c2e20c1e61fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:00.860726 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8500db66-40c7-4720-b3ad-c2e20c1e61fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:00.861009 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8500db66-40c7-4720-b3ad-c2e20c1e61fe admin admin] PATH_INFO: `/v3/projects/838a3f1d4bd84a0bb7e770b58aa6b857/users/f6981b5f946845e1aec02038efffe959/roles/fe9bbc67742f4f5893f39b18eb31d59a` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:00.867142 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded48e53-870d-47e7-a5d3-fe4db420f16e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:00.867775 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded48e53-870d-47e7-a5d3-fe4db420f16e admin admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:00.868065 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded48e53-870d-47e7-a5d3-fe4db420f16e admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:00.868371 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded48e53-870d-47e7-a5d3-fe4db420f16e admin admin] PATH_INFO: `/v3/users` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:00.869019 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded48e53-870d-47e7-a5d3-fe4db420f16e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:00.885148 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded48e53-870d-47e7-a5d3-fe4db420f16e admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:00.945429 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8500db66-40c7-4720-b3ad-c2e20c1e61fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=838a3f1d4bd84a0bb7e770b58aa6b857, user_id=f6981b5f946845e1aec02038efffe959, role_id=fe9bbc67742f4f5893f39b18eb31d59a)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:00.954853 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8500db66-40c7-4720-b3ad-c2e20c1e61fe admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:00.973600 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 881/1746] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 02:12:00 2022] POST /identity/v3/users => generated 289 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:00.975321 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded48e53-870d-47e7-a5d3-fe4db420f16e admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:00.993595 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 866/1747] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:12:00 2022] PUT /identity/v3/projects/838a3f1d4bd84a0bb7e770b58aa6b857/users/f6981b5f946845e1aec02038efffe959/roles/fe9bbc67742f4f5893f39b18eb31d59a => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:01.002893 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d336ead5-0693-4745-87f9-eec237e6f41a None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:01.003191 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d336ead5-0693-4745-87f9-eec237e6f41a None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:01.003469 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d336ead5-0693-4745-87f9-eec237e6f41a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:01.057410 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded48e53-870d-47e7-a5d3-fe4db420f16e admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:01.070607 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-d336ead5-0693-4745-87f9-eec237e6f41a None None] MFA Rules not processed for user `f167598e4a354a21b89825f2cbe8ff2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:01.077531 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-d336ead5-0693-4745-87f9-eec237e6f41a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:01.352219 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 867/1748] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:12:00 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:01.352987 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d336ead5-0693-4745-87f9-eec237e6f41a None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:01.372674 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22461b6-bfb5-4a1b-aac4-3eb45e4eaee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:01.375982 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22461b6-bfb5-4a1b-aac4-3eb45e4eaee5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:01.376341 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22461b6-bfb5-4a1b-aac4-3eb45e4eaee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:01.378736 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22461b6-bfb5-4a1b-aac4-3eb45e4eaee5 admin admin] PATH_INFO: `/v3/projects/6dbd98e0328846ea82155c66aca4287a/users/5004001b7156426ea96c81192f8ac306/roles/f157f905c9c94ccfbfb46e52d443e8f2` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:01.413821 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d336ead5-0693-4745-87f9-eec237e6f41a None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:01.434253 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f643f07f-e388-4ee9-8225-1e3b1808b166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:01.435265 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f643f07f-e388-4ee9-8225-1e3b1808b166 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:01.436214 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f643f07f-e388-4ee9-8225-1e3b1808b166 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:01.436709 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f643f07f-e388-4ee9-8225-1e3b1808b166 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:01.437617 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f643f07f-e388-4ee9-8225-1e3b1808b166 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:01.439481 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f643f07f-e388-4ee9-8225-1e3b1808b166 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:01.451447 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22461b6-bfb5-4a1b-aac4-3eb45e4eaee5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dbd98e0328846ea82155c66aca4287a, user_id=5004001b7156426ea96c81192f8ac306, role_id=f157f905c9c94ccfbfb46e52d443e8f2)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:01.464704 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22461b6-bfb5-4a1b-aac4-3eb45e4eaee5 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:01.471489 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 868/1749] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:01 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:01.474061 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f643f07f-e388-4ee9-8225-1e3b1808b166 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:01.508372 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 882/1750] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:12:00 2022] PUT /identity/v3/projects/6dbd98e0328846ea82155c66aca4287a/users/5004001b7156426ea96c81192f8ac306/roles/f157f905c9c94ccfbfb46e52d443e8f2 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:01.512410 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22461b6-bfb5-4a1b-aac4-3eb45e4eaee5 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:01.512967 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f643f07f-e388-4ee9-8225-1e3b1808b166 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:01.629653 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:01.674246 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27297302-8b33-4dab-8809-c29f8ac2f941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:01.677502 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27297302-8b33-4dab-8809-c29f8ac2f941 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:01.679263 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27297302-8b33-4dab-8809-c29f8ac2f941 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:01.679725 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27297302-8b33-4dab-8809-c29f8ac2f941 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:01.684314 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27297302-8b33-4dab-8809-c29f8ac2f941 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:01.690223 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27297302-8b33-4dab-8809-c29f8ac2f941 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:01.712532 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22461b6-bfb5-4a1b-aac4-3eb45e4eaee5 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:01.714305 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 869/1751] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:01 2022] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:01.715837 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c344827-8d20-4c9e-8a27-5d94c6a0c74b None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:01.716282 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c344827-8d20-4c9e-8a27-5d94c6a0c74b None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:01.717115 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c344827-8d20-4c9e-8a27-5d94c6a0c74b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:01.725058 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349fe48d-0c30-4cb8-bc05-ff8ff422bf45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:01.726050 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349fe48d-0c30-4cb8-bc05-ff8ff422bf45 admin admin] REQUEST_METHOD: `PUT` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:01.726475 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349fe48d-0c30-4cb8-bc05-ff8ff422bf45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:01.726910 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349fe48d-0c30-4cb8-bc05-ff8ff422bf45 admin admin] PATH_INFO: `/v3/projects/16b3a5d5d52646d18cca73b1ac9a6f76/users/524cf925744e4658b8c9f735dd541608/roles/fe9bbc67742f4f5893f39b18eb31d59a` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:01.764791 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349fe48d-0c30-4cb8-bc05-ff8ff422bf45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16b3a5d5d52646d18cca73b1ac9a6f76, user_id=524cf925744e4658b8c9f735dd541608, role_id=fe9bbc67742f4f5893f39b18eb31d59a)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:01.768627 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349fe48d-0c30-4cb8-bc05-ff8ff422bf45 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:01.783488 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-3c344827-8d20-4c9e-8a27-5d94c6a0c74b None None] MFA Rules not processed for user `5004001b7156426ea96c81192f8ac306`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:01.788283 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-3c344827-8d20-4c9e-8a27-5d94c6a0c74b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:01.803953 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 883/1752] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:12:01 2022] PUT /identity/v3/projects/16b3a5d5d52646d18cca73b1ac9a6f76/users/524cf925744e4658b8c9f735dd541608/roles/fe9bbc67742f4f5893f39b18eb31d59a => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:01.809588 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52165b9-86d6-41bb-883a-a818ffe9344c None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:01.811718 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52165b9-86d6-41bb-883a-a818ffe9344c None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:01.812529 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52165b9-86d6-41bb-883a-a818ffe9344c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:01.840947 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:01.884337 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-d52165b9-86d6-41bb-883a-a818ffe9344c None None] MFA Rules not processed for user `d94f9f739ade490e9e96b24d296a0e94`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:01.889782 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-d52165b9-86d6-41bb-883a-a818ffe9344c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:01.993096 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 870/1753] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:12:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:01.997223 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c344827-8d20-4c9e-8a27-5d94c6a0c74b None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:02.142602 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 884/1754] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:12:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:02.146978 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52165b9-86d6-41bb-883a-a818ffe9344c None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:02.259403 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c344827-8d20-4c9e-8a27-5d94c6a0c74b None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:02.331874 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924a773c-54ab-4fe3-bda8-0e14a590ed5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:02.336021 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a773c-54ab-4fe3-bda8-0e14a590ed5d admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:02.338792 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a773c-54ab-4fe3-bda8-0e14a590ed5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:02.340402 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a773c-54ab-4fe3-bda8-0e14a590ed5d admin admin] PATH_INFO: `/v3/projects/838a3f1d4bd84a0bb7e770b58aa6b857/users/f6981b5f946845e1aec02038efffe959/roles/fe9bbc67742f4f5893f39b18eb31d59a` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:02.351089 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924a773c-54ab-4fe3-bda8-0e14a590ed5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=838a3f1d4bd84a0bb7e770b58aa6b857, user_id=f6981b5f946845e1aec02038efffe959, role_id=fe9bbc67742f4f5893f39b18eb31d59a)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:02.360640 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924a773c-54ab-4fe3-bda8-0e14a590ed5d admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:02.424935 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 871/1755] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:12:01 2022] PUT /identity/v3/projects/838a3f1d4bd84a0bb7e770b58aa6b857/users/f6981b5f946845e1aec02038efffe959/roles/fe9bbc67742f4f5893f39b18eb31d59a => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:02.424935 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924a773c-54ab-4fe3-bda8-0e14a590ed5d admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:02.473286 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52165b9-86d6-41bb-883a-a818ffe9344c None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:02.621658 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924a773c-54ab-4fe3-bda8-0e14a590ed5d admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:02.638889 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e26e39e-9f6f-4802-a513-e79fcc36d2d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:02.639714 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e26e39e-9f6f-4802-a513-e79fcc36d2d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:02.640198 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e26e39e-9f6f-4802-a513-e79fcc36d2d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:02.640671 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e26e39e-9f6f-4802-a513-e79fcc36d2d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:02.649962 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e26e39e-9f6f-4802-a513-e79fcc36d2d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:02.653078 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e26e39e-9f6f-4802-a513-e79fcc36d2d0 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:02.672091 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:02.706936 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a92e62-4223-42c4-b473-ea441740ab8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:02.711479 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a92e62-4223-42c4-b473-ea441740ab8d admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:02.715544 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a92e62-4223-42c4-b473-ea441740ab8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:02.716664 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a92e62-4223-42c4-b473-ea441740ab8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:02.721296 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a92e62-4223-42c4-b473-ea441740ab8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:02.723116 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a92e62-4223-42c4-b473-ea441740ab8d admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:02.747928 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 872/1756] 10.222.0.49 () {60 vars in 1153 bytes} [Thu Sep 29 02:12:02 2022] POST /identity/v3/projects => generated 365 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:02.748927 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e26e39e-9f6f-4802-a513-e79fcc36d2d0 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:02.754732 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-9e26e39e-9f6f-4802-a513-e79fcc36d2d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:02.762880 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 885/1757] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:02 2022] GET /identity/v3/roles => generated 1420 bytes in 620 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:02.764570 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7201f766-d28c-4e72-ac1b-81644cec7761 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:02.768193 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7201f766-d28c-4e72-ac1b-81644cec7761 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:02.769354 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7201f766-d28c-4e72-ac1b-81644cec7761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:02.842675 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-7201f766-d28c-4e72-ac1b-81644cec7761 None None] MFA Rules not processed for user `f6981b5f946845e1aec02038efffe959`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:02.843976 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-7201f766-d28c-4e72-ac1b-81644cec7761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:02.892941 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:02.956962 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e26e39e-9f6f-4802-a513-e79fcc36d2d0 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:02.981349 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663e8b78-be71-485d-8cac-6c878645c6c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:02.982761 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e8b78-be71-485d-8cac-6c878645c6c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:02.982761 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e8b78-be71-485d-8cac-6c878645c6c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:02.982761 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e8b78-be71-485d-8cac-6c878645c6c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:02.982761 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663e8b78-be71-485d-8cac-6c878645c6c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:02.984690 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663e8b78-be71-485d-8cac-6c878645c6c0 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:02.996736 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 886/1758] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:12:02 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:03.009632 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7201f766-d28c-4e72-ac1b-81644cec7761 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:03.036945 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7201f766-d28c-4e72-ac1b-81644cec7761 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:03.043753 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bcc5d0-c465-48a3-a940-d87acfe95e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:03.044660 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bcc5d0-c465-48a3-a940-d87acfe95e01 admin admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:03.045652 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bcc5d0-c465-48a3-a940-d87acfe95e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:03.046136 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bcc5d0-c465-48a3-a940-d87acfe95e01 admin admin] PATH_INFO: `/v3/users` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:03.046892 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bcc5d0-c465-48a3-a940-d87acfe95e01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:03.049722 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 873/1759] 10.222.0.49 () {60 vars in 1153 bytes} [Thu Sep 29 02:12:02 2022] POST /identity/v3/projects => generated 371 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:03.050431 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663e8b78-be71-485d-8cac-6c878645c6c0 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:03.062314 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bcc5d0-c465-48a3-a940-d87acfe95e01 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:03.100640 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 887/1760] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 02:12:02 2022] POST /identity/v3/users => generated 289 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:03.101977 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bcc5d0-c465-48a3-a940-d87acfe95e01 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:03.106330 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-55bcc5d0-c465-48a3-a940-d87acfe95e01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:03.245732 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bcc5d0-c465-48a3-a940-d87acfe95e01 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:03.263474 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663e8b78-be71-485d-8cac-6c878645c6c0 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:03.285426 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf0415a-5d3e-4f92-95ac-57c72585077e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:03.286122 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf0415a-5d3e-4f92-95ac-57c72585077e admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:03.286405 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf0415a-5d3e-4f92-95ac-57c72585077e admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:03.287068 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf0415a-5d3e-4f92-95ac-57c72585077e admin admin] PATH_INFO: `/v3/projects/16b3a5d5d52646d18cca73b1ac9a6f76/users/524cf925744e4658b8c9f735dd541608/roles/fe9bbc67742f4f5893f39b18eb31d59a` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:03.289576 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf0415a-5d3e-4f92-95ac-57c72585077e admin admin] RBAC: Authorizing `identity:create_grant(project_id=16b3a5d5d52646d18cca73b1ac9a6f76, user_id=524cf925744e4658b8c9f735dd541608, role_id=fe9bbc67742f4f5893f39b18eb31d59a)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:03.292870 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf0415a-5d3e-4f92-95ac-57c72585077e admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:03.331704 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 874/1761] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:12:03 2022] PUT /identity/v3/projects/16b3a5d5d52646d18cca73b1ac9a6f76/users/524cf925744e4658b8c9f735dd541608/roles/fe9bbc67742f4f5893f39b18eb31d59a => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:03.332972 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf0415a-5d3e-4f92-95ac-57c72585077e admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:03.394710 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80621469-2226-4437-b39e-b19e63ecb594 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75135b856134ba4b9ccac337886f682', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:03.395537 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80621469-2226-4437-b39e-b19e63ecb594 service cinder] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:03.395890 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80621469-2226-4437-b39e-b19e63ecb594 service cinder] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:03.396286 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80621469-2226-4437-b39e-b19e63ecb594 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:03.556004 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf0415a-5d3e-4f92-95ac-57c72585077e admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:03.568757 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef68a27b-9aae-4c2c-bff6-10d5669a0dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:03.573149 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef68a27b-9aae-4c2c-bff6-10d5669a0dce admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:03.573718 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef68a27b-9aae-4c2c-bff6-10d5669a0dce admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:03.574139 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef68a27b-9aae-4c2c-bff6-10d5669a0dce admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:03.574966 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef68a27b-9aae-4c2c-bff6-10d5669a0dce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:03.580710 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef68a27b-9aae-4c2c-bff6-10d5669a0dce admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:03.593362 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:03.641167 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 875/1762] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 02:12:03 2022] POST /identity/v3/users => generated 292 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:03.645277 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef68a27b-9aae-4c2c-bff6-10d5669a0dce admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:03.687385 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef68a27b-9aae-4c2c-bff6-10d5669a0dce admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:03.704033 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e730a498-8bc9-43ef-9080-73d32369170f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:03.705265 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e730a498-8bc9-43ef-9080-73d32369170f admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:03.705577 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e730a498-8bc9-43ef-9080-73d32369170f admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:03.705851 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e730a498-8bc9-43ef-9080-73d32369170f admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:03.709903 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e730a498-8bc9-43ef-9080-73d32369170f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:03.715446 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e730a498-8bc9-43ef-9080-73d32369170f admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:03.751515 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 876/1763] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:03 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:03.754690 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793d58d-deec-48c8-8c7c-2f66d794d329 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:03.755821 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793d58d-deec-48c8-8c7c-2f66d794d329 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:03.757040 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793d58d-deec-48c8-8c7c-2f66d794d329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:03.824648 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80621469-2226-4437-b39e-b19e63ecb594 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:03.833113 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-8793d58d-deec-48c8-8c7c-2f66d794d329 None None] MFA Rules not processed for user `524cf925744e4658b8c9f735dd541608`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:03.834581 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-8793d58d-deec-48c8-8c7c-2f66d794d329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:03.853146 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80621469-2226-4437-b39e-b19e63ecb594 service cinder] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:03.926528 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:03.929620 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 888/1764] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:03 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 828 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:12:03.956808 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4dc4f1-3bd5-46ed-ae3c-a344566734b3 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:03.957018 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4dc4f1-3bd5-46ed-ae3c-a344566734b3 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:03.957296 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4dc4f1-3bd5-46ed-ae3c-a344566734b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:04.047519 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 877/1765] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:12:03 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:04.049598 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8793d58d-deec-48c8-8c7c-2f66d794d329 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:04.076043 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8793d58d-deec-48c8-8c7c-2f66d794d329 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:04.091496 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8e0094-165b-435c-91cf-35c9c3eef33b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:04.092133 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8e0094-165b-435c-91cf-35c9c3eef33b admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:04.092417 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8e0094-165b-435c-91cf-35c9c3eef33b admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:04.092689 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8e0094-165b-435c-91cf-35c9c3eef33b admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:04.093370 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8e0094-165b-435c-91cf-35c9c3eef33b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:04.095326 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8e0094-165b-435c-91cf-35c9c3eef33b admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:04.119473 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 878/1766] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:04 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:04.120520 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8e0094-165b-435c-91cf-35c9c3eef33b admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:04.126632 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-5f4dc4f1-3bd5-46ed-ae3c-a344566734b3 None None] MFA Rules not processed for user `3a68abb5f8ab421cb6044c9a9f579ba6`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:04.133495 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-5f4dc4f1-3bd5-46ed-ae3c-a344566734b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:04.141152 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8e0094-165b-435c-91cf-35c9c3eef33b admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:04.176772 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc847877-7f9f-4632-a9ec-4f60599cc48c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:04.184174 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc847877-7f9f-4632-a9ec-4f60599cc48c admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:04.185364 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc847877-7f9f-4632-a9ec-4f60599cc48c admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:04.185778 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc847877-7f9f-4632-a9ec-4f60599cc48c admin admin] PATH_INFO: `/v3/projects/99c35af69def41479d8092bb0aaa61c5/users/a6b48132ea894588878906628fe478d6/roles/fe9bbc67742f4f5893f39b18eb31d59a` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:04.241762 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc847877-7f9f-4632-a9ec-4f60599cc48c admin admin] RBAC: Authorizing `identity:create_grant(project_id=99c35af69def41479d8092bb0aaa61c5, user_id=a6b48132ea894588878906628fe478d6, role_id=fe9bbc67742f4f5893f39b18eb31d59a)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:04.250695 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc847877-7f9f-4632-a9ec-4f60599cc48c admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:04.287907 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 879/1767] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:12:04 2022] PUT /identity/v3/projects/99c35af69def41479d8092bb0aaa61c5/users/a6b48132ea894588878906628fe478d6/roles/fe9bbc67742f4f5893f39b18eb31d59a => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:04.290712 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc847877-7f9f-4632-a9ec-4f60599cc48c admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:04.302440 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-cc847877-7f9f-4632-a9ec-4f60599cc48c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:04.310684 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 889/1768] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:12:03 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 376 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:04.310684 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4dc4f1-3bd5-46ed-ae3c-a344566734b3 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:04.351437 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4dc4f1-3bd5-46ed-ae3c-a344566734b3 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:04.495413 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea2a593-6523-44db-a2df-043080a0df50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:04.497971 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2a593-6523-44db-a2df-043080a0df50 admin admin] REQUEST_METHOD: `PUT` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:04.498189 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2a593-6523-44db-a2df-043080a0df50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:04.498300 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2a593-6523-44db-a2df-043080a0df50 admin admin] PATH_INFO: `/v3/projects/b2b771f7f618417aaa920f52182a9949/users/b5ee7a619dbd4f31bd3ddfd10f127e0f/roles/fe9bbc67742f4f5893f39b18eb31d59a` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:04.520464 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc847877-7f9f-4632-a9ec-4f60599cc48c admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:04.543565 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103d631f-3537-4da7-8968-cc2a6a30635b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75135b856134ba4b9ccac337886f682', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:04.544252 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d631f-3537-4da7-8968-cc2a6a30635b service cinder] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:04.544652 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea2a593-6523-44db-a2df-043080a0df50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2b771f7f618417aaa920f52182a9949, user_id=b5ee7a619dbd4f31bd3ddfd10f127e0f, role_id=fe9bbc67742f4f5893f39b18eb31d59a)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:04.544773 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d631f-3537-4da7-8968-cc2a6a30635b service cinder] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:04.545128 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d631f-3537-4da7-8968-cc2a6a30635b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:04.550846 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea2a593-6523-44db-a2df-043080a0df50 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:04.593672 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 890/1769] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:12:04 2022] PUT /identity/v3/projects/b2b771f7f618417aaa920f52182a9949/users/b5ee7a619dbd4f31bd3ddfd10f127e0f/roles/fe9bbc67742f4f5893f39b18eb31d59a => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:04.593672 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea2a593-6523-44db-a2df-043080a0df50 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:04.708623 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea2a593-6523-44db-a2df-043080a0df50 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:04.714972 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c720dc-b4fe-4dbd-9d09-ef9407e6f760 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75135b856134ba4b9ccac337886f682', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:04.716036 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c720dc-b4fe-4dbd-9d09-ef9407e6f760 service cinder] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:04.717111 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c720dc-b4fe-4dbd-9d09-ef9407e6f760 service cinder] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:04.717820 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c720dc-b4fe-4dbd-9d09-ef9407e6f760 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:04.737085 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:04.738426 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103d631f-3537-4da7-8968-cc2a6a30635b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:04.765528 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103d631f-3537-4da7-8968-cc2a6a30635b service cinder] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:04.795835 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 880/1770] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:04 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:12:04.799808 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103d631f-3537-4da7-8968-cc2a6a30635b service cinder] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:04.840611 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103d631f-3537-4da7-8968-cc2a6a30635b service cinder] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:05.024658 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c720dc-b4fe-4dbd-9d09-ef9407e6f760 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:05.034713 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:05.038704 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c720dc-b4fe-4dbd-9d09-ef9407e6f760 service cinder] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:05.093259 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4851e20-1e11-4076-aae0-b77fe3fa8193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:05.095073 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4851e20-1e11-4076-aae0-b77fe3fa8193 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:05.095550 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4851e20-1e11-4076-aae0-b77fe3fa8193 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:05.095842 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4851e20-1e11-4076-aae0-b77fe3fa8193 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:05.096998 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4851e20-1e11-4076-aae0-b77fe3fa8193 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:05.099193 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4851e20-1e11-4076-aae0-b77fe3fa8193 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:05.113414 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 891/1771] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:04 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:12:05.114469 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c720dc-b4fe-4dbd-9d09-ef9407e6f760 service cinder] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:05.125921 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 881/1772] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:04 2022] GET /identity/v3/roles => generated 1420 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:05.126897 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4851e20-1e11-4076-aae0-b77fe3fa8193 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:05.142340 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4851e20-1e11-4076-aae0-b77fe3fa8193 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:05.148354 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9354c7bf-a96a-4555-93d7-382adf819ed8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75135b856134ba4b9ccac337886f682', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:05.148992 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9354c7bf-a96a-4555-93d7-382adf819ed8 service cinder] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:05.149966 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9354c7bf-a96a-4555-93d7-382adf819ed8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:05.150905 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9354c7bf-a96a-4555-93d7-382adf819ed8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:05.152832 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c720dc-b4fe-4dbd-9d09-ef9407e6f760 service cinder] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:05.168574 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5bd9af-5401-4380-8aa5-27956bc59fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:05.169135 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5bd9af-5401-4380-8aa5-27956bc59fa5 admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:05.169479 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5bd9af-5401-4380-8aa5-27956bc59fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:05.169774 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5bd9af-5401-4380-8aa5-27956bc59fa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:05.170641 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5bd9af-5401-4380-8aa5-27956bc59fa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:05.172446 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5bd9af-5401-4380-8aa5-27956bc59fa5 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:05.208861 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 892/1773] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:05 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:05.213635 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d55a9a-9687-4d66-b8bb-b06470d59b65 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:05.214852 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d55a9a-9687-4d66-b8bb-b06470d59b65 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:05.216088 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d55a9a-9687-4d66-b8bb-b06470d59b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:05.332425 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9354c7bf-a96a-4555-93d7-382adf819ed8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:05.347428 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9354c7bf-a96a-4555-93d7-382adf819ed8 service cinder] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:05.385481 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-35d55a9a-9687-4d66-b8bb-b06470d59b65 None None] MFA Rules not processed for user `0f8f13f302de4701a7f4e0562bca08cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:05.388770 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 882/1774] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:05 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:12:05.389889 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-35d55a9a-9687-4d66-b8bb-b06470d59b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:05.390465 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9354c7bf-a96a-4555-93d7-382adf819ed8 service cinder] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:05.423426 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9354c7bf-a96a-4555-93d7-382adf819ed8 service cinder] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:05.440954 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe5c2a5-8157-428f-979c-847b17c0b50a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:05.445021 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe5c2a5-8157-428f-979c-847b17c0b50a admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:05.445355 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe5c2a5-8157-428f-979c-847b17c0b50a admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:05.445615 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe5c2a5-8157-428f-979c-847b17c0b50a admin admin] PATH_INFO: `/v3/projects/99c35af69def41479d8092bb0aaa61c5/users/a6b48132ea894588878906628fe478d6/roles/fe9bbc67742f4f5893f39b18eb31d59a` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:05.450573 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe5c2a5-8157-428f-979c-847b17c0b50a admin admin] RBAC: Authorizing `identity:create_grant(project_id=99c35af69def41479d8092bb0aaa61c5, user_id=a6b48132ea894588878906628fe478d6, role_id=fe9bbc67742f4f5893f39b18eb31d59a)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:05.459858 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe5c2a5-8157-428f-979c-847b17c0b50a admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:05.523902 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 883/1775] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:12:05 2022] PUT /identity/v3/projects/99c35af69def41479d8092bb0aaa61c5/users/a6b48132ea894588878906628fe478d6/roles/fe9bbc67742f4f5893f39b18eb31d59a => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:05.529851 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe5c2a5-8157-428f-979c-847b17c0b50a admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:05.591003 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 893/1776] 10.222.0.49 () {58 vars in 1009 bytes} [Thu Sep 29 02:12:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 381 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:05.592890 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2dc57e-936b-4d97-a0c4-440f5fb805c0 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:05.593183 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2dc57e-936b-4d97-a0c4-440f5fb805c0 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:05.595098 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2dc57e-936b-4d97-a0c4-440f5fb805c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:05.715224 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe5c2a5-8157-428f-979c-847b17c0b50a admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:05.718496 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-5f2dc57e-936b-4d97-a0c4-440f5fb805c0 None None] MFA Rules not processed for user `a6b48132ea894588878906628fe478d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:05.721636 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-5f2dc57e-936b-4d97-a0c4-440f5fb805c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:05.727824 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4151e7-0868-4ede-9dfb-866e40f97807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:05.729269 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4151e7-0868-4ede-9dfb-866e40f97807 admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:05.729663 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4151e7-0868-4ede-9dfb-866e40f97807 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:05.730220 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4151e7-0868-4ede-9dfb-866e40f97807 admin admin] PATH_INFO: `/v3/projects/b2b771f7f618417aaa920f52182a9949/users/b5ee7a619dbd4f31bd3ddfd10f127e0f/roles/fe9bbc67742f4f5893f39b18eb31d59a` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:05.735958 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4151e7-0868-4ede-9dfb-866e40f97807 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2b771f7f618417aaa920f52182a9949, user_id=b5ee7a619dbd4f31bd3ddfd10f127e0f, role_id=fe9bbc67742f4f5893f39b18eb31d59a)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:05.743485 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4151e7-0868-4ede-9dfb-866e40f97807 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:05.771026 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 884/1777] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:12:05 2022] PUT /identity/v3/projects/b2b771f7f618417aaa920f52182a9949/users/b5ee7a619dbd4f31bd3ddfd10f127e0f/roles/fe9bbc67742f4f5893f39b18eb31d59a => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:05.935971 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4151e7-0868-4ede-9dfb-866e40f97807 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:05.938180 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-3e4151e7-0868-4ede-9dfb-866e40f97807 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:05.979912 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:06.011036 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 894/1778] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:12:05 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 419 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:06.024631 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2dc57e-936b-4d97-a0c4-440f5fb805c0 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:06.115533 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:06.195851 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2dc57e-936b-4d97-a0c4-440f5fb805c0 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:06.235772 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4151e7-0868-4ede-9dfb-866e40f97807 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:06.255342 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f845b5af-3541-497d-b535-465ae563c6f7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c88bc0f32600416ca7c6a59f4196e497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:06.256307 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f845b5af-3541-497d-b535-465ae563c6f7 service swift] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:06.257338 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f845b5af-3541-497d-b535-465ae563c6f7 service swift] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:06.257756 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f845b5af-3541-497d-b535-465ae563c6f7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:06.322763 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a35ade-b87d-4aa9-b031-8ae0460490d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75135b856134ba4b9ccac337886f682', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:06.324373 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a35ade-b87d-4aa9-b031-8ae0460490d2 service cinder] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:06.324898 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a35ade-b87d-4aa9-b031-8ae0460490d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:06.325169 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a35ade-b87d-4aa9-b031-8ae0460490d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:06.399716 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f845b5af-3541-497d-b535-465ae563c6f7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:06.401812 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f845b5af-3541-497d-b535-465ae563c6f7 service swift] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:06.436456 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 885/1779] 10.222.0.49 () {60 vars in 1384 bytes} [Thu Sep 29 02:12:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 29 02:12:06.509208 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a35ade-b87d-4aa9-b031-8ae0460490d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:06.513030 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a35ade-b87d-4aa9-b031-8ae0460490d2 service cinder] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:06.562824 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 895/1780] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:06 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 539 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:12:07.684466 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f845b5af-3541-497d-b535-465ae563c6f7 service swift] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:07.927762 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f845b5af-3541-497d-b535-465ae563c6f7 service swift] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:07.954391 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93479411-2da3-42b3-8a53-dbfa704662e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:07.955131 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93479411-2da3-42b3-8a53-dbfa704662e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:07.955415 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93479411-2da3-42b3-8a53-dbfa704662e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:07.955696 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93479411-2da3-42b3-8a53-dbfa704662e4 admin admin] PATH_INFO: `/v3/users/5004001b7156426ea96c81192f8ac306` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:07.965631 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93479411-2da3-42b3-8a53-dbfa704662e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5004001b7156426ea96c81192f8ac306)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:07.972950 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93479411-2da3-42b3-8a53-dbfa704662e4 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:08.148648 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-93479411-2da3-42b3-8a53-dbfa704662e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5004001b7156426ea96c81192f8ac306'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:08.149943 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-93479411-2da3-42b3-8a53-dbfa704662e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5004001b7156426ea96c81192f8ac306'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:08.191246 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-93479411-2da3-42b3-8a53-dbfa704662e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5004001b7156426ea96c81192f8ac306'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:08.211519 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-93479411-2da3-42b3-8a53-dbfa704662e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5004001b7156426ea96c81192f8ac306'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:08.215419 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-93479411-2da3-42b3-8a53-dbfa704662e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5004001b7156426ea96c81192f8ac306'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:08.257515 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:08.316228 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 886/1781] 10.222.0.49 () {58 vars in 1224 bytes} [Thu Sep 29 02:12:07 2022] DELETE /identity/v3/users/5004001b7156426ea96c81192f8ac306 => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:08.320608 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f079777e-b139-4f4e-a03c-8a1cc38818c6 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:08.321135 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f079777e-b139-4f4e-a03c-8a1cc38818c6 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:08.321448 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f079777e-b139-4f4e-a03c-8a1cc38818c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:08.388088 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-f079777e-b139-4f4e-a03c-8a1cc38818c6 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:08.389500 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-f079777e-b139-4f4e-a03c-8a1cc38818c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:08.595857 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:08.623560 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e654c119-9386-477d-83e2-8e814da4e511 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:08.624560 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e654c119-9386-477d-83e2-8e814da4e511 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:08.626638 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 896/1782] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:12:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:08.630618 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e654c119-9386-477d-83e2-8e814da4e511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:08.673570 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f079777e-b139-4f4e-a03c-8a1cc38818c6 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:08.674927 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-f079777e-b139-4f4e-a03c-8a1cc38818c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:08.715290 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-e654c119-9386-477d-83e2-8e814da4e511 None None] MFA Rules not processed for user `2053f823bd3c4098a43c299890c1f733`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:08.728007 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-e654c119-9386-477d-83e2-8e814da4e511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:08.881929 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f079777e-b139-4f4e-a03c-8a1cc38818c6 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:08.897199 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531b5650-4d86-4ffe-b3cd-a09d7e80ed7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:08.897860 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531b5650-4d86-4ffe-b3cd-a09d7e80ed7b service neutron] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:08.898180 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531b5650-4d86-4ffe-b3cd-a09d7e80ed7b service neutron] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:08.898406 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531b5650-4d86-4ffe-b3cd-a09d7e80ed7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:08.929945 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 887/1783] 10.222.0.16 () {58 vars in 1015 bytes} [Thu Sep 29 02:12:08 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:08.943714 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531b5650-4d86-4ffe-b3cd-a09d7e80ed7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:08.945389 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531b5650-4d86-4ffe-b3cd-a09d7e80ed7b service neutron] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:09.005502 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 897/1784] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 29 02:12:09.071556 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e654c119-9386-477d-83e2-8e814da4e511 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:09.091753 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e654c119-9386-477d-83e2-8e814da4e511 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:09.112751 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c37979-6e71-4d7b-a65f-7454b507f523 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:09.113773 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c37979-6e71-4d7b-a65f-7454b507f523 service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:09.114198 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c37979-6e71-4d7b-a65f-7454b507f523 service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:09.114723 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c37979-6e71-4d7b-a65f-7454b507f523 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:09.162759 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c37979-6e71-4d7b-a65f-7454b507f523 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:09.169612 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c37979-6e71-4d7b-a65f-7454b507f523 service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:09.236954 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 888/1785] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:12:11.407567 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531b5650-4d86-4ffe-b3cd-a09d7e80ed7b service neutron] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:11.409081 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-531b5650-4d86-4ffe-b3cd-a09d7e80ed7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:11.441094 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531b5650-4d86-4ffe-b3cd-a09d7e80ed7b service neutron] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:11.463670 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209cfec1-d363-4797-9cee-d5cc10f95ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:11.464335 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209cfec1-d363-4797-9cee-d5cc10f95ec4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:11.464657 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209cfec1-d363-4797-9cee-d5cc10f95ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:11.464877 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209cfec1-d363-4797-9cee-d5cc10f95ec4 admin admin] PATH_INFO: `/v3/users/b63214efce86478b8e18b0efa08ee51d` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:11.469795 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209cfec1-d363-4797-9cee-d5cc10f95ec4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b63214efce86478b8e18b0efa08ee51d)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:11.475371 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209cfec1-d363-4797-9cee-d5cc10f95ec4 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:11.601988 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-209cfec1-d363-4797-9cee-d5cc10f95ec4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b63214efce86478b8e18b0efa08ee51d'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:11.608615 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-209cfec1-d363-4797-9cee-d5cc10f95ec4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b63214efce86478b8e18b0efa08ee51d'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:11.656025 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-209cfec1-d363-4797-9cee-d5cc10f95ec4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b63214efce86478b8e18b0efa08ee51d'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:11.675908 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-209cfec1-d363-4797-9cee-d5cc10f95ec4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b63214efce86478b8e18b0efa08ee51d'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:11.676552 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-209cfec1-d363-4797-9cee-d5cc10f95ec4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b63214efce86478b8e18b0efa08ee51d'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:11.710834 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c37979-6e71-4d7b-a65f-7454b507f523 service neutron] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:11.712993 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-f0c37979-6e71-4d7b-a65f-7454b507f523 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:11.723905 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 898/1786] 10.222.0.49 () {58 vars in 1224 bytes} [Thu Sep 29 02:12:11 2022] DELETE /identity/v3/users/b63214efce86478b8e18b0efa08ee51d => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:11.735473 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8265a40-5046-42f3-8103-8728ec6d4dbc None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:11.735889 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8265a40-5046-42f3-8103-8728ec6d4dbc None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:11.736172 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8265a40-5046-42f3-8103-8728ec6d4dbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:11.754818 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c37979-6e71-4d7b-a65f-7454b507f523 service neutron] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:11.805363 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-d8265a40-5046-42f3-8103-8728ec6d4dbc None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:11.807049 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-d8265a40-5046-42f3-8103-8728ec6d4dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:11.942952 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e650e6f-fb2c-46ba-be5d-4b4adea6e56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:11.943336 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e650e6f-fb2c-46ba-be5d-4b4adea6e56e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:11.943694 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e650e6f-fb2c-46ba-be5d-4b4adea6e56e admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:11.943998 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e650e6f-fb2c-46ba-be5d-4b4adea6e56e admin admin] PATH_INFO: `/v3/projects/6dbd98e0328846ea82155c66aca4287a` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:11.946180 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e650e6f-fb2c-46ba-be5d-4b4adea6e56e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6dbd98e0328846ea82155c66aca4287a)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:11.948581 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e650e6f-fb2c-46ba-be5d-4b4adea6e56e admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:11.993276 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 899/1787] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:12:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:12.094856 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-1e650e6f-fb2c-46ba-be5d-4b4adea6e56e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6dbd98e0328846ea82155c66aca4287a', 'request_id': 'req-1e650e6f-fb2c-46ba-be5d-4b4adea6e56e'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:12.101756 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-1e650e6f-fb2c-46ba-be5d-4b4adea6e56e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6dbd98e0328846ea82155c66aca4287a', 'request_id': 'req-1e650e6f-fb2c-46ba-be5d-4b4adea6e56e'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:12.122193 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-1e650e6f-fb2c-46ba-be5d-4b4adea6e56e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6dbd98e0328846ea82155c66aca4287a', 'request_id': 'req-1e650e6f-fb2c-46ba-be5d-4b4adea6e56e'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:12.138743 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-1e650e6f-fb2c-46ba-be5d-4b4adea6e56e admin admin] The token cache is being invalidate because project 6dbd98e0328846ea82155c66aca4287a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81649) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:12:12.139042 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-1e650e6f-fb2c-46ba-be5d-4b4adea6e56e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:12.150376 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-1e650e6f-fb2c-46ba-be5d-4b4adea6e56e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:12.152246 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 889/1788] 10.222.0.49 () {58 vars in 1233 bytes} [Thu Sep 29 02:12:11 2022] DELETE /identity/v3/projects/6dbd98e0328846ea82155c66aca4287a => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:12:12.156444 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8265a40-5046-42f3-8103-8728ec6d4dbc None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:12.157913 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-d8265a40-5046-42f3-8103-8728ec6d4dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:12.162702 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e650e6f-fb2c-46ba-be5d-4b4adea6e56e admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:12.164113 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-1e650e6f-fb2c-46ba-be5d-4b4adea6e56e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:12.195537 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8265a40-5046-42f3-8103-8728ec6d4dbc None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:12.223776 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:12.226435 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:12.340145 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e650e6f-fb2c-46ba-be5d-4b4adea6e56e admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:12.348175 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3f1ea5-655c-400d-8ce5-1493a1c324f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:12.348824 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f1ea5-655c-400d-8ce5-1493a1c324f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:12.348979 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f1ea5-655c-400d-8ce5-1493a1c324f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:12.349357 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f1ea5-655c-400d-8ce5-1493a1c324f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:12.354997 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-bb3f1ea5-655c-400d-8ce5-1493a1c324f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:12.403317 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95986ba-0216-4733-a0b7-edc74c0f4c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:12.404464 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95986ba-0216-4733-a0b7-edc74c0f4c68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:12.404855 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95986ba-0216-4733-a0b7-edc74c0f4c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:12.405785 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95986ba-0216-4733-a0b7-edc74c0f4c68 admin admin] PATH_INFO: `/v3/users/a6b48132ea894588878906628fe478d6` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:12.410738 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95986ba-0216-4733-a0b7-edc74c0f4c68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6b48132ea894588878906628fe478d6)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:12.447674 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95986ba-0216-4733-a0b7-edc74c0f4c68 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:12.575255 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3f1ea5-655c-400d-8ce5-1493a1c324f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:12.576656 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3f1ea5-655c-400d-8ce5-1493a1c324f3 service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:12.624962 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 890/1789] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:12:12.678110 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-c95986ba-0216-4733-a0b7-edc74c0f4c68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6b48132ea894588878906628fe478d6'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:12.678810 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-c95986ba-0216-4733-a0b7-edc74c0f4c68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6b48132ea894588878906628fe478d6'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:12.713583 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-c95986ba-0216-4733-a0b7-edc74c0f4c68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6b48132ea894588878906628fe478d6'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:12.732642 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-c95986ba-0216-4733-a0b7-edc74c0f4c68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6b48132ea894588878906628fe478d6'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:12.733419 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-c95986ba-0216-4733-a0b7-edc74c0f4c68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6b48132ea894588878906628fe478d6'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:12.764788 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 900/1790] 10.222.0.49 () {58 vars in 1224 bytes} [Thu Sep 29 02:12:12 2022] DELETE /identity/v3/users/a6b48132ea894588878906628fe478d6 => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:13.547026 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2543c04-0f81-44ca-9077-99619d6d7255 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:13.547602 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2543c04-0f81-44ca-9077-99619d6d7255 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:13.547602 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2543c04-0f81-44ca-9077-99619d6d7255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:13.622601 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-e2543c04-0f81-44ca-9077-99619d6d7255 None None] MFA Rules not processed for user `b5ee7a619dbd4f31bd3ddfd10f127e0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:13.624308 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-e2543c04-0f81-44ca-9077-99619d6d7255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:13.911621 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a511d17-2fe3-41d8-8d8b-d235def3367e None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:13.912176 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a511d17-2fe3-41d8-8d8b-d235def3367e None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:13.912176 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a511d17-2fe3-41d8-8d8b-d235def3367e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:13.915776 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 891/1791] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:12:13 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:13.962807 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-8a511d17-2fe3-41d8-8d8b-d235def3367e None None] MFA Rules not processed for user `d94f9f739ade490e9e96b24d296a0e94`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:13.980032 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-8a511d17-2fe3-41d8-8d8b-d235def3367e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:14.208880 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 901/1792] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:12:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:14.220293 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2543c04-0f81-44ca-9077-99619d6d7255 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:14.222767 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-e2543c04-0f81-44ca-9077-99619d6d7255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:14.405074 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:14.452538 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2543c04-0f81-44ca-9077-99619d6d7255 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:14.467525 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7211a2-b4e0-4fe9-82a4-7867a1bb51ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3325a7111d447f4a9cf00c672d5420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:14.468162 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7211a2-b4e0-4fe9-82a4-7867a1bb51ce service nova] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:14.468439 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7211a2-b4e0-4fe9-82a4-7867a1bb51ce service nova] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:14.468711 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7211a2-b4e0-4fe9-82a4-7867a1bb51ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:14.475341 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-4e7211a2-b4e0-4fe9-82a4-7867a1bb51ce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:14.502006 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7211a2-b4e0-4fe9-82a4-7867a1bb51ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:14.506733 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7211a2-b4e0-4fe9-82a4-7867a1bb51ce service nova] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:14.533985 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 892/1793] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:12:15.674888 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a511d17-2fe3-41d8-8d8b-d235def3367e None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:15.677745 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-8a511d17-2fe3-41d8-8d8b-d235def3367e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:15.690866 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7211a2-b4e0-4fe9-82a4-7867a1bb51ce service nova] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:15.692390 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-4e7211a2-b4e0-4fe9-82a4-7867a1bb51ce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:15.761338 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:15.793863 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a511d17-2fe3-41d8-8d8b-d235def3367e None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:15.816418 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa54bfaa-e211-4a1f-aecd-6616c66f9706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:15.817259 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa54bfaa-e211-4a1f-aecd-6616c66f9706 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:15.820888 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa54bfaa-e211-4a1f-aecd-6616c66f9706 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:15.821292 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa54bfaa-e211-4a1f-aecd-6616c66f9706 admin admin] PATH_INFO: `/v3/projects/99c35af69def41479d8092bb0aaa61c5` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:15.823174 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa54bfaa-e211-4a1f-aecd-6616c66f9706 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99c35af69def41479d8092bb0aaa61c5)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:15.825273 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa54bfaa-e211-4a1f-aecd-6616c66f9706 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:15.907468 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7211a2-b4e0-4fe9-82a4-7867a1bb51ce service nova] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:15.933983 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd96d5ea-86de-4d8b-ac02-0f9521768b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:15.938755 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd96d5ea-86de-4d8b-ac02-0f9521768b12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:15.939213 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd96d5ea-86de-4d8b-ac02-0f9521768b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:15.939631 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd96d5ea-86de-4d8b-ac02-0f9521768b12 admin admin] PATH_INFO: `/v3/projects/22839ad03cae4035be0a3edf3bcdb495` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:15.943488 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd96d5ea-86de-4d8b-ac02-0f9521768b12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22839ad03cae4035be0a3edf3bcdb495)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:15.958650 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd96d5ea-86de-4d8b-ac02-0f9521768b12 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:16.118812 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-dd96d5ea-86de-4d8b-ac02-0f9521768b12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22839ad03cae4035be0a3edf3bcdb495', 'request_id': 'req-dd96d5ea-86de-4d8b-ac02-0f9521768b12'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:16.127041 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-dd96d5ea-86de-4d8b-ac02-0f9521768b12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22839ad03cae4035be0a3edf3bcdb495', 'request_id': 'req-dd96d5ea-86de-4d8b-ac02-0f9521768b12'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:16.127496 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-fa54bfaa-e211-4a1f-aecd-6616c66f9706 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99c35af69def41479d8092bb0aaa61c5', 'request_id': 'req-fa54bfaa-e211-4a1f-aecd-6616c66f9706'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:16.146256 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-dd96d5ea-86de-4d8b-ac02-0f9521768b12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22839ad03cae4035be0a3edf3bcdb495', 'request_id': 'req-dd96d5ea-86de-4d8b-ac02-0f9521768b12'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:16.154317 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-fa54bfaa-e211-4a1f-aecd-6616c66f9706 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99c35af69def41479d8092bb0aaa61c5', 'request_id': 'req-fa54bfaa-e211-4a1f-aecd-6616c66f9706'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:16.175104 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-dd96d5ea-86de-4d8b-ac02-0f9521768b12 admin admin] The token cache is being invalidate because project 22839ad03cae4035be0a3edf3bcdb495 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81649) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:12:16.176345 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-dd96d5ea-86de-4d8b-ac02-0f9521768b12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:16.186035 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-dd96d5ea-86de-4d8b-ac02-0f9521768b12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:16.188185 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 893/1794] 10.222.0.49 () {58 vars in 1233 bytes} [Thu Sep 29 02:12:15 2022] DELETE /identity/v3/projects/22839ad03cae4035be0a3edf3bcdb495 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:16.192127 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd96d5ea-86de-4d8b-ac02-0f9521768b12 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:16.194278 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-dd96d5ea-86de-4d8b-ac02-0f9521768b12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:16.201553 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-fa54bfaa-e211-4a1f-aecd-6616c66f9706 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99c35af69def41479d8092bb0aaa61c5', 'request_id': 'req-fa54bfaa-e211-4a1f-aecd-6616c66f9706'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:16.229035 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-fa54bfaa-e211-4a1f-aecd-6616c66f9706 admin admin] The token cache is being invalidate because project 99c35af69def41479d8092bb0aaa61c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81648) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:12:16.229741 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-fa54bfaa-e211-4a1f-aecd-6616c66f9706 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:16.230709 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-fa54bfaa-e211-4a1f-aecd-6616c66f9706 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:16.233540 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 902/1795] 10.222.0.49 () {58 vars in 1233 bytes} [Thu Sep 29 02:12:15 2022] DELETE /identity/v3/projects/99c35af69def41479d8092bb0aaa61c5 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:16.287582 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5203d10d-f93c-4b60-8628-009aed8e7a4b None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:16.287801 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5203d10d-f93c-4b60-8628-009aed8e7a4b None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:16.290963 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5203d10d-f93c-4b60-8628-009aed8e7a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:16.415955 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-5203d10d-f93c-4b60-8628-009aed8e7a4b None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:16.417574 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-5203d10d-f93c-4b60-8628-009aed8e7a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:16.443397 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 903/1796] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:12:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:16.444903 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a0c4e0-fbba-4694-a141-5a42166b7010 None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:16.445284 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a0c4e0-fbba-4694-a141-5a42166b7010 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:16.445665 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a0c4e0-fbba-4694-a141-5a42166b7010 None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:16.451104 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 904/1797] 10.222.0.49 () {54 vars in 921 bytes} [Thu Sep 29 02:12:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:12:16.456580 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd96d5ea-86de-4d8b-ac02-0f9521768b12 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:16.457875 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725d858b-dc3c-44a3-aa66-eaccb26e4274 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:16.458286 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725d858b-dc3c-44a3-aa66-eaccb26e4274 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:16.458643 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725d858b-dc3c-44a3-aa66-eaccb26e4274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:16.475990 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf98aee-f719-4290-9a80-6c10a5bf6c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:16.479204 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf98aee-f719-4290-9a80-6c10a5bf6c3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:16.480734 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf98aee-f719-4290-9a80-6c10a5bf6c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:16.483205 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf98aee-f719-4290-9a80-6c10a5bf6c3d admin admin] PATH_INFO: `/v3/users/f6981b5f946845e1aec02038efffe959` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:16.488173 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf98aee-f719-4290-9a80-6c10a5bf6c3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6981b5f946845e1aec02038efffe959)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:16.501460 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf98aee-f719-4290-9a80-6c10a5bf6c3d admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:16.523514 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:16.527891 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-725d858b-dc3c-44a3-aa66-eaccb26e4274 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:16.533744 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-725d858b-dc3c-44a3-aa66-eaccb26e4274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:16.563078 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 905/1798] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:12:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:16.567756 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725d858b-dc3c-44a3-aa66-eaccb26e4274 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:16.603690 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725d858b-dc3c-44a3-aa66-eaccb26e4274 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:16.614033 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca4c4e5-7f3b-49ba-aa2e-48648debe686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:16.614664 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca4c4e5-7f3b-49ba-aa2e-48648debe686 admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:16.615483 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca4c4e5-7f3b-49ba-aa2e-48648debe686 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:16.615761 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca4c4e5-7f3b-49ba-aa2e-48648debe686 admin admin] PATH_INFO: `/v3/domains` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:16.616425 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca4c4e5-7f3b-49ba-aa2e-48648debe686 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:12:16.616734 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca4c4e5-7f3b-49ba-aa2e-48648debe686 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:16.618443 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca4c4e5-7f3b-49ba-aa2e-48648debe686 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:16.640950 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-ecf98aee-f719-4290-9a80-6c10a5bf6c3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6981b5f946845e1aec02038efffe959'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:16.644740 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-ecf98aee-f719-4290-9a80-6c10a5bf6c3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6981b5f946845e1aec02038efffe959'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:16.678701 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 906/1799] 10.222.0.49 () {58 vars in 1153 bytes} [Thu Sep 29 02:12:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:12:16.679544 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca4c4e5-7f3b-49ba-aa2e-48648debe686 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:16.694261 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-cca4c4e5-7f3b-49ba-aa2e-48648debe686 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:16.697977 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-ecf98aee-f719-4290-9a80-6c10a5bf6c3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6981b5f946845e1aec02038efffe959'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:16.713684 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-ecf98aee-f719-4290-9a80-6c10a5bf6c3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6981b5f946845e1aec02038efffe959'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:16.714433 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-ecf98aee-f719-4290-9a80-6c10a5bf6c3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6981b5f946845e1aec02038efffe959'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:16.740504 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca4c4e5-7f3b-49ba-aa2e-48648debe686 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:16.755184 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d6b7a5-5a23-45bd-b168-fce6d3bf4e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:16.756156 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d6b7a5-5a23-45bd-b168-fce6d3bf4e74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:16.758552 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d6b7a5-5a23-45bd-b168-fce6d3bf4e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:16.759281 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d6b7a5-5a23-45bd-b168-fce6d3bf4e74 admin admin] PATH_INFO: `/v3/users/ea1a24d2169a4106ac58dbd4a368e082` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:16.763117 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d6b7a5-5a23-45bd-b168-fce6d3bf4e74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea1a24d2169a4106ac58dbd4a368e082)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:16.768300 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 894/1800] 10.222.0.49 () {58 vars in 1224 bytes} [Thu Sep 29 02:12:16 2022] DELETE /identity/v3/users/f6981b5f946845e1aec02038efffe959 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:16.770108 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae2803-5d77-41bd-b354-97175763d600 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:16.772029 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d6b7a5-5a23-45bd-b168-fce6d3bf4e74 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:16.772580 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae2803-5d77-41bd-b354-97175763d600 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:16.773649 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae2803-5d77-41bd-b354-97175763d600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:16.830769 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-16ae2803-5d77-41bd-b354-97175763d600 None None] MFA Rules not processed for user `f3325a7111d447f4a9cf00c672d5420f`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:16.832991 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-16ae2803-5d77-41bd-b354-97175763d600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:16.910396 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-c2d6b7a5-5a23-45bd-b168-fce6d3bf4e74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea1a24d2169a4106ac58dbd4a368e082'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:16.912937 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-c2d6b7a5-5a23-45bd-b168-fce6d3bf4e74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea1a24d2169a4106ac58dbd4a368e082'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:16.948963 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-c2d6b7a5-5a23-45bd-b168-fce6d3bf4e74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea1a24d2169a4106ac58dbd4a368e082'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:16.964235 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-c2d6b7a5-5a23-45bd-b168-fce6d3bf4e74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea1a24d2169a4106ac58dbd4a368e082'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:16.968703 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-c2d6b7a5-5a23-45bd-b168-fce6d3bf4e74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea1a24d2169a4106ac58dbd4a368e082'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:17.021489 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 907/1801] 10.222.0.49 () {58 vars in 1224 bytes} [Thu Sep 29 02:12:16 2022] DELETE /identity/v3/users/ea1a24d2169a4106ac58dbd4a368e082 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:17.025384 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be41469-444a-4902-a3f6-a8c733d5b60e None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:17.026610 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be41469-444a-4902-a3f6-a8c733d5b60e None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:17.027607 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be41469-444a-4902-a3f6-a8c733d5b60e None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:17.031429 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 908/1802] 10.222.0.49 () {54 vars in 921 bytes} [Thu Sep 29 02:12:17 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:12:17.035052 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be41469-444a-4902-a3f6-a8c733d5b60e None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:17.042770 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-9be41469-444a-4902-a3f6-a8c733d5b60e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:17.067609 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 895/1803] 10.222.0.49 () {58 vars in 1018 bytes} [Thu Sep 29 02:12:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:17.084025 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b4330e-13aa-4b2d-8ac3-cdc612692479 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:17.084888 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b4330e-13aa-4b2d-8ac3-cdc612692479 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:17.085738 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b4330e-13aa-4b2d-8ac3-cdc612692479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:17.090509 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:17.139476 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-03b4330e-13aa-4b2d-8ac3-cdc612692479 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:17.145151 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-03b4330e-13aa-4b2d-8ac3-cdc612692479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:17.186421 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be41469-444a-4902-a3f6-a8c733d5b60e None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:17.193642 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51abbf8-8705-4129-83df-4ab45d297fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:17.194536 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51abbf8-8705-4129-83df-4ab45d297fce admin admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:17.195220 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51abbf8-8705-4129-83df-4ab45d297fce admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:17.195818 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51abbf8-8705-4129-83df-4ab45d297fce admin admin] PATH_INFO: `/v3/projects` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:17.197346 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51abbf8-8705-4129-83df-4ab45d297fce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:17.200760 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51abbf8-8705-4129-83df-4ab45d297fce admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:17.270080 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 909/1804] 10.222.0.49 () {60 vars in 1153 bytes} [Thu Sep 29 02:12:17 2022] POST /identity/v3/projects => generated 369 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:17.272151 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9721fe69-222a-48ac-82de-3f5b2c63829b None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:17.272446 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9721fe69-222a-48ac-82de-3f5b2c63829b None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:17.275450 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9721fe69-222a-48ac-82de-3f5b2c63829b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:17.329290 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 896/1805] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:12:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:17.330167 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b4330e-13aa-4b2d-8ac3-cdc612692479 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:17.339920 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-9721fe69-222a-48ac-82de-3f5b2c63829b None None] MFA Rules not processed for user `f3325a7111d447f4a9cf00c672d5420f`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:17.344524 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-9721fe69-222a-48ac-82de-3f5b2c63829b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:17.362012 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b4330e-13aa-4b2d-8ac3-cdc612692479 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:17.426246 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:17.600760 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901cef0b-dbff-4ef6-b1e0-4a12b653ca38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:17.605879 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901cef0b-dbff-4ef6-b1e0-4a12b653ca38 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:17.606802 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901cef0b-dbff-4ef6-b1e0-4a12b653ca38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:17.607079 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901cef0b-dbff-4ef6-b1e0-4a12b653ca38 admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:17.610538 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901cef0b-dbff-4ef6-b1e0-4a12b653ca38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:17.616739 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901cef0b-dbff-4ef6-b1e0-4a12b653ca38 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:17.626041 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 910/1806] 10.222.0.49 () {58 vars in 1018 bytes} [Thu Sep 29 02:12:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:17.627669 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9721fe69-222a-48ac-82de-3f5b2c63829b None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:17.636228 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-9721fe69-222a-48ac-82de-3f5b2c63829b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:17.697563 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 897/1807] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 02:12:17 2022] POST /identity/v3/users => generated 285 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:17.698351 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901cef0b-dbff-4ef6-b1e0-4a12b653ca38 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:17.734641 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901cef0b-dbff-4ef6-b1e0-4a12b653ca38 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:17.758504 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfde6c8-ba3a-40f8-b87a-ba125006ab2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:17.759398 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfde6c8-ba3a-40f8-b87a-ba125006ab2c admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:17.759681 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfde6c8-ba3a-40f8-b87a-ba125006ab2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:17.759974 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfde6c8-ba3a-40f8-b87a-ba125006ab2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:17.760628 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfde6c8-ba3a-40f8-b87a-ba125006ab2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:17.762335 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfde6c8-ba3a-40f8-b87a-ba125006ab2c admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:17.794186 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 898/1808] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:17 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:17.795137 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfde6c8-ba3a-40f8-b87a-ba125006ab2c admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:17.817668 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfde6c8-ba3a-40f8-b87a-ba125006ab2c admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:17.822185 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9721fe69-222a-48ac-82de-3f5b2c63829b None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:17.827631 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deab734a-0193-41b4-bcf2-cbf99460e243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:17.828297 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deab734a-0193-41b4-bcf2-cbf99460e243 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:17.828527 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deab734a-0193-41b4-bcf2-cbf99460e243 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:17.830348 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79756606-40d1-4adf-b3d4-7014262cba9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:17.831107 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79756606-40d1-4adf-b3d4-7014262cba9e service neutron] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:17.831228 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79756606-40d1-4adf-b3d4-7014262cba9e service neutron] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:17.831485 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79756606-40d1-4adf-b3d4-7014262cba9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:17.832052 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deab734a-0193-41b4-bcf2-cbf99460e243 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:17.832816 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deab734a-0193-41b4-bcf2-cbf99460e243 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:17.834363 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deab734a-0193-41b4-bcf2-cbf99460e243 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:17.865683 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 899/1809] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:17 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:17.867865 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79756606-40d1-4adf-b3d4-7014262cba9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:17.870579 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79756606-40d1-4adf-b3d4-7014262cba9e service neutron] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:17.872106 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deab734a-0193-41b4-bcf2-cbf99460e243 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:17.905863 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 911/1810] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:12:17.912826 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deab734a-0193-41b4-bcf2-cbf99460e243 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:17.923673 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb657675-2c81-4ee8-831a-8def7bf71484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:17.924540 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb657675-2c81-4ee8-831a-8def7bf71484 admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:17.925900 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb657675-2c81-4ee8-831a-8def7bf71484 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:17.926358 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb657675-2c81-4ee8-831a-8def7bf71484 admin admin] PATH_INFO: `/v3/projects/db0b0db820654b159e5c24d03b0ee18d/users/140375110912435da3aaef7c99fbf4ee/roles/f157f905c9c94ccfbfb46e52d443e8f2` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:17.953744 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb657675-2c81-4ee8-831a-8def7bf71484 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db0b0db820654b159e5c24d03b0ee18d, user_id=140375110912435da3aaef7c99fbf4ee, role_id=f157f905c9c94ccfbfb46e52d443e8f2)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:17.967561 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb657675-2c81-4ee8-831a-8def7bf71484 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:18.010126 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 900/1811] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:12:17 2022] PUT /identity/v3/projects/db0b0db820654b159e5c24d03b0ee18d/users/140375110912435da3aaef7c99fbf4ee/roles/f157f905c9c94ccfbfb46e52d443e8f2 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:18.013104 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ac790-58ad-4b1a-85f3-772cd1ea9cbf None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:18.013557 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ac790-58ad-4b1a-85f3-772cd1ea9cbf None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:18.013826 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ac790-58ad-4b1a-85f3-772cd1ea9cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:18.088520 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-2d4ac790-58ad-4b1a-85f3-772cd1ea9cbf None None] MFA Rules not processed for user `140375110912435da3aaef7c99fbf4ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:18.089921 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-2d4ac790-58ad-4b1a-85f3-772cd1ea9cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:18.157720 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:18.271141 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 912/1812] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:12:18 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:18.276873 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb657675-2c81-4ee8-831a-8def7bf71484 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:18.406880 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb657675-2c81-4ee8-831a-8def7bf71484 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:18.426589 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84ea245-a0b7-497c-af7b-ead7405d03a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:18.427233 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ea245-a0b7-497c-af7b-ead7405d03a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:18.427515 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ea245-a0b7-497c-af7b-ead7405d03a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:18.427789 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ea245-a0b7-497c-af7b-ead7405d03a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:18.428440 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84ea245-a0b7-497c-af7b-ead7405d03a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:18.438189 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84ea245-a0b7-497c-af7b-ead7405d03a5 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:18.521741 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 901/1813] 10.222.0.49 () {60 vars in 1153 bytes} [Thu Sep 29 02:12:18 2022] POST /identity/v3/projects => generated 369 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 29 02:12:18.526475 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4ac790-58ad-4b1a-85f3-772cd1ea9cbf None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:18.544369 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4ac790-58ad-4b1a-85f3-772cd1ea9cbf None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:18.737022 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bc04c3-b910-4116-8084-6dbe28bdf659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:18.737735 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc04c3-b910-4116-8084-6dbe28bdf659 admin admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:18.738100 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc04c3-b910-4116-8084-6dbe28bdf659 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:18.738364 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc04c3-b910-4116-8084-6dbe28bdf659 admin admin] PATH_INFO: `/v3/users` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:18.739624 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bc04c3-b910-4116-8084-6dbe28bdf659 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:18.741742 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bc04c3-b910-4116-8084-6dbe28bdf659 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:18.796212 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 913/1814] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 02:12:18 2022] POST /identity/v3/users => generated 291 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:18.800369 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84ea245-a0b7-497c-af7b-ead7405d03a5 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:18.824329 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84ea245-a0b7-497c-af7b-ead7405d03a5 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:18.839670 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b7005e-57a1-4571-a77c-d3a5ac3e7962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:18.840484 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b7005e-57a1-4571-a77c-d3a5ac3e7962 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:18.842621 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b7005e-57a1-4571-a77c-d3a5ac3e7962 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:18.843713 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b7005e-57a1-4571-a77c-d3a5ac3e7962 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:18.845023 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b7005e-57a1-4571-a77c-d3a5ac3e7962 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:18.863834 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b7005e-57a1-4571-a77c-d3a5ac3e7962 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:18.937935 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 902/1815] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:18 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:18.952220 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bc04c3-b910-4116-8084-6dbe28bdf659 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:18.954267 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-84bc04c3-b910-4116-8084-6dbe28bdf659 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:18.956548 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b7005e-57a1-4571-a77c-d3a5ac3e7962 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:18.989692 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b7005e-57a1-4571-a77c-d3a5ac3e7962 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:19.015017 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb60523a-b04a-49d2-95dc-486c3344f7df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:19.015842 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb60523a-b04a-49d2-95dc-486c3344f7df admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:19.016254 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb60523a-b04a-49d2-95dc-486c3344f7df admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:19.016635 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb60523a-b04a-49d2-95dc-486c3344f7df admin admin] PATH_INFO: `/v3/projects/e1e7f4119ae749fcb790fe018a20bc00/users/2f18fd6cb19f4f30a889dd9e16931cf3/roles/fe9bbc67742f4f5893f39b18eb31d59a` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:19.087748 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb60523a-b04a-49d2-95dc-486c3344f7df admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1e7f4119ae749fcb790fe018a20bc00, user_id=2f18fd6cb19f4f30a889dd9e16931cf3, role_id=fe9bbc67742f4f5893f39b18eb31d59a)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:19.092430 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb60523a-b04a-49d2-95dc-486c3344f7df admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:19.144093 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 903/1816] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:12:18 2022] PUT /identity/v3/projects/e1e7f4119ae749fcb790fe018a20bc00/users/2f18fd6cb19f4f30a889dd9e16931cf3/roles/fe9bbc67742f4f5893f39b18eb31d59a => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:19.147779 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb60523a-b04a-49d2-95dc-486c3344f7df admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:19.217501 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:19.296794 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bc04c3-b910-4116-8084-6dbe28bdf659 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:19.338516 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb60523a-b04a-49d2-95dc-486c3344f7df admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:19.356291 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b874b024-23be-49e0-9a38-5a862e287b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:19.357204 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b874b024-23be-49e0-9a38-5a862e287b33 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:19.357685 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b874b024-23be-49e0-9a38-5a862e287b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:19.358141 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b874b024-23be-49e0-9a38-5a862e287b33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:19.358959 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b874b024-23be-49e0-9a38-5a862e287b33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:19.360694 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b874b024-23be-49e0-9a38-5a862e287b33 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:19.407836 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:19.410774 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 904/1817] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:19 2022] GET /identity/v3/roles => generated 1420 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 29 02:12:19.411850 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b874b024-23be-49e0-9a38-5a862e287b33 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:19.422681 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-b874b024-23be-49e0-9a38-5a862e287b33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:19.440880 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5e9883-0dff-4ce1-95f8-74e15b879f47 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3325a7111d447f4a9cf00c672d5420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:19.443542 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e9883-0dff-4ce1-95f8-74e15b879f47 service nova] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:19.444454 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e9883-0dff-4ce1-95f8-74e15b879f47 service nova] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:19.445369 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e9883-0dff-4ce1-95f8-74e15b879f47 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:19.472789 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5e9883-0dff-4ce1-95f8-74e15b879f47 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:19.480367 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5e9883-0dff-4ce1-95f8-74e15b879f47 service nova] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:19.519322 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 914/1818] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:12:19.521621 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5e9883-0dff-4ce1-95f8-74e15b879f47 service nova] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:19.567545 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5e9883-0dff-4ce1-95f8-74e15b879f47 service nova] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:19.590711 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce70dac2-7d96-457a-a67b-35f8895722bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:19.591406 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70dac2-7d96-457a-a67b-35f8895722bd admin admin] REQUEST_METHOD: `PUT` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:19.591725 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70dac2-7d96-457a-a67b-35f8895722bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:19.592099 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70dac2-7d96-457a-a67b-35f8895722bd admin admin] PATH_INFO: `/v3/projects/e1e7f4119ae749fcb790fe018a20bc00/users/2f18fd6cb19f4f30a889dd9e16931cf3/roles/fe9bbc67742f4f5893f39b18eb31d59a` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:19.599621 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce70dac2-7d96-457a-a67b-35f8895722bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1e7f4119ae749fcb790fe018a20bc00, user_id=2f18fd6cb19f4f30a889dd9e16931cf3, role_id=fe9bbc67742f4f5893f39b18eb31d59a)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:19.611433 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce70dac2-7d96-457a-a67b-35f8895722bd admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:19.704831 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 915/1819] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:12:19 2022] PUT /identity/v3/projects/e1e7f4119ae749fcb790fe018a20bc00/users/2f18fd6cb19f4f30a889dd9e16931cf3/roles/fe9bbc67742f4f5893f39b18eb31d59a => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:19.715732 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d3087-c27b-4f8d-a90f-b50c420330dc None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:19.718202 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d3087-c27b-4f8d-a90f-b50c420330dc None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:19.718481 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d3087-c27b-4f8d-a90f-b50c420330dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:19.731530 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b874b024-23be-49e0-9a38-5a862e287b33 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:19.818722 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-287d3087-c27b-4f8d-a90f-b50c420330dc None None] MFA Rules not processed for user `2f18fd6cb19f4f30a889dd9e16931cf3`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:19.829297 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-287d3087-c27b-4f8d-a90f-b50c420330dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:19.870782 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3fd8d4-4d4e-4cb7-8905-d061ba7c0b77 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3325a7111d447f4a9cf00c672d5420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:19.878043 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3fd8d4-4d4e-4cb7-8905-d061ba7c0b77 service nova] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:19.878477 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3fd8d4-4d4e-4cb7-8905-d061ba7c0b77 service nova] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:19.879243 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3fd8d4-4d4e-4cb7-8905-d061ba7c0b77 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:19.895206 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3fd8d4-4d4e-4cb7-8905-d061ba7c0b77 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:19.897855 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3fd8d4-4d4e-4cb7-8905-d061ba7c0b77 service nova] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:19.920362 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 905/1820] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:12:19.921752 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3fd8d4-4d4e-4cb7-8905-d061ba7c0b77 service nova] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:19.923466 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-7c3fd8d4-4d4e-4cb7-8905-d061ba7c0b77 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:19.986315 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:20.023019 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3fd8d4-4d4e-4cb7-8905-d061ba7c0b77 service nova] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:20.029948 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5191fde6-5825-4bb9-888e-426f93e8f73b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:20.030875 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5191fde6-5825-4bb9-888e-426f93e8f73b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:20.031711 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5191fde6-5825-4bb9-888e-426f93e8f73b admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:20.032089 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5191fde6-5825-4bb9-888e-426f93e8f73b admin admin] PATH_INFO: `/v3/projects/3943215a39c54da2b460600c0fdd850f` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:20.043023 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5191fde6-5825-4bb9-888e-426f93e8f73b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3943215a39c54da2b460600c0fdd850f)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:20.050165 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5191fde6-5825-4bb9-888e-426f93e8f73b admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:20.081871 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 916/1821] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:12:19 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:20.093954 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287d3087-c27b-4f8d-a90f-b50c420330dc None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:20.095771 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-287d3087-c27b-4f8d-a90f-b50c420330dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:20.138249 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-5191fde6-5825-4bb9-888e-426f93e8f73b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3943215a39c54da2b460600c0fdd850f', 'request_id': 'req-5191fde6-5825-4bb9-888e-426f93e8f73b'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:20.146338 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-5191fde6-5825-4bb9-888e-426f93e8f73b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3943215a39c54da2b460600c0fdd850f', 'request_id': 'req-5191fde6-5825-4bb9-888e-426f93e8f73b'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:20.173944 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-5191fde6-5825-4bb9-888e-426f93e8f73b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3943215a39c54da2b460600c0fdd850f', 'request_id': 'req-5191fde6-5825-4bb9-888e-426f93e8f73b'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:20.186595 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287d3087-c27b-4f8d-a90f-b50c420330dc None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:20.207099 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-5191fde6-5825-4bb9-888e-426f93e8f73b admin admin] The token cache is being invalidate because project 3943215a39c54da2b460600c0fdd850f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81649) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:12:20.207777 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-5191fde6-5825-4bb9-888e-426f93e8f73b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:20.210034 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-5191fde6-5825-4bb9-888e-426f93e8f73b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:20.220037 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 906/1822] 10.222.0.49 () {58 vars in 1233 bytes} [Thu Sep 29 02:12:19 2022] DELETE /identity/v3/projects/3943215a39c54da2b460600c0fdd850f => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:20.225257 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5191fde6-5825-4bb9-888e-426f93e8f73b admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:20.229722 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-5191fde6-5825-4bb9-888e-426f93e8f73b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:20.295963 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4228e650-3381-429a-baca-ad501b541d3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75135b856134ba4b9ccac337886f682', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:20.297923 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4228e650-3381-429a-baca-ad501b541d3a service cinder] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:20.298451 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4228e650-3381-429a-baca-ad501b541d3a service cinder] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:20.299247 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4228e650-3381-429a-baca-ad501b541d3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:20.302647 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-4228e650-3381-429a-baca-ad501b541d3a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:20.334418 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5191fde6-5825-4bb9-888e-426f93e8f73b admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:20.342084 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dc7074-1a41-47b1-bd1d-f9d452824c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:20.343249 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc7074-1a41-47b1-bd1d-f9d452824c77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:20.343451 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc7074-1a41-47b1-bd1d-f9d452824c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:20.343685 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc7074-1a41-47b1-bd1d-f9d452824c77 admin admin] PATH_INFO: `/v3/users/524cf925744e4658b8c9f735dd541608` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:20.345196 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dc7074-1a41-47b1-bd1d-f9d452824c77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=524cf925744e4658b8c9f735dd541608)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:20.356692 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:20.364155 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dc7074-1a41-47b1-bd1d-f9d452824c77 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:20.451174 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4228e650-3381-429a-baca-ad501b541d3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:20.451768 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-83dc7074-1a41-47b1-bd1d-f9d452824c77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '524cf925744e4658b8c9f735dd541608'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:20.453293 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4228e650-3381-429a-baca-ad501b541d3a service cinder] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:20.455159 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-83dc7074-1a41-47b1-bd1d-f9d452824c77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '524cf925744e4658b8c9f735dd541608'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:20.477199 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 917/1823] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:20 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 29 02:12:20.481507 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4228e650-3381-429a-baca-ad501b541d3a service cinder] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:20.487431 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-83dc7074-1a41-47b1-bd1d-f9d452824c77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '524cf925744e4658b8c9f735dd541608'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:20.487658 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-4228e650-3381-429a-baca-ad501b541d3a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:20.494769 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:20.505184 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-83dc7074-1a41-47b1-bd1d-f9d452824c77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '524cf925744e4658b8c9f735dd541608'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:20.507337 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-83dc7074-1a41-47b1-bd1d-f9d452824c77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '524cf925744e4658b8c9f735dd541608'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:20.528526 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4228e650-3381-429a-baca-ad501b541d3a service cinder] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:20.544236 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 907/1824] 10.222.0.49 () {58 vars in 1224 bytes} [Thu Sep 29 02:12:20 2022] DELETE /identity/v3/users/524cf925744e4658b8c9f735dd541608 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:20.545156 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0087bd-cd2c-4e1e-b576-c5310962c13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:20.546016 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0087bd-cd2c-4e1e-b576-c5310962c13f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:20.546748 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0087bd-cd2c-4e1e-b576-c5310962c13f admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:20.552824 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dc7074-1a41-47b1-bd1d-f9d452824c77 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:20.555148 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0087bd-cd2c-4e1e-b576-c5310962c13f admin admin] PATH_INFO: `/v3/projects/838a3f1d4bd84a0bb7e770b58aa6b857` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:20.556269 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-83dc7074-1a41-47b1-bd1d-f9d452824c77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:20.559716 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0087bd-cd2c-4e1e-b576-c5310962c13f admin admin] RBAC: Authorizing `identity:delete_project(project_id=838a3f1d4bd84a0bb7e770b58aa6b857)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:20.565557 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0087bd-cd2c-4e1e-b576-c5310962c13f admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:20.639659 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-bd0087bd-cd2c-4e1e-b576-c5310962c13f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '838a3f1d4bd84a0bb7e770b58aa6b857', 'request_id': 'req-bd0087bd-cd2c-4e1e-b576-c5310962c13f'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:20.654293 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-bd0087bd-cd2c-4e1e-b576-c5310962c13f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '838a3f1d4bd84a0bb7e770b58aa6b857', 'request_id': 'req-bd0087bd-cd2c-4e1e-b576-c5310962c13f'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:20.663021 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dc7074-1a41-47b1-bd1d-f9d452824c77 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:20.669702 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-bd0087bd-cd2c-4e1e-b576-c5310962c13f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '838a3f1d4bd84a0bb7e770b58aa6b857', 'request_id': 'req-bd0087bd-cd2c-4e1e-b576-c5310962c13f'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:20.684743 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-bd0087bd-cd2c-4e1e-b576-c5310962c13f admin admin] The token cache is being invalidate because project 838a3f1d4bd84a0bb7e770b58aa6b857 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81648) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:12:20.685439 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-bd0087bd-cd2c-4e1e-b576-c5310962c13f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:20.688080 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-bd0087bd-cd2c-4e1e-b576-c5310962c13f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:20.694439 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 918/1825] 10.222.0.49 () {58 vars in 1233 bytes} [Thu Sep 29 02:12:20 2022] DELETE /identity/v3/projects/838a3f1d4bd84a0bb7e770b58aa6b857 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:20.695795 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d741d09-758c-4f9d-8bb2-5948c7afd496 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:20.696217 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d741d09-758c-4f9d-8bb2-5948c7afd496 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:20.696507 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d741d09-758c-4f9d-8bb2-5948c7afd496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:20.751587 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-8d741d09-758c-4f9d-8bb2-5948c7afd496 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:20.752839 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-8d741d09-758c-4f9d-8bb2-5948c7afd496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:20.767108 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0b4c65-254e-45fa-abea-1170a6506601 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75135b856134ba4b9ccac337886f682', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:20.768154 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b4c65-254e-45fa-abea-1170a6506601 service cinder] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:20.768512 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b4c65-254e-45fa-abea-1170a6506601 service cinder] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:20.768891 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b4c65-254e-45fa-abea-1170a6506601 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:20.774890 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-1d0b4c65-254e-45fa-abea-1170a6506601 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:20.873466 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 919/1826] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:12:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:20.877673 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1425a5fd-edc1-4dde-8486-c288c3066c7e None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:20.877961 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1425a5fd-edc1-4dde-8486-c288c3066c7e None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:20.878238 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1425a5fd-edc1-4dde-8486-c288c3066c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:20.897856 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0b4c65-254e-45fa-abea-1170a6506601 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:20.900965 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0b4c65-254e-45fa-abea-1170a6506601 service cinder] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:20.906638 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-1425a5fd-edc1-4dde-8486-c288c3066c7e None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:20.909758 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-1425a5fd-edc1-4dde-8486-c288c3066c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:20.922185 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 908/1827] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:20 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:12:20.930054 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 920/1828] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:12:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:20.934991 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0b4c65-254e-45fa-abea-1170a6506601 service cinder] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:20.947480 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0b4c65-254e-45fa-abea-1170a6506601 service cinder] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:20.952797 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e86e502-e43b-455a-9aab-0e453543e692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:20.953453 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86e502-e43b-455a-9aab-0e453543e692 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:20.953737 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86e502-e43b-455a-9aab-0e453543e692 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:20.954013 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86e502-e43b-455a-9aab-0e453543e692 admin admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:20.954668 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e86e502-e43b-455a-9aab-0e453543e692 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:12:20.954979 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e86e502-e43b-455a-9aab-0e453543e692 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:20.956565 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e86e502-e43b-455a-9aab-0e453543e692 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:20.969250 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 909/1829] 10.222.0.49 () {58 vars in 1153 bytes} [Thu Sep 29 02:12:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:12:20.973726 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1425a5fd-edc1-4dde-8486-c288c3066c7e None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:20.984850 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1425a5fd-edc1-4dde-8486-c288c3066c7e None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:20.990010 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c052618-75c9-4020-bc5b-3404060f8906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:20.990666 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c052618-75c9-4020-bc5b-3404060f8906 admin admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:20.991031 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c052618-75c9-4020-bc5b-3404060f8906 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:20.991368 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c052618-75c9-4020-bc5b-3404060f8906 admin admin] PATH_INFO: `/v3/projects` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:20.992067 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c052618-75c9-4020-bc5b-3404060f8906 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:20.994273 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c052618-75c9-4020-bc5b-3404060f8906 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:21.029582 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 921/1830] 10.222.0.49 () {60 vars in 1153 bytes} [Thu Sep 29 02:12:20 2022] POST /identity/v3/projects => generated 401 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 29 02:12:21.033254 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e86e502-e43b-455a-9aab-0e453543e692 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:21.043896 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e86e502-e43b-455a-9aab-0e453543e692 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:21.071106 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c052618-75c9-4020-bc5b-3404060f8906 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:21.073681 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-5c052618-75c9-4020-bc5b-3404060f8906 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:21.092412 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:21.123800 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:21.162321 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6fda48-d9dd-4022-a899-555330a506f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:21.163122 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6fda48-d9dd-4022-a899-555330a506f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:21.163508 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6fda48-d9dd-4022-a899-555330a506f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:21.163888 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6fda48-d9dd-4022-a899-555330a506f5 admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:21.164650 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6fda48-d9dd-4022-a899-555330a506f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:21.166968 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6fda48-d9dd-4022-a899-555330a506f5 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:21.168864 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c052618-75c9-4020-bc5b-3404060f8906 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:21.174920 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d403e46-6f98-4dd5-b988-fd8fd07ae1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:21.176176 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d403e46-6f98-4dd5-b988-fd8fd07ae1a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:21.176640 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d403e46-6f98-4dd5-b988-fd8fd07ae1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:21.177053 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d403e46-6f98-4dd5-b988-fd8fd07ae1a0 admin admin] PATH_INFO: `/v3/projects/16b3a5d5d52646d18cca73b1ac9a6f76` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:21.178497 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d403e46-6f98-4dd5-b988-fd8fd07ae1a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16b3a5d5d52646d18cca73b1ac9a6f76)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:21.181161 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d403e46-6f98-4dd5-b988-fd8fd07ae1a0 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:21.194735 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 910/1831] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 02:12:21 2022] POST /identity/v3/users => generated 301 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:21.198775 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6fda48-d9dd-4022-a899-555330a506f5 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:21.216611 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6fda48-d9dd-4022-a899-555330a506f5 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:21.223612 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c07a022-5a6a-42bb-b22b-48c7963acf78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:21.225763 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c07a022-5a6a-42bb-b22b-48c7963acf78 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:21.226052 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c07a022-5a6a-42bb-b22b-48c7963acf78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:21.226513 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c07a022-5a6a-42bb-b22b-48c7963acf78 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:21.227179 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c07a022-5a6a-42bb-b22b-48c7963acf78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:21.229273 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c07a022-5a6a-42bb-b22b-48c7963acf78 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:21.241737 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 911/1832] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:21 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:21.245475 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c07a022-5a6a-42bb-b22b-48c7963acf78 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:21.266101 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c07a022-5a6a-42bb-b22b-48c7963acf78 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:21.276625 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-4d403e46-6f98-4dd5-b988-fd8fd07ae1a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16b3a5d5d52646d18cca73b1ac9a6f76', 'request_id': 'req-4d403e46-6f98-4dd5-b988-fd8fd07ae1a0'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:21.284980 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-4d403e46-6f98-4dd5-b988-fd8fd07ae1a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16b3a5d5d52646d18cca73b1ac9a6f76', 'request_id': 'req-4d403e46-6f98-4dd5-b988-fd8fd07ae1a0'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:21.295266 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-4d403e46-6f98-4dd5-b988-fd8fd07ae1a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16b3a5d5d52646d18cca73b1ac9a6f76', 'request_id': 'req-4d403e46-6f98-4dd5-b988-fd8fd07ae1a0'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:21.309487 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-4d403e46-6f98-4dd5-b988-fd8fd07ae1a0 admin admin] The token cache is being invalidate because project 16b3a5d5d52646d18cca73b1ac9a6f76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81648) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:12:21.309776 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-4d403e46-6f98-4dd5-b988-fd8fd07ae1a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:21.311153 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-4d403e46-6f98-4dd5-b988-fd8fd07ae1a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:21.313381 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 922/1833] 10.222.0.49 () {58 vars in 1233 bytes} [Thu Sep 29 02:12:21 2022] DELETE /identity/v3/projects/16b3a5d5d52646d18cca73b1ac9a6f76 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:21.330886 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1247c-7557-47f6-86d0-dfb8e53e652f None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:21.331171 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1247c-7557-47f6-86d0-dfb8e53e652f None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:21.331446 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1247c-7557-47f6-86d0-dfb8e53e652f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:21.376532 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-98e1247c-7557-47f6-86d0-dfb8e53e652f None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:21.377870 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-98e1247c-7557-47f6-86d0-dfb8e53e652f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:21.379426 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07480a7c-1f5c-42fd-b4fe-45cfc908ccde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:21.380091 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07480a7c-1f5c-42fd-b4fe-45cfc908ccde admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:21.380309 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07480a7c-1f5c-42fd-b4fe-45cfc908ccde admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:21.380687 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07480a7c-1f5c-42fd-b4fe-45cfc908ccde admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:21.381474 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07480a7c-1f5c-42fd-b4fe-45cfc908ccde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:21.383366 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07480a7c-1f5c-42fd-b4fe-45cfc908ccde admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:21.388755 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 923/1834] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:12:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:21.395226 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 912/1835] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:21 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:21.396242 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d5ad9-e390-46bf-a739-7d96c7d30aa2 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:21.396526 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d5ad9-e390-46bf-a739-7d96c7d30aa2 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:21.396794 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d5ad9-e390-46bf-a739-7d96c7d30aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:21.399528 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07480a7c-1f5c-42fd-b4fe-45cfc908ccde admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:21.401418 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-07480a7c-1f5c-42fd-b4fe-45cfc908ccde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:21.413577 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07480a7c-1f5c-42fd-b4fe-45cfc908ccde admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:21.417073 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-a22d5ad9-e390-46bf-a739-7d96c7d30aa2 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:21.418291 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-a22d5ad9-e390-46bf-a739-7d96c7d30aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:21.418992 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c638aaa3-ca00-4e2e-9400-f9ec01174fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:21.419643 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c638aaa3-ca00-4e2e-9400-f9ec01174fc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:21.419940 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c638aaa3-ca00-4e2e-9400-f9ec01174fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:21.420319 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c638aaa3-ca00-4e2e-9400-f9ec01174fc0 admin admin] PATH_INFO: `/v3/projects/da407bf120a84aaa915a9597c64c954e/users/5465779876234f6cbbd78319d856befd/roles/f157f905c9c94ccfbfb46e52d443e8f2` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:21.426559 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 924/1836] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:12:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 29 02:12:21.431587 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22d5ad9-e390-46bf-a739-7d96c7d30aa2 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:21.437481 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c638aaa3-ca00-4e2e-9400-f9ec01174fc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da407bf120a84aaa915a9597c64c954e, user_id=5465779876234f6cbbd78319d856befd, role_id=f157f905c9c94ccfbfb46e52d443e8f2)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:21.440142 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c638aaa3-ca00-4e2e-9400-f9ec01174fc0 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:21.440383 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22d5ad9-e390-46bf-a739-7d96c7d30aa2 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:21.445102 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72360d4f-acf7-4163-99db-a0d73b49cc98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:21.445872 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72360d4f-acf7-4163-99db-a0d73b49cc98 admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:21.446296 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72360d4f-acf7-4163-99db-a0d73b49cc98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:21.446676 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72360d4f-acf7-4163-99db-a0d73b49cc98 admin admin] PATH_INFO: `/v3/domains` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:21.447395 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72360d4f-acf7-4163-99db-a0d73b49cc98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:12:21.447684 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72360d4f-acf7-4163-99db-a0d73b49cc98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:21.449682 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72360d4f-acf7-4163-99db-a0d73b49cc98 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:21.457112 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 913/1837] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:12:21 2022] PUT /identity/v3/projects/da407bf120a84aaa915a9597c64c954e/users/5465779876234f6cbbd78319d856befd/roles/f157f905c9c94ccfbfb46e52d443e8f2 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:12:21.468455 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2ba961-8007-4824-8a89-ed2dc560586b None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:21.468756 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2ba961-8007-4824-8a89-ed2dc560586b None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:21.469066 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2ba961-8007-4824-8a89-ed2dc560586b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:21.475037 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 925/1838] 10.222.0.49 () {58 vars in 1153 bytes} [Thu Sep 29 02:12:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:12:21.479610 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72360d4f-acf7-4163-99db-a0d73b49cc98 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:21.495003 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72360d4f-acf7-4163-99db-a0d73b49cc98 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:21.505565 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-0b2ba961-8007-4824-8a89-ed2dc560586b None None] MFA Rules not processed for user `5465779876234f6cbbd78319d856befd`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:21.506808 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-0b2ba961-8007-4824-8a89-ed2dc560586b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:21.568628 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1468e20-3f59-4de8-91f5-89d7ac0eef00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:21.569241 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1468e20-3f59-4de8-91f5-89d7ac0eef00 admin admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:21.569613 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1468e20-3f59-4de8-91f5-89d7ac0eef00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:21.569991 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1468e20-3f59-4de8-91f5-89d7ac0eef00 admin admin] PATH_INFO: `/v3/projects` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:21.570624 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1468e20-3f59-4de8-91f5-89d7ac0eef00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:21.573177 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1468e20-3f59-4de8-91f5-89d7ac0eef00 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:21.583328 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 914/1839] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:12:21 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:21.584317 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2ba961-8007-4824-8a89-ed2dc560586b None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:21.596061 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2ba961-8007-4824-8a89-ed2dc560586b None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:21.602835 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de00a64-e567-4407-9255-1fd4e22b7c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:21.603846 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de00a64-e567-4407-9255-1fd4e22b7c48 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:21.604118 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de00a64-e567-4407-9255-1fd4e22b7c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:21.604385 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de00a64-e567-4407-9255-1fd4e22b7c48 admin admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:21.605618 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:21.606579 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de00a64-e567-4407-9255-1fd4e22b7c48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:21.608810 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de00a64-e567-4407-9255-1fd4e22b7c48 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:21.617271 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 926/1840] 10.222.0.49 () {60 vars in 1153 bytes} [Thu Sep 29 02:12:21 2022] POST /identity/v3/projects => generated 365 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:21.618624 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1468e20-3f59-4de8-91f5-89d7ac0eef00 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:21.638837 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:21.653416 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 915/1841] 10.222.0.49 () {60 vars in 1153 bytes} [Thu Sep 29 02:12:21 2022] POST /identity/v3/projects => generated 401 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 29 02:12:21.654513 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de00a64-e567-4407-9255-1fd4e22b7c48 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:21.713636 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1468e20-3f59-4de8-91f5-89d7ac0eef00 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:21.738405 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de00a64-e567-4407-9255-1fd4e22b7c48 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:21.744962 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d35f9f-c19b-4460-bf35-09575dc15fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:21.745609 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d35f9f-c19b-4460-bf35-09575dc15fb0 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:21.745890 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d35f9f-c19b-4460-bf35-09575dc15fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:21.746161 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d35f9f-c19b-4460-bf35-09575dc15fb0 admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:21.746910 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d35f9f-c19b-4460-bf35-09575dc15fb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:21.748967 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d35f9f-c19b-4460-bf35-09575dc15fb0 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:21.773422 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 916/1842] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 02:12:21 2022] POST /identity/v3/users => generated 307 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 29 02:12:21.777554 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d35f9f-c19b-4460-bf35-09575dc15fb0 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:21.779472 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f5dfc4-3f7c-42c1-bde0-da6465355d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:21.780294 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f5dfc4-3f7c-42c1-bde0-da6465355d34 admin admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:21.780694 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f5dfc4-3f7c-42c1-bde0-da6465355d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:21.780970 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f5dfc4-3f7c-42c1-bde0-da6465355d34 admin admin] PATH_INFO: `/v3/users` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:21.781642 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f5dfc4-3f7c-42c1-bde0-da6465355d34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:21.783560 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f5dfc4-3f7c-42c1-bde0-da6465355d34 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:21.787943 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d35f9f-c19b-4460-bf35-09575dc15fb0 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:21.793063 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743da60d-c97e-4112-a02d-aed2a8bb4919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:21.793765 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743da60d-c97e-4112-a02d-aed2a8bb4919 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:21.793986 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743da60d-c97e-4112-a02d-aed2a8bb4919 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:21.794258 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743da60d-c97e-4112-a02d-aed2a8bb4919 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:21.795094 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743da60d-c97e-4112-a02d-aed2a8bb4919 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:21.796636 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743da60d-c97e-4112-a02d-aed2a8bb4919 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:21.809563 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 927/1843] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 02:12:21 2022] POST /identity/v3/users => generated 283 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:21.809683 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 917/1844] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:21.810447 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f5dfc4-3f7c-42c1-bde0-da6465355d34 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:21.813557 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743da60d-c97e-4112-a02d-aed2a8bb4919 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:21.824300 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743da60d-c97e-4112-a02d-aed2a8bb4919 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:21.829339 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a5f4ca-f243-4411-9d72-fcbb9b32870d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:21.829991 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a5f4ca-f243-4411-9d72-fcbb9b32870d admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:21.830276 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a5f4ca-f243-4411-9d72-fcbb9b32870d admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:21.830553 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f5dfc4-3f7c-42c1-bde0-da6465355d34 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:21.830663 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a5f4ca-f243-4411-9d72-fcbb9b32870d admin admin] PATH_INFO: `/v3/projects/7c4b58bed04e45748fae114619989cdf/users/0ea30542d6f842db87e857bd1957564c/roles/fe9bbc67742f4f5893f39b18eb31d59a` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:21.835417 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1abf1e-7f6b-46b5-90ad-578c9bfa2e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:21.836083 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1abf1e-7f6b-46b5-90ad-578c9bfa2e82 admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:21.836761 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1abf1e-7f6b-46b5-90ad-578c9bfa2e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:21.837221 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1abf1e-7f6b-46b5-90ad-578c9bfa2e82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:21.838063 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1abf1e-7f6b-46b5-90ad-578c9bfa2e82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:21.839724 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1abf1e-7f6b-46b5-90ad-578c9bfa2e82 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:21.846815 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a5f4ca-f243-4411-9d72-fcbb9b32870d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c4b58bed04e45748fae114619989cdf, user_id=0ea30542d6f842db87e857bd1957564c, role_id=fe9bbc67742f4f5893f39b18eb31d59a)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:21.850111 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a5f4ca-f243-4411-9d72-fcbb9b32870d admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:21.851877 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 928/1845] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:21 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:21.856463 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1abf1e-7f6b-46b5-90ad-578c9bfa2e82 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:21.866445 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 918/1846] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:12:21 2022] PUT /identity/v3/projects/7c4b58bed04e45748fae114619989cdf/users/0ea30542d6f842db87e857bd1957564c/roles/fe9bbc67742f4f5893f39b18eb31d59a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:12:21.870561 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1abf1e-7f6b-46b5-90ad-578c9bfa2e82 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:21.870758 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a5f4ca-f243-4411-9d72-fcbb9b32870d admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:21.952448 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa5a8ac-d540-4799-bf81-4a25e628722e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:21.953250 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5a8ac-d540-4799-bf81-4a25e628722e admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:21.953708 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5a8ac-d540-4799-bf81-4a25e628722e admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:21.954122 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5a8ac-d540-4799-bf81-4a25e628722e admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:21.954919 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa5a8ac-d540-4799-bf81-4a25e628722e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:21.957043 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa5a8ac-d540-4799-bf81-4a25e628722e admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:21.960983 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a5f4ca-f243-4411-9d72-fcbb9b32870d admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:21.967830 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086d04fc-9140-4285-a01b-919050983365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:21.968516 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086d04fc-9140-4285-a01b-919050983365 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:21.968862 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086d04fc-9140-4285-a01b-919050983365 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:21.969226 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086d04fc-9140-4285-a01b-919050983365 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:21.969910 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086d04fc-9140-4285-a01b-919050983365 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:21.971529 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086d04fc-9140-4285-a01b-919050983365 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:21.973156 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 929/1847] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:21 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 29 02:12:21.977727 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa5a8ac-d540-4799-bf81-4a25e628722e admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:21.983556 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 919/1848] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:21 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 29 02:12:21.987671 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086d04fc-9140-4285-a01b-919050983365 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:21.988387 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa5a8ac-d540-4799-bf81-4a25e628722e admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:21.995037 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138ad80f-79ec-49b9-a57a-3bc190d23cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:21.995852 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ad80f-79ec-49b9-a57a-3bc190d23cfa admin admin] REQUEST_METHOD: `PUT` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:21.996268 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ad80f-79ec-49b9-a57a-3bc190d23cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:21.996560 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ad80f-79ec-49b9-a57a-3bc190d23cfa admin admin] PATH_INFO: `/v3/projects/9901e22ab56140d29b4be38052997d97/users/1469278d81e740888daa82d428950cdd/roles/f157f905c9c94ccfbfb46e52d443e8f2` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:21.998608 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086d04fc-9140-4285-a01b-919050983365 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:22.004581 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5481f524-6e99-410e-a83a-b17bb12e1b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:22.005230 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5481f524-6e99-410e-a83a-b17bb12e1b21 admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:22.005668 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5481f524-6e99-410e-a83a-b17bb12e1b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:22.005876 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5481f524-6e99-410e-a83a-b17bb12e1b21 admin admin] PATH_INFO: `/v3/projects/7c4b58bed04e45748fae114619989cdf/users/0ea30542d6f842db87e857bd1957564c/roles/fe9bbc67742f4f5893f39b18eb31d59a` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:22.008062 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5481f524-6e99-410e-a83a-b17bb12e1b21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c4b58bed04e45748fae114619989cdf, user_id=0ea30542d6f842db87e857bd1957564c, role_id=fe9bbc67742f4f5893f39b18eb31d59a)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:22.011069 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5481f524-6e99-410e-a83a-b17bb12e1b21 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:22.023282 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138ad80f-79ec-49b9-a57a-3bc190d23cfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=9901e22ab56140d29b4be38052997d97, user_id=1469278d81e740888daa82d428950cdd, role_id=f157f905c9c94ccfbfb46e52d443e8f2)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:22.027852 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138ad80f-79ec-49b9-a57a-3bc190d23cfa admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:22.037265 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:22.042948 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 920/1849] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:12:21 2022] PUT /identity/v3/projects/7c4b58bed04e45748fae114619989cdf/users/0ea30542d6f842db87e857bd1957564c/roles/fe9bbc67742f4f5893f39b18eb31d59a => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:12:22.046298 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 930/1850] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:12:21 2022] PUT /identity/v3/projects/9901e22ab56140d29b4be38052997d97/users/1469278d81e740888daa82d428950cdd/roles/f157f905c9c94ccfbfb46e52d443e8f2 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:12:22.053267 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e29dd04-eb4a-4c80-a1ec-bc9cd2d25a70 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:22.053600 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e29dd04-eb4a-4c80-a1ec-bc9cd2d25a70 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:22.053875 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e29dd04-eb4a-4c80-a1ec-bc9cd2d25a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:22.057202 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430dfe7f-4814-4dc6-a388-0f15579d7f2a None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:22.057701 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430dfe7f-4814-4dc6-a388-0f15579d7f2a None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:22.058062 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430dfe7f-4814-4dc6-a388-0f15579d7f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:22.090055 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-9e29dd04-eb4a-4c80-a1ec-bc9cd2d25a70 None None] MFA Rules not processed for user `0ea30542d6f842db87e857bd1957564c`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:22.091966 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-9e29dd04-eb4a-4c80-a1ec-bc9cd2d25a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:22.103520 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-430dfe7f-4814-4dc6-a388-0f15579d7f2a None None] MFA Rules not processed for user `1469278d81e740888daa82d428950cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:22.104781 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-430dfe7f-4814-4dc6-a388-0f15579d7f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:22.124648 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:22.183488 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 921/1851] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:12:22 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:22.188956 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 931/1852] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:12:22 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 29 02:12:22.191215 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e29dd04-eb4a-4c80-a1ec-bc9cd2d25a70 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:22.192703 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-9e29dd04-eb4a-4c80-a1ec-bc9cd2d25a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:22.192924 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430dfe7f-4814-4dc6-a388-0f15579d7f2a None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:22.283837 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e29dd04-eb4a-4c80-a1ec-bc9cd2d25a70 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:22.288734 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fba7d92-e1ac-40ae-8cbc-2084707f2968 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75135b856134ba4b9ccac337886f682', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:22.289417 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fba7d92-e1ac-40ae-8cbc-2084707f2968 service cinder] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:22.289788 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fba7d92-e1ac-40ae-8cbc-2084707f2968 service cinder] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:22.290781 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fba7d92-e1ac-40ae-8cbc-2084707f2968 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:22.292672 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430dfe7f-4814-4dc6-a388-0f15579d7f2a None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:22.298680 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b194fc-9c42-4955-a05e-ae37bcc9c318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:22.299366 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b194fc-9c42-4955-a05e-ae37bcc9c318 admin admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:22.299647 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b194fc-9c42-4955-a05e-ae37bcc9c318 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:22.300067 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b194fc-9c42-4955-a05e-ae37bcc9c318 admin admin] PATH_INFO: `/v3/projects` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:22.301643 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b194fc-9c42-4955-a05e-ae37bcc9c318 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:22.303901 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fba7d92-e1ac-40ae-8cbc-2084707f2968 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:22.304152 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b194fc-9c42-4955-a05e-ae37bcc9c318 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:22.306018 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fba7d92-e1ac-40ae-8cbc-2084707f2968 service cinder] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:22.319818 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 922/1853] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:22 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:12:22.394577 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 932/1854] 10.222.0.49 () {60 vars in 1153 bytes} [Thu Sep 29 02:12:22 2022] POST /identity/v3/projects => generated 365 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:22.398417 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fba7d92-e1ac-40ae-8cbc-2084707f2968 service cinder] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:22.418194 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fba7d92-e1ac-40ae-8cbc-2084707f2968 service cinder] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:22.456519 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b194fc-9c42-4955-a05e-ae37bcc9c318 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:22.574317 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b194fc-9c42-4955-a05e-ae37bcc9c318 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:22.581622 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9066092b-09ff-4228-b702-625d42895882 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75135b856134ba4b9ccac337886f682', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:22.582790 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9066092b-09ff-4228-b702-625d42895882 service cinder] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:22.583228 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9066092b-09ff-4228-b702-625d42895882 service cinder] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:22.583645 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9066092b-09ff-4228-b702-625d42895882 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:22.591543 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ebf407-39af-4cbc-9021-02ac8033668f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:22.592174 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ebf407-39af-4cbc-9021-02ac8033668f admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:22.592457 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ebf407-39af-4cbc-9021-02ac8033668f admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:22.592796 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ebf407-39af-4cbc-9021-02ac8033668f admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:22.593527 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ebf407-39af-4cbc-9021-02ac8033668f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:22.596002 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ebf407-39af-4cbc-9021-02ac8033668f admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:22.624906 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:22.628613 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 923/1855] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 02:12:22 2022] POST /identity/v3/users => generated 289 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:22.632665 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ebf407-39af-4cbc-9021-02ac8033668f admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:22.645240 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ebf407-39af-4cbc-9021-02ac8033668f admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:22.651679 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf12b29d-11aa-4855-b649-9a83535f0545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:22.652478 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf12b29d-11aa-4855-b649-9a83535f0545 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:22.652863 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf12b29d-11aa-4855-b649-9a83535f0545 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:22.653236 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf12b29d-11aa-4855-b649-9a83535f0545 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:22.654047 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf12b29d-11aa-4855-b649-9a83535f0545 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:22.655844 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf12b29d-11aa-4855-b649-9a83535f0545 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:22.669917 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 924/1856] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:22 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:22.675186 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf12b29d-11aa-4855-b649-9a83535f0545 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:22.701999 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf12b29d-11aa-4855-b649-9a83535f0545 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:22.706822 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9066092b-09ff-4228-b702-625d42895882 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:22.712745 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9066092b-09ff-4228-b702-625d42895882 service cinder] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:22.718329 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba69782-28b7-4d48-a161-46efec7c8bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:22.721013 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba69782-28b7-4d48-a161-46efec7c8bf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:22.723334 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba69782-28b7-4d48-a161-46efec7c8bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:22.723334 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba69782-28b7-4d48-a161-46efec7c8bf3 admin admin] PATH_INFO: `/v3/projects/70866ef24d9a4ee69b2d5e38ea3d72cc/users/ae0393d748114f929b085c466d99c6fe/roles/fe9bbc67742f4f5893f39b18eb31d59a` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:22.742765 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 933/1857] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:22 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 29 02:12:22.756828 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba69782-28b7-4d48-a161-46efec7c8bf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70866ef24d9a4ee69b2d5e38ea3d72cc, user_id=ae0393d748114f929b085c466d99c6fe, role_id=fe9bbc67742f4f5893f39b18eb31d59a)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:22.761192 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba69782-28b7-4d48-a161-46efec7c8bf3 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:22.782834 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 925/1858] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:12:22 2022] PUT /identity/v3/projects/70866ef24d9a4ee69b2d5e38ea3d72cc/users/ae0393d748114f929b085c466d99c6fe/roles/fe9bbc67742f4f5893f39b18eb31d59a => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:22.787167 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9066092b-09ff-4228-b702-625d42895882 service cinder] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:22.807541 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9066092b-09ff-4228-b702-625d42895882 service cinder] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:22.967048 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb97624c-8bb9-4dcf-a87a-cbd241940541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:22.967687 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb97624c-8bb9-4dcf-a87a-cbd241940541 admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:22.968033 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb97624c-8bb9-4dcf-a87a-cbd241940541 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:22.968311 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb97624c-8bb9-4dcf-a87a-cbd241940541 admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:22.969078 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb97624c-8bb9-4dcf-a87a-cbd241940541 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:22.970786 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb97624c-8bb9-4dcf-a87a-cbd241940541 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:22.992027 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 934/1859] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:22 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:22.996878 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba69782-28b7-4d48-a161-46efec7c8bf3 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:23.022059 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba69782-28b7-4d48-a161-46efec7c8bf3 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:23.031917 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfa2ee7-5ddb-4ace-9782-30f7f3d63dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:23.032915 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfa2ee7-5ddb-4ace-9782-30f7f3d63dcf admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:23.033295 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfa2ee7-5ddb-4ace-9782-30f7f3d63dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:23.034535 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfa2ee7-5ddb-4ace-9782-30f7f3d63dcf admin admin] PATH_INFO: `/v3/projects/70866ef24d9a4ee69b2d5e38ea3d72cc/users/ae0393d748114f929b085c466d99c6fe/roles/fe9bbc67742f4f5893f39b18eb31d59a` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:23.037485 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfa2ee7-5ddb-4ace-9782-30f7f3d63dcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=70866ef24d9a4ee69b2d5e38ea3d72cc, user_id=ae0393d748114f929b085c466d99c6fe, role_id=fe9bbc67742f4f5893f39b18eb31d59a)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:23.041492 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfa2ee7-5ddb-4ace-9782-30f7f3d63dcf admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:23.054500 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 926/1860] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:12:22 2022] PUT /identity/v3/projects/70866ef24d9a4ee69b2d5e38ea3d72cc/users/ae0393d748114f929b085c466d99c6fe/roles/fe9bbc67742f4f5893f39b18eb31d59a => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:23.067680 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6607deb-7283-4433-8fc8-d0332e911bdd None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:23.067968 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6607deb-7283-4433-8fc8-d0332e911bdd None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:23.068241 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6607deb-7283-4433-8fc8-d0332e911bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:23.124674 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-f6607deb-7283-4433-8fc8-d0332e911bdd None None] MFA Rules not processed for user `ae0393d748114f929b085c466d99c6fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:23.125732 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-f6607deb-7283-4433-8fc8-d0332e911bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:23.315241 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 935/1861] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:12:23 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 29 02:12:23.329889 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfa2ee7-5ddb-4ace-9782-30f7f3d63dcf admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:23.332704 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-0cfa2ee7-5ddb-4ace-9782-30f7f3d63dcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:23.359057 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:23.417435 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfa2ee7-5ddb-4ace-9782-30f7f3d63dcf admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:23.426905 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34bf5b5-c0df-40ee-b5ec-c19aba3b42c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75135b856134ba4b9ccac337886f682', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:23.428067 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34bf5b5-c0df-40ee-b5ec-c19aba3b42c3 service cinder] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:23.428342 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34bf5b5-c0df-40ee-b5ec-c19aba3b42c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:23.428608 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34bf5b5-c0df-40ee-b5ec-c19aba3b42c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:23.441799 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34bf5b5-c0df-40ee-b5ec-c19aba3b42c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:23.443256 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34bf5b5-c0df-40ee-b5ec-c19aba3b42c3 service cinder] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:23.455512 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 927/1862] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:23 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:12:23.550811 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6607deb-7283-4433-8fc8-d0332e911bdd None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:23.560624 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6607deb-7283-4433-8fc8-d0332e911bdd None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:23.564636 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328f7918-7aa3-4628-abec-1e402e23262a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75135b856134ba4b9ccac337886f682', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:23.564822 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328f7918-7aa3-4628-abec-1e402e23262a service cinder] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:23.565086 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328f7918-7aa3-4628-abec-1e402e23262a service cinder] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:23.565386 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328f7918-7aa3-4628-abec-1e402e23262a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:23.613607 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:23.626053 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328f7918-7aa3-4628-abec-1e402e23262a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:23.627481 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328f7918-7aa3-4628-abec-1e402e23262a service cinder] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:23.636703 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 936/1863] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:23 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:12:25.022620 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34bf5b5-c0df-40ee-b5ec-c19aba3b42c3 service cinder] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:25.024390 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-b34bf5b5-c0df-40ee-b5ec-c19aba3b42c3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:25.098180 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34bf5b5-c0df-40ee-b5ec-c19aba3b42c3 service cinder] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:25.103267 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c886d2d-dbeb-4ef1-b9fa-45a39676a2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:25.103897 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c886d2d-dbeb-4ef1-b9fa-45a39676a2d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:25.104172 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c886d2d-dbeb-4ef1-b9fa-45a39676a2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:25.104435 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c886d2d-dbeb-4ef1-b9fa-45a39676a2d3 admin admin] PATH_INFO: `/v3/users/140375110912435da3aaef7c99fbf4ee` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:25.105585 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c886d2d-dbeb-4ef1-b9fa-45a39676a2d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=140375110912435da3aaef7c99fbf4ee)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:25.107466 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c886d2d-dbeb-4ef1-b9fa-45a39676a2d3 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:25.153911 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-7c886d2d-dbeb-4ef1-b9fa-45a39676a2d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '140375110912435da3aaef7c99fbf4ee'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:25.154569 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-7c886d2d-dbeb-4ef1-b9fa-45a39676a2d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '140375110912435da3aaef7c99fbf4ee'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:25.167366 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-7c886d2d-dbeb-4ef1-b9fa-45a39676a2d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '140375110912435da3aaef7c99fbf4ee'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:25.174789 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-7c886d2d-dbeb-4ef1-b9fa-45a39676a2d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '140375110912435da3aaef7c99fbf4ee'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:25.175527 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-7c886d2d-dbeb-4ef1-b9fa-45a39676a2d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '140375110912435da3aaef7c99fbf4ee'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:25.189289 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 928/1864] 10.222.0.49 () {58 vars in 1224 bytes} [Thu Sep 29 02:12:25 2022] DELETE /identity/v3/users/140375110912435da3aaef7c99fbf4ee => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:25.193740 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bd78e0-955f-42e8-9383-946221db3e85 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:25.194287 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bd78e0-955f-42e8-9383-946221db3e85 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:25.194287 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bd78e0-955f-42e8-9383-946221db3e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:25.213721 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-e4bd78e0-955f-42e8-9383-946221db3e85 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:25.215099 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-e4bd78e0-955f-42e8-9383-946221db3e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:25.278862 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 937/1865] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:12:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:25.288737 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c886d2d-dbeb-4ef1-b9fa-45a39676a2d3 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:25.290913 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-7c886d2d-dbeb-4ef1-b9fa-45a39676a2d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:25.329030 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:25.357211 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c886d2d-dbeb-4ef1-b9fa-45a39676a2d3 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:25.361123 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab05d7ce-76f1-4a64-8dff-2ac1f22625c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:25.361756 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab05d7ce-76f1-4a64-8dff-2ac1f22625c5 service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:25.362040 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab05d7ce-76f1-4a64-8dff-2ac1f22625c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:25.362310 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab05d7ce-76f1-4a64-8dff-2ac1f22625c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:25.372208 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab05d7ce-76f1-4a64-8dff-2ac1f22625c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:25.373656 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab05d7ce-76f1-4a64-8dff-2ac1f22625c5 service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:25.384224 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 929/1866] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:12:25.811564 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bd78e0-955f-42e8-9383-946221db3e85 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:25.813029 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-e4bd78e0-955f-42e8-9383-946221db3e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:25.859937 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bd78e0-955f-42e8-9383-946221db3e85 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:25.865841 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f6ba54-bdf8-4fdd-81e2-fa1aadc49d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:25.866569 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f6ba54-bdf8-4fdd-81e2-fa1aadc49d79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:25.866914 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f6ba54-bdf8-4fdd-81e2-fa1aadc49d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:25.867289 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f6ba54-bdf8-4fdd-81e2-fa1aadc49d79 admin admin] PATH_INFO: `/v3/projects/db0b0db820654b159e5c24d03b0ee18d` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:25.868656 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f6ba54-bdf8-4fdd-81e2-fa1aadc49d79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db0b0db820654b159e5c24d03b0ee18d)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:25.870689 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f6ba54-bdf8-4fdd-81e2-fa1aadc49d79 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:25.946744 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-08f6ba54-bdf8-4fdd-81e2-fa1aadc49d79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db0b0db820654b159e5c24d03b0ee18d', 'request_id': 'req-08f6ba54-bdf8-4fdd-81e2-fa1aadc49d79'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:25.957936 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-08f6ba54-bdf8-4fdd-81e2-fa1aadc49d79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db0b0db820654b159e5c24d03b0ee18d', 'request_id': 'req-08f6ba54-bdf8-4fdd-81e2-fa1aadc49d79'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:25.968009 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-08f6ba54-bdf8-4fdd-81e2-fa1aadc49d79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db0b0db820654b159e5c24d03b0ee18d', 'request_id': 'req-08f6ba54-bdf8-4fdd-81e2-fa1aadc49d79'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:25.981029 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-08f6ba54-bdf8-4fdd-81e2-fa1aadc49d79 admin admin] The token cache is being invalidate because project db0b0db820654b159e5c24d03b0ee18d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81648) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:12:25.981457 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-08f6ba54-bdf8-4fdd-81e2-fa1aadc49d79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:25.982252 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-08f6ba54-bdf8-4fdd-81e2-fa1aadc49d79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:25.984297 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 938/1867] 10.222.0.49 () {58 vars in 1233 bytes} [Thu Sep 29 02:12:25 2022] DELETE /identity/v3/projects/db0b0db820654b159e5c24d03b0ee18d => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:25.988716 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab05d7ce-76f1-4a64-8dff-2ac1f22625c5 service neutron] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:26.000602 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab05d7ce-76f1-4a64-8dff-2ac1f22625c5 service neutron] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:26.074217 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40489890-94e7-41be-97e7-b39aff7a77d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:26.075070 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40489890-94e7-41be-97e7-b39aff7a77d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:26.075461 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40489890-94e7-41be-97e7-b39aff7a77d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:26.075799 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40489890-94e7-41be-97e7-b39aff7a77d9 admin admin] PATH_INFO: `/v3/users/2f18fd6cb19f4f30a889dd9e16931cf3` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:26.077022 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40489890-94e7-41be-97e7-b39aff7a77d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f18fd6cb19f4f30a889dd9e16931cf3)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:26.079074 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40489890-94e7-41be-97e7-b39aff7a77d9 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:26.139741 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-40489890-94e7-41be-97e7-b39aff7a77d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f18fd6cb19f4f30a889dd9e16931cf3'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:26.140588 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-40489890-94e7-41be-97e7-b39aff7a77d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f18fd6cb19f4f30a889dd9e16931cf3'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:26.155692 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-40489890-94e7-41be-97e7-b39aff7a77d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f18fd6cb19f4f30a889dd9e16931cf3'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:26.163838 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-40489890-94e7-41be-97e7-b39aff7a77d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f18fd6cb19f4f30a889dd9e16931cf3'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:26.165125 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-40489890-94e7-41be-97e7-b39aff7a77d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f18fd6cb19f4f30a889dd9e16931cf3'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:26.178287 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 930/1868] 10.222.0.49 () {58 vars in 1224 bytes} [Thu Sep 29 02:12:25 2022] DELETE /identity/v3/users/2f18fd6cb19f4f30a889dd9e16931cf3 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:26.449839 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f6ba54-bdf8-4fdd-81e2-fa1aadc49d79 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:26.451665 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-08f6ba54-bdf8-4fdd-81e2-fa1aadc49d79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:26.466621 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40489890-94e7-41be-97e7-b39aff7a77d9 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:26.467820 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f6ba54-bdf8-4fdd-81e2-fa1aadc49d79 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:26.468101 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-40489890-94e7-41be-97e7-b39aff7a77d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:26.529242 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:26.538325 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fedb59-9943-49b4-b8c2-3cd3dba8e398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:26.539309 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fedb59-9943-49b4-b8c2-3cd3dba8e398 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:26.540235 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fedb59-9943-49b4-b8c2-3cd3dba8e398 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:26.540734 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fedb59-9943-49b4-b8c2-3cd3dba8e398 admin admin] PATH_INFO: `/v3/users/1469278d81e740888daa82d428950cdd` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:26.542605 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fedb59-9943-49b4-b8c2-3cd3dba8e398 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1469278d81e740888daa82d428950cdd)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:26.544519 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fedb59-9943-49b4-b8c2-3cd3dba8e398 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:26.544996 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40489890-94e7-41be-97e7-b39aff7a77d9 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:26.549808 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1f0a79-de6c-49e7-88d4-d58e05166eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:26.550440 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f0a79-de6c-49e7-88d4-d58e05166eed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:26.550749 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f0a79-de6c-49e7-88d4-d58e05166eed admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:26.551025 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f0a79-de6c-49e7-88d4-d58e05166eed admin admin] PATH_INFO: `/v3/projects/e1e7f4119ae749fcb790fe018a20bc00` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:26.552148 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1f0a79-de6c-49e7-88d4-d58e05166eed admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1e7f4119ae749fcb790fe018a20bc00)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:26.554079 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1f0a79-de6c-49e7-88d4-d58e05166eed admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:26.558612 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:26.596627 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-09fedb59-9943-49b4-b8c2-3cd3dba8e398 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1469278d81e740888daa82d428950cdd'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:26.597341 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-09fedb59-9943-49b4-b8c2-3cd3dba8e398 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1469278d81e740888daa82d428950cdd'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:26.604664 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-1f1f0a79-de6c-49e7-88d4-d58e05166eed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1e7f4119ae749fcb790fe018a20bc00', 'request_id': 'req-1f1f0a79-de6c-49e7-88d4-d58e05166eed'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:26.610301 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-09fedb59-9943-49b4-b8c2-3cd3dba8e398 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1469278d81e740888daa82d428950cdd'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:26.611051 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-1f1f0a79-de6c-49e7-88d4-d58e05166eed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1e7f4119ae749fcb790fe018a20bc00', 'request_id': 'req-1f1f0a79-de6c-49e7-88d4-d58e05166eed'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:26.618338 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-09fedb59-9943-49b4-b8c2-3cd3dba8e398 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1469278d81e740888daa82d428950cdd'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:26.619206 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-09fedb59-9943-49b4-b8c2-3cd3dba8e398 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1469278d81e740888daa82d428950cdd'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:26.620622 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-1f1f0a79-de6c-49e7-88d4-d58e05166eed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1e7f4119ae749fcb790fe018a20bc00', 'request_id': 'req-1f1f0a79-de6c-49e7-88d4-d58e05166eed'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:26.631271 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-1f1f0a79-de6c-49e7-88d4-d58e05166eed admin admin] The token cache is being invalidate because project e1e7f4119ae749fcb790fe018a20bc00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81649) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:12:26.631597 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-1f1f0a79-de6c-49e7-88d4-d58e05166eed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:26.632311 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-1f1f0a79-de6c-49e7-88d4-d58e05166eed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:26.632415 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 939/1869] 10.222.0.49 () {58 vars in 1224 bytes} [Thu Sep 29 02:12:26 2022] DELETE /identity/v3/users/1469278d81e740888daa82d428950cdd => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:26.634992 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 931/1870] 10.222.0.49 () {58 vars in 1233 bytes} [Thu Sep 29 02:12:26 2022] DELETE /identity/v3/projects/e1e7f4119ae749fcb790fe018a20bc00 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:12:26.637613 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7dcff8-78f1-437e-bccd-8e079b6067a1 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:26.637967 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7dcff8-78f1-437e-bccd-8e079b6067a1 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:26.638254 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7dcff8-78f1-437e-bccd-8e079b6067a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:26.640377 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1dcd86-60ec-41af-8f8e-9ae519c8b6c5 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:26.640703 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1dcd86-60ec-41af-8f8e-9ae519c8b6c5 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:26.641146 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1dcd86-60ec-41af-8f8e-9ae519c8b6c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:26.659117 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-6d7dcff8-78f1-437e-bccd-8e079b6067a1 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:26.660344 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-6d7dcff8-78f1-437e-bccd-8e079b6067a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:26.662237 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-8e1dcd86-60ec-41af-8f8e-9ae519c8b6c5 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:26.663419 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-8e1dcd86-60ec-41af-8f8e-9ae519c8b6c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:26.721888 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 940/1871] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:12:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 29 02:12:26.723240 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 932/1872] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:12:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:26.732148 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5ea2dd-487a-4af4-abcf-3c1e19efe827 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:26.732326 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1dcd86-60ec-41af-8f8e-9ae519c8b6c5 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:26.732422 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5ea2dd-487a-4af4-abcf-3c1e19efe827 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:26.732695 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5ea2dd-487a-4af4-abcf-3c1e19efe827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:26.733818 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-8e1dcd86-60ec-41af-8f8e-9ae519c8b6c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:26.753411 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-9a5ea2dd-487a-4af4-abcf-3c1e19efe827 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:26.754615 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-9a5ea2dd-487a-4af4-abcf-3c1e19efe827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:26.763034 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 941/1873] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:12:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:26.767055 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5ea2dd-487a-4af4-abcf-3c1e19efe827 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:26.777180 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5ea2dd-487a-4af4-abcf-3c1e19efe827 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:26.782274 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e356a8-7fca-4b62-960d-3bafafdfef57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:26.782810 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e356a8-7fca-4b62-960d-3bafafdfef57 admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:26.783087 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e356a8-7fca-4b62-960d-3bafafdfef57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:26.783352 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e356a8-7fca-4b62-960d-3bafafdfef57 admin admin] PATH_INFO: `/v3/domains` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:26.783987 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e356a8-7fca-4b62-960d-3bafafdfef57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:12:26.784284 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e356a8-7fca-4b62-960d-3bafafdfef57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:26.785905 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e356a8-7fca-4b62-960d-3bafafdfef57 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:26.791815 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1dcd86-60ec-41af-8f8e-9ae519c8b6c5 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:26.795740 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a5dbe2-57ef-4045-8d2e-7036133a8b73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:26.796344 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a5dbe2-57ef-4045-8d2e-7036133a8b73 service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:26.796623 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a5dbe2-57ef-4045-8d2e-7036133a8b73 service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:26.796894 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a5dbe2-57ef-4045-8d2e-7036133a8b73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:26.801356 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 942/1874] 10.222.0.49 () {58 vars in 1153 bytes} [Thu Sep 29 02:12:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 02:12:26.802384 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e356a8-7fca-4b62-960d-3bafafdfef57 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:26.810523 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a5dbe2-57ef-4045-8d2e-7036133a8b73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:26.814321 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a5dbe2-57ef-4045-8d2e-7036133a8b73 service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:26.815318 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e356a8-7fca-4b62-960d-3bafafdfef57 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:26.820168 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475ee1b1-cde5-4105-88d7-0e614e12b92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:26.822308 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475ee1b1-cde5-4105-88d7-0e614e12b92b admin admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:26.822935 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475ee1b1-cde5-4105-88d7-0e614e12b92b admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:26.826311 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475ee1b1-cde5-4105-88d7-0e614e12b92b admin admin] PATH_INFO: `/v3/projects` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:26.826595 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475ee1b1-cde5-4105-88d7-0e614e12b92b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:26.828603 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475ee1b1-cde5-4105-88d7-0e614e12b92b admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:26.831369 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 933/1875] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:12:26.863490 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 943/1876] 10.222.0.49 () {60 vars in 1153 bytes} [Thu Sep 29 02:12:26 2022] POST /identity/v3/projects => generated 377 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 29 02:12:26.863968 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a5dbe2-57ef-4045-8d2e-7036133a8b73 service neutron] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:26.876961 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a5dbe2-57ef-4045-8d2e-7036133a8b73 service neutron] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:26.903191 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:26.958124 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00f2736-bd8e-4074-8d07-e1b80e60b344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:26.958879 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00f2736-bd8e-4074-8d07-e1b80e60b344 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:26.959231 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00f2736-bd8e-4074-8d07-e1b80e60b344 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:26.959574 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00f2736-bd8e-4074-8d07-e1b80e60b344 admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:26.960290 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00f2736-bd8e-4074-8d07-e1b80e60b344 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:26.962451 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00f2736-bd8e-4074-8d07-e1b80e60b344 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:26.988464 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 934/1877] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 02:12:26 2022] POST /identity/v3/users => generated 289 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 29 02:12:26.993220 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475ee1b1-cde5-4105-88d7-0e614e12b92b admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:27.005094 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475ee1b1-cde5-4105-88d7-0e614e12b92b admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:27.011131 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a24aab5-7d35-4064-8217-6264f33bcce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:27.012291 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a24aab5-7d35-4064-8217-6264f33bcce6 admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:27.012420 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a24aab5-7d35-4064-8217-6264f33bcce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:27.012866 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a24aab5-7d35-4064-8217-6264f33bcce6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:27.013742 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a24aab5-7d35-4064-8217-6264f33bcce6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:27.015452 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a24aab5-7d35-4064-8217-6264f33bcce6 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:27.031328 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 944/1878] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:26 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:27.032699 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00f2736-bd8e-4074-8d07-e1b80e60b344 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:27.044642 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00f2736-bd8e-4074-8d07-e1b80e60b344 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:27.049720 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368290fd-d287-43d7-93da-f45a8ea86964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:27.050677 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368290fd-d287-43d7-93da-f45a8ea86964 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:27.051058 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368290fd-d287-43d7-93da-f45a8ea86964 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:27.051444 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368290fd-d287-43d7-93da-f45a8ea86964 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:27.052196 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368290fd-d287-43d7-93da-f45a8ea86964 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:27.053987 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368290fd-d287-43d7-93da-f45a8ea86964 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:27.066462 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 935/1879] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:27.071283 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a24aab5-7d35-4064-8217-6264f33bcce6 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:27.082663 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a24aab5-7d35-4064-8217-6264f33bcce6 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:27.088404 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd7ed05-7471-42fd-84e1-29b549370455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:27.089375 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd7ed05-7471-42fd-84e1-29b549370455 admin admin] REQUEST_METHOD: `PUT` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:27.089807 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd7ed05-7471-42fd-84e1-29b549370455 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:27.090100 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd7ed05-7471-42fd-84e1-29b549370455 admin admin] PATH_INFO: `/v3/projects/178beb90fee4480f9e34665beb71cf3d/users/ea1ec9394bd048949350e07b17689b18/roles/f157f905c9c94ccfbfb46e52d443e8f2` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:27.107299 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd7ed05-7471-42fd-84e1-29b549370455 admin admin] RBAC: Authorizing `identity:create_grant(project_id=178beb90fee4480f9e34665beb71cf3d, user_id=ea1ec9394bd048949350e07b17689b18, role_id=f157f905c9c94ccfbfb46e52d443e8f2)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:27.110191 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd7ed05-7471-42fd-84e1-29b549370455 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:27.125199 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 945/1880] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:12:27 2022] PUT /identity/v3/projects/178beb90fee4480f9e34665beb71cf3d/users/ea1ec9394bd048949350e07b17689b18/roles/f157f905c9c94ccfbfb46e52d443e8f2 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:27.137015 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ac1a27-1d4f-4602-b83c-c2e293e4a396 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:27.138134 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ac1a27-1d4f-4602-b83c-c2e293e4a396 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:27.139152 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ac1a27-1d4f-4602-b83c-c2e293e4a396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:27.203807 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-86ac1a27-1d4f-4602-b83c-c2e293e4a396 None None] MFA Rules not processed for user `ea1ec9394bd048949350e07b17689b18`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:27.205039 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-86ac1a27-1d4f-4602-b83c-c2e293e4a396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:27.368137 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 936/1881] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:12:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:27.369688 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd7ed05-7471-42fd-84e1-29b549370455 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:27.405361 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:27.441751 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ac1a27-1d4f-4602-b83c-c2e293e4a396 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:27.443641 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-86ac1a27-1d4f-4602-b83c-c2e293e4a396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:27.514093 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd7ed05-7471-42fd-84e1-29b549370455 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:27.528831 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c8cbc5-38e0-450e-89a3-a5b519b07e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:27.529491 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c8cbc5-38e0-450e-89a3-a5b519b07e55 admin admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:27.529820 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c8cbc5-38e0-450e-89a3-a5b519b07e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:27.530039 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c8cbc5-38e0-450e-89a3-a5b519b07e55 admin admin] PATH_INFO: `/v3/projects` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:27.530710 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c8cbc5-38e0-450e-89a3-a5b519b07e55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:27.532582 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c8cbc5-38e0-450e-89a3-a5b519b07e55 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:27.548678 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ac1a27-1d4f-4602-b83c-c2e293e4a396 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:27.553756 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e82f8ef-b62f-4479-9aa8-2bdf3e338982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:27.554520 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e82f8ef-b62f-4479-9aa8-2bdf3e338982 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:27.554855 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e82f8ef-b62f-4479-9aa8-2bdf3e338982 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:27.555927 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e82f8ef-b62f-4479-9aa8-2bdf3e338982 admin admin] PATH_INFO: `/v3/users/5465779876234f6cbbd78319d856befd` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:27.557238 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e82f8ef-b62f-4479-9aa8-2bdf3e338982 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5465779876234f6cbbd78319d856befd)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:27.563423 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e82f8ef-b62f-4479-9aa8-2bdf3e338982 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:27.569444 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 946/1882] 10.222.0.49 () {60 vars in 1153 bytes} [Thu Sep 29 02:12:27 2022] POST /identity/v3/projects => generated 377 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:27.569444 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c8cbc5-38e0-450e-89a3-a5b519b07e55 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:27.571769 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-92c8cbc5-38e0-450e-89a3-a5b519b07e55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:27.606362 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:27.621342 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-6e82f8ef-b62f-4479-9aa8-2bdf3e338982 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5465779876234f6cbbd78319d856befd'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:27.622044 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-6e82f8ef-b62f-4479-9aa8-2bdf3e338982 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5465779876234f6cbbd78319d856befd'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:27.654233 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-6e82f8ef-b62f-4479-9aa8-2bdf3e338982 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5465779876234f6cbbd78319d856befd'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:27.663865 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-6e82f8ef-b62f-4479-9aa8-2bdf3e338982 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5465779876234f6cbbd78319d856befd'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:27.665523 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-6e82f8ef-b62f-4479-9aa8-2bdf3e338982 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5465779876234f6cbbd78319d856befd'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:27.666835 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c8cbc5-38e0-450e-89a3-a5b519b07e55 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:27.672312 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec5d734-31af-400b-831d-ec8db27887c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:27.672990 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec5d734-31af-400b-831d-ec8db27887c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:27.673277 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec5d734-31af-400b-831d-ec8db27887c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:27.673588 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec5d734-31af-400b-831d-ec8db27887c9 admin admin] PATH_INFO: `/v3/projects/9901e22ab56140d29b4be38052997d97` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:27.674891 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec5d734-31af-400b-831d-ec8db27887c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9901e22ab56140d29b4be38052997d97)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:27.676852 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec5d734-31af-400b-831d-ec8db27887c9 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:27.682999 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 937/1883] 10.222.0.49 () {58 vars in 1224 bytes} [Thu Sep 29 02:12:27 2022] DELETE /identity/v3/users/5465779876234f6cbbd78319d856befd => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:27.684420 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e82f8ef-b62f-4479-9aa8-2bdf3e338982 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:27.686103 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-6e82f8ef-b62f-4479-9aa8-2bdf3e338982 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:27.734390 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-aec5d734-31af-400b-831d-ec8db27887c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9901e22ab56140d29b4be38052997d97', 'request_id': 'req-aec5d734-31af-400b-831d-ec8db27887c9'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:27.740652 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-aec5d734-31af-400b-831d-ec8db27887c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9901e22ab56140d29b4be38052997d97', 'request_id': 'req-aec5d734-31af-400b-831d-ec8db27887c9'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:27.750132 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-aec5d734-31af-400b-831d-ec8db27887c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9901e22ab56140d29b4be38052997d97', 'request_id': 'req-aec5d734-31af-400b-831d-ec8db27887c9'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:27.762120 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-aec5d734-31af-400b-831d-ec8db27887c9 admin admin] The token cache is being invalidate because project 9901e22ab56140d29b4be38052997d97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81648) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:12:27.762409 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-aec5d734-31af-400b-831d-ec8db27887c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:27.763115 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-aec5d734-31af-400b-831d-ec8db27887c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:27.764873 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 947/1884] 10.222.0.49 () {58 vars in 1233 bytes} [Thu Sep 29 02:12:27 2022] DELETE /identity/v3/projects/9901e22ab56140d29b4be38052997d97 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:27.766098 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc3231-41c7-4bcf-b227-3939bae05af8 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:27.766377 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc3231-41c7-4bcf-b227-3939bae05af8 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:27.766642 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc3231-41c7-4bcf-b227-3939bae05af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:27.771872 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e82f8ef-b62f-4479-9aa8-2bdf3e338982 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:27.786594 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-47fc3231-41c7-4bcf-b227-3939bae05af8 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:27.787827 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-47fc3231-41c7-4bcf-b227-3939bae05af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:27.813298 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:27.850951 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b15fe0-0a35-4f0c-b717-c513ed44dfe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:27.852602 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b15fe0-0a35-4f0c-b717-c513ed44dfe0 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:27.852722 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b15fe0-0a35-4f0c-b717-c513ed44dfe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:27.853107 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b15fe0-0a35-4f0c-b717-c513ed44dfe0 admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:27.853917 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b15fe0-0a35-4f0c-b717-c513ed44dfe0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:27.855898 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b15fe0-0a35-4f0c-b717-c513ed44dfe0 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:27.858583 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 948/1885] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:12:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:27.859704 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fc3231-41c7-4bcf-b227-3939bae05af8 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:27.861099 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-47fc3231-41c7-4bcf-b227-3939bae05af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:27.876814 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fc3231-41c7-4bcf-b227-3939bae05af8 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:27.884295 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 938/1886] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 02:12:27 2022] POST /identity/v3/users => generated 295 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:27.884434 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac46990-2c19-42c0-959c-5c5b760604f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:27.884434 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac46990-2c19-42c0-959c-5c5b760604f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:27.884434 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac46990-2c19-42c0-959c-5c5b760604f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:27.884705 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b15fe0-0a35-4f0c-b717-c513ed44dfe0 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:27.884793 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac46990-2c19-42c0-959c-5c5b760604f4 admin admin] PATH_INFO: `/v3/users/ae0393d748114f929b085c466d99c6fe` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:27.884889 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-66b15fe0-0a35-4f0c-b717-c513ed44dfe0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:27.884976 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac46990-2c19-42c0-959c-5c5b760604f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae0393d748114f929b085c466d99c6fe)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:27.886711 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac46990-2c19-42c0-959c-5c5b760604f4 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:27.941301 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-0ac46990-2c19-42c0-959c-5c5b760604f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae0393d748114f929b085c466d99c6fe'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:27.941987 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-0ac46990-2c19-42c0-959c-5c5b760604f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae0393d748114f929b085c466d99c6fe'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:27.947032 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:27.951037 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b15fe0-0a35-4f0c-b717-c513ed44dfe0 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:27.955140 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-0ac46990-2c19-42c0-959c-5c5b760604f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae0393d748114f929b085c466d99c6fe'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:27.956147 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0455ace4-ad49-4a28-b933-521ce9497282 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:27.956759 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0455ace4-ad49-4a28-b933-521ce9497282 service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:27.957037 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0455ace4-ad49-4a28-b933-521ce9497282 service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:27.957327 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0455ace4-ad49-4a28-b933-521ce9497282 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:27.959290 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-0455ace4-ad49-4a28-b933-521ce9497282 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:27.966448 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-0ac46990-2c19-42c0-959c-5c5b760604f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae0393d748114f929b085c466d99c6fe'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:27.967294 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-0ac46990-2c19-42c0-959c-5c5b760604f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae0393d748114f929b085c466d99c6fe'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:27.975659 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0455ace4-ad49-4a28-b933-521ce9497282 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:27.977985 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0455ace4-ad49-4a28-b933-521ce9497282 service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:27.984167 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 949/1887] 10.222.0.49 () {58 vars in 1224 bytes} [Thu Sep 29 02:12:27 2022] DELETE /identity/v3/users/ae0393d748114f929b085c466d99c6fe => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:27.985305 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac46990-2c19-42c0-959c-5c5b760604f4 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:27.986789 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-0ac46990-2c19-42c0-959c-5c5b760604f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:27.988608 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 939/1888] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:12:28.060811 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac46990-2c19-42c0-959c-5c5b760604f4 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:28.065646 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae8c71c-3309-4326-8fd1-1ea7acc9f470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:28.066280 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae8c71c-3309-4326-8fd1-1ea7acc9f470 admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:28.066573 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae8c71c-3309-4326-8fd1-1ea7acc9f470 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:28.066739 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae8c71c-3309-4326-8fd1-1ea7acc9f470 admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:28.067404 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae8c71c-3309-4326-8fd1-1ea7acc9f470 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:28.069012 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae8c71c-3309-4326-8fd1-1ea7acc9f470 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:28.080349 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 950/1889] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:27 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:28.084589 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0455ace4-ad49-4a28-b933-521ce9497282 service neutron] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:28.095360 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0455ace4-ad49-4a28-b933-521ce9497282 service neutron] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:28.101685 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8776869b-b197-454e-9868-5bb40f74754c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:28.102695 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8776869b-b197-454e-9868-5bb40f74754c admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:28.103115 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8776869b-b197-454e-9868-5bb40f74754c admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:28.103531 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8776869b-b197-454e-9868-5bb40f74754c admin admin] PATH_INFO: `/v3/projects/4bedff2b4b4f48739d4ff78831ce1f1a/users/89d7266589034648838eb80a62af64d8/roles/fe9bbc67742f4f5893f39b18eb31d59a` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:28.125195 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8776869b-b197-454e-9868-5bb40f74754c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bedff2b4b4f48739d4ff78831ce1f1a, user_id=89d7266589034648838eb80a62af64d8, role_id=fe9bbc67742f4f5893f39b18eb31d59a)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:28.127959 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8776869b-b197-454e-9868-5bb40f74754c admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:28.142538 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 940/1890] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:12:28 2022] PUT /identity/v3/projects/4bedff2b4b4f48739d4ff78831ce1f1a/users/89d7266589034648838eb80a62af64d8/roles/fe9bbc67742f4f5893f39b18eb31d59a => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:28.147001 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae8c71c-3309-4326-8fd1-1ea7acc9f470 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:28.158469 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae8c71c-3309-4326-8fd1-1ea7acc9f470 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:28.202245 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:28.226550 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c4dcba-c2e6-412f-aefa-1b16473d3c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:28.227009 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c4dcba-c2e6-412f-aefa-1b16473d3c81 admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:28.227298 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c4dcba-c2e6-412f-aefa-1b16473d3c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:28.227572 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c4dcba-c2e6-412f-aefa-1b16473d3c81 admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:28.228219 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c4dcba-c2e6-412f-aefa-1b16473d3c81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:28.229868 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c4dcba-c2e6-412f-aefa-1b16473d3c81 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:28.246809 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 951/1891] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:28 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:28.248069 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8776869b-b197-454e-9868-5bb40f74754c admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:28.262187 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8776869b-b197-454e-9868-5bb40f74754c admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:28.278647 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f8fb02-729a-4219-840c-e0de0c69b48f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:28.279332 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f8fb02-729a-4219-840c-e0de0c69b48f admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:28.279612 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f8fb02-729a-4219-840c-e0de0c69b48f admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:28.279883 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f8fb02-729a-4219-840c-e0de0c69b48f admin admin] PATH_INFO: `/v3/projects/4bedff2b4b4f48739d4ff78831ce1f1a/users/89d7266589034648838eb80a62af64d8/roles/fe9bbc67742f4f5893f39b18eb31d59a` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:28.282113 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f8fb02-729a-4219-840c-e0de0c69b48f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bedff2b4b4f48739d4ff78831ce1f1a, user_id=89d7266589034648838eb80a62af64d8, role_id=fe9bbc67742f4f5893f39b18eb31d59a)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:28.285140 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f8fb02-729a-4219-840c-e0de0c69b48f admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:28.308086 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 941/1892] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:12:28 2022] PUT /identity/v3/projects/4bedff2b4b4f48739d4ff78831ce1f1a/users/89d7266589034648838eb80a62af64d8/roles/fe9bbc67742f4f5893f39b18eb31d59a => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:28.309885 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03094484-bf94-4cf3-99cd-c1d2eaa15aed None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:28.310174 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03094484-bf94-4cf3-99cd-c1d2eaa15aed None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:28.310452 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03094484-bf94-4cf3-99cd-c1d2eaa15aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:28.342069 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-03094484-bf94-4cf3-99cd-c1d2eaa15aed None None] MFA Rules not processed for user `89d7266589034648838eb80a62af64d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:28.343374 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-03094484-bf94-4cf3-99cd-c1d2eaa15aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:28.448892 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 952/1893] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:12:28 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:28.449257 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f8fb02-729a-4219-840c-e0de0c69b48f admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:28.458263 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-06f8fb02-729a-4219-840c-e0de0c69b48f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:28.463957 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03094484-bf94-4cf3-99cd-c1d2eaa15aed None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:28.466258 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-03094484-bf94-4cf3-99cd-c1d2eaa15aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:28.578283 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03094484-bf94-4cf3-99cd-c1d2eaa15aed None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:28.586509 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2763ce-0b20-4b7d-8367-88841291764d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75135b856134ba4b9ccac337886f682', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:28.587127 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2763ce-0b20-4b7d-8367-88841291764d service cinder] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:28.587402 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2763ce-0b20-4b7d-8367-88841291764d service cinder] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:28.588043 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2763ce-0b20-4b7d-8367-88841291764d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:28.589956 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-7f2763ce-0b20-4b7d-8367-88841291764d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:28.601677 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f8fb02-729a-4219-840c-e0de0c69b48f admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:28.608905 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459bb364-649c-48a0-b4c4-0a39743b9d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:28.609746 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459bb364-649c-48a0-b4c4-0a39743b9d58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:28.610107 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459bb364-649c-48a0-b4c4-0a39743b9d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:28.610455 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459bb364-649c-48a0-b4c4-0a39743b9d58 admin admin] PATH_INFO: `/v3/projects/70866ef24d9a4ee69b2d5e38ea3d72cc` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:28.612056 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459bb364-649c-48a0-b4c4-0a39743b9d58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70866ef24d9a4ee69b2d5e38ea3d72cc)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:28.614085 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459bb364-649c-48a0-b4c4-0a39743b9d58 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:28.694798 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2763ce-0b20-4b7d-8367-88841291764d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:28.695491 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-459bb364-649c-48a0-b4c4-0a39743b9d58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70866ef24d9a4ee69b2d5e38ea3d72cc', 'request_id': 'req-459bb364-649c-48a0-b4c4-0a39743b9d58'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:28.696803 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2763ce-0b20-4b7d-8367-88841291764d service cinder] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:28.705665 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-459bb364-649c-48a0-b4c4-0a39743b9d58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70866ef24d9a4ee69b2d5e38ea3d72cc', 'request_id': 'req-459bb364-649c-48a0-b4c4-0a39743b9d58'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:28.720350 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-459bb364-649c-48a0-b4c4-0a39743b9d58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70866ef24d9a4ee69b2d5e38ea3d72cc', 'request_id': 'req-459bb364-649c-48a0-b4c4-0a39743b9d58'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:28.729423 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 953/1894] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:28 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:12:28.730360 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2763ce-0b20-4b7d-8367-88841291764d service cinder] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:28.734788 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-7f2763ce-0b20-4b7d-8367-88841291764d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:28.736609 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-459bb364-649c-48a0-b4c4-0a39743b9d58 admin admin] The token cache is being invalidate because project 70866ef24d9a4ee69b2d5e38ea3d72cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81649) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:12:28.737276 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-459bb364-649c-48a0-b4c4-0a39743b9d58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:28.738212 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-459bb364-649c-48a0-b4c4-0a39743b9d58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:28.740145 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 942/1895] 10.222.0.49 () {58 vars in 1233 bytes} [Thu Sep 29 02:12:28 2022] DELETE /identity/v3/projects/70866ef24d9a4ee69b2d5e38ea3d72cc => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:12:28.746347 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab9c215-46e7-458d-a728-754a8d85d5f7 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:28.746347 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab9c215-46e7-458d-a728-754a8d85d5f7 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:28.746582 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab9c215-46e7-458d-a728-754a8d85d5f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:28.764499 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2763ce-0b20-4b7d-8367-88841291764d service cinder] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:28.777193 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:28.791892 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-bab9c215-46e7-458d-a728-754a8d85d5f7 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:28.793430 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-bab9c215-46e7-458d-a728-754a8d85d5f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:28.835695 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de90f8d8-ec48-42f9-8f33-ab129d929368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:28.836615 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de90f8d8-ec48-42f9-8f33-ab129d929368 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:28.837120 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de90f8d8-ec48-42f9-8f33-ab129d929368 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:28.837712 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de90f8d8-ec48-42f9-8f33-ab129d929368 admin admin] PATH_INFO: `/v3/projects/da407bf120a84aaa915a9597c64c954e` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:28.839016 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de90f8d8-ec48-42f9-8f33-ab129d929368 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da407bf120a84aaa915a9597c64c954e)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:28.841243 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de90f8d8-ec48-42f9-8f33-ab129d929368 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:28.888068 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:28.937444 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 943/1896] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:12:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 29 02:12:28.944690 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-de90f8d8-ec48-42f9-8f33-ab129d929368 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da407bf120a84aaa915a9597c64c954e', 'request_id': 'req-de90f8d8-ec48-42f9-8f33-ab129d929368'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:28.945578 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f75fcb-9a96-4841-b426-feb04ba03f2f None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:28.945944 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f75fcb-9a96-4841-b426-feb04ba03f2f None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:28.946216 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f75fcb-9a96-4841-b426-feb04ba03f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:28.954767 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-de90f8d8-ec48-42f9-8f33-ab129d929368 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da407bf120a84aaa915a9597c64c954e', 'request_id': 'req-de90f8d8-ec48-42f9-8f33-ab129d929368'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:28.978183 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-25f75fcb-9a96-4841-b426-feb04ba03f2f None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:28.980089 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-25f75fcb-9a96-4841-b426-feb04ba03f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:28.996534 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-de90f8d8-ec48-42f9-8f33-ab129d929368 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da407bf120a84aaa915a9597c64c954e', 'request_id': 'req-de90f8d8-ec48-42f9-8f33-ab129d929368'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:29.010750 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-de90f8d8-ec48-42f9-8f33-ab129d929368 admin admin] The token cache is being invalidate because project da407bf120a84aaa915a9597c64c954e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81648) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:12:29.011156 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-de90f8d8-ec48-42f9-8f33-ab129d929368 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:29.012534 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-de90f8d8-ec48-42f9-8f33-ab129d929368 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:29.017773 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 954/1897] 10.222.0.49 () {58 vars in 1233 bytes} [Thu Sep 29 02:12:28 2022] DELETE /identity/v3/projects/da407bf120a84aaa915a9597c64c954e => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:29.018726 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de90f8d8-ec48-42f9-8f33-ab129d929368 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:29.020113 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-de90f8d8-ec48-42f9-8f33-ab129d929368 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:29.064278 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 944/1898] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:12:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 29 02:12:29.068642 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f75fcb-9a96-4841-b426-feb04ba03f2f None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:29.080843 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f75fcb-9a96-4841-b426-feb04ba03f2f None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:29.087533 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d55070f-3c2e-465e-95c5-9b09f12d3cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:29.088409 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d55070f-3c2e-465e-95c5-9b09f12d3cec admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:29.088806 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d55070f-3c2e-465e-95c5-9b09f12d3cec admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:29.089555 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d55070f-3c2e-465e-95c5-9b09f12d3cec admin admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:29.090870 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d55070f-3c2e-465e-95c5-9b09f12d3cec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:12:29.091377 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d55070f-3c2e-465e-95c5-9b09f12d3cec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:29.092951 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d55070f-3c2e-465e-95c5-9b09f12d3cec admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:29.109245 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 945/1899] 10.222.0.49 () {58 vars in 1153 bytes} [Thu Sep 29 02:12:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 02:12:29.113429 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d55070f-3c2e-465e-95c5-9b09f12d3cec admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:29.115093 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de90f8d8-ec48-42f9-8f33-ab129d929368 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:29.120918 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d019a1f5-0168-4db5-a3e0-3172011fd443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:29.121605 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d019a1f5-0168-4db5-a3e0-3172011fd443 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:29.121884 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d019a1f5-0168-4db5-a3e0-3172011fd443 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:29.122674 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d019a1f5-0168-4db5-a3e0-3172011fd443 admin admin] PATH_INFO: `/v3/users/0ea30542d6f842db87e857bd1957564c` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:29.123282 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d019a1f5-0168-4db5-a3e0-3172011fd443 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ea30542d6f842db87e857bd1957564c)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:29.125421 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d019a1f5-0168-4db5-a3e0-3172011fd443 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:29.126658 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d55070f-3c2e-465e-95c5-9b09f12d3cec admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:29.132872 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63849960-3fda-4c82-9b1d-38890afe764f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:29.133757 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63849960-3fda-4c82-9b1d-38890afe764f admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:29.134104 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63849960-3fda-4c82-9b1d-38890afe764f admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:29.134450 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63849960-3fda-4c82-9b1d-38890afe764f admin admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:29.135226 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63849960-3fda-4c82-9b1d-38890afe764f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:29.137600 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63849960-3fda-4c82-9b1d-38890afe764f admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:29.199216 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 946/1900] 10.222.0.49 () {60 vars in 1153 bytes} [Thu Sep 29 02:12:29 2022] POST /identity/v3/projects => generated 359 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 29 02:12:29.205663 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63849960-3fda-4c82-9b1d-38890afe764f admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:29.213447 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:29.216336 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-d019a1f5-0168-4db5-a3e0-3172011fd443 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ea30542d6f842db87e857bd1957564c'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:29.218922 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-d019a1f5-0168-4db5-a3e0-3172011fd443 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ea30542d6f842db87e857bd1957564c'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:29.243334 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-d019a1f5-0168-4db5-a3e0-3172011fd443 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ea30542d6f842db87e857bd1957564c'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:29.255280 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-d019a1f5-0168-4db5-a3e0-3172011fd443 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ea30542d6f842db87e857bd1957564c'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:29.256228 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-d019a1f5-0168-4db5-a3e0-3172011fd443 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ea30542d6f842db87e857bd1957564c'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:29.274739 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 955/1901] 10.222.0.49 () {58 vars in 1224 bytes} [Thu Sep 29 02:12:29 2022] DELETE /identity/v3/users/0ea30542d6f842db87e857bd1957564c => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:29.293065 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc7afa0-0d9b-4cf2-95ce-6eff4c14b09d None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:29.293710 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc7afa0-0d9b-4cf2-95ce-6eff4c14b09d None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:29.294467 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc7afa0-0d9b-4cf2-95ce-6eff4c14b09d None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:29.296683 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 956/1902] 10.222.0.49 () {54 vars in 921 bytes} [Thu Sep 29 02:12:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 29 02:12:29.310469 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e120ea-f9a6-4f65-b7b0-ff4ef91eb635 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:29.312295 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e120ea-f9a6-4f65-b7b0-ff4ef91eb635 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:29.312884 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e120ea-f9a6-4f65-b7b0-ff4ef91eb635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:29.315474 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63849960-3fda-4c82-9b1d-38890afe764f admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:29.353301 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-a2e120ea-f9a6-4f65-b7b0-ff4ef91eb635 None None] MFA Rules not processed for user `f3325a7111d447f4a9cf00c672d5420f`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:29.354653 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-a2e120ea-f9a6-4f65-b7b0-ff4ef91eb635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:29.397978 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:29.417812 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0694ed-ecf4-4ec2-8295-20d61c9763c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:29.418445 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0694ed-ecf4-4ec2-8295-20d61c9763c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:29.419176 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0694ed-ecf4-4ec2-8295-20d61c9763c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:29.419460 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0694ed-ecf4-4ec2-8295-20d61c9763c6 admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:29.420966 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0694ed-ecf4-4ec2-8295-20d61c9763c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:29.423584 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0694ed-ecf4-4ec2-8295-20d61c9763c6 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:29.460535 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 947/1903] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 02:12:29 2022] POST /identity/v3/users => generated 280 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:29.466119 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0694ed-ecf4-4ec2-8295-20d61c9763c6 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:29.467960 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-4a0694ed-ecf4-4ec2-8295-20d61c9763c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:29.481862 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0694ed-ecf4-4ec2-8295-20d61c9763c6 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:29.484229 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 957/1904] 10.222.0.49 () {58 vars in 1018 bytes} [Thu Sep 29 02:12:29 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:29.487534 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769c14df-82ec-4a8d-a1a6-63beccac4f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:29.488153 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c14df-82ec-4a8d-a1a6-63beccac4f7b admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:29.488437 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c14df-82ec-4a8d-a1a6-63beccac4f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:29.488712 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c14df-82ec-4a8d-a1a6-63beccac4f7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:29.490359 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769c14df-82ec-4a8d-a1a6-63beccac4f7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:29.492365 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769c14df-82ec-4a8d-a1a6-63beccac4f7b admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:29.500630 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e120ea-f9a6-4f65-b7b0-ff4ef91eb635 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:29.502982 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-a2e120ea-f9a6-4f65-b7b0-ff4ef91eb635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:29.507538 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 948/1905] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:29 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:29.509248 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769c14df-82ec-4a8d-a1a6-63beccac4f7b admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:29.518035 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e120ea-f9a6-4f65-b7b0-ff4ef91eb635 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:29.522041 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769c14df-82ec-4a8d-a1a6-63beccac4f7b admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:29.525239 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a14c7f-2c40-455c-915e-b7e60f304633 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3325a7111d447f4a9cf00c672d5420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:29.525964 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a14c7f-2c40-455c-915e-b7e60f304633 service nova] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:29.526246 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a14c7f-2c40-455c-915e-b7e60f304633 service nova] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:29.526519 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a14c7f-2c40-455c-915e-b7e60f304633 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:29.527970 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eab8f6-7bb6-4bc5-93c3-7650947f7190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:29.528708 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eab8f6-7bb6-4bc5-93c3-7650947f7190 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:29.529092 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eab8f6-7bb6-4bc5-93c3-7650947f7190 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:29.529442 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eab8f6-7bb6-4bc5-93c3-7650947f7190 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:29.530167 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eab8f6-7bb6-4bc5-93c3-7650947f7190 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:29.531959 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eab8f6-7bb6-4bc5-93c3-7650947f7190 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:29.536310 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a14c7f-2c40-455c-915e-b7e60f304633 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:29.538047 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a14c7f-2c40-455c-915e-b7e60f304633 service nova] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:29.544983 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 949/1906] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:29 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:29.549034 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eab8f6-7bb6-4bc5-93c3-7650947f7190 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:29.552069 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 958/1907] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:12:29.559853 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eab8f6-7bb6-4bc5-93c3-7650947f7190 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:29.564593 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad54a6ea-25b2-4b80-b7d6-1c5e35924666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:29.565369 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad54a6ea-25b2-4b80-b7d6-1c5e35924666 admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:29.565724 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad54a6ea-25b2-4b80-b7d6-1c5e35924666 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:29.566379 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad54a6ea-25b2-4b80-b7d6-1c5e35924666 admin admin] PATH_INFO: `/v3/projects/1f11222e56e04c019d0d18a73e5d3ead/users/07407375990f4a069c3096cf67d4de4d/roles/f157f905c9c94ccfbfb46e52d443e8f2` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:29.592602 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad54a6ea-25b2-4b80-b7d6-1c5e35924666 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f11222e56e04c019d0d18a73e5d3ead, user_id=07407375990f4a069c3096cf67d4de4d, role_id=f157f905c9c94ccfbfb46e52d443e8f2)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:29.595766 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad54a6ea-25b2-4b80-b7d6-1c5e35924666 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:29.622111 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 950/1908] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:12:29 2022] PUT /identity/v3/projects/1f11222e56e04c019d0d18a73e5d3ead/users/07407375990f4a069c3096cf67d4de4d/roles/f157f905c9c94ccfbfb46e52d443e8f2 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:12:29.629833 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d315a-272c-4fbf-aa4c-aa0fa8d6bc17 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:29.630388 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d315a-272c-4fbf-aa4c-aa0fa8d6bc17 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:29.630388 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d315a-272c-4fbf-aa4c-aa0fa8d6bc17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:29.657363 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad54a6ea-25b2-4b80-b7d6-1c5e35924666 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:29.659428 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-ad54a6ea-25b2-4b80-b7d6-1c5e35924666 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:29.701611 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-c79d315a-272c-4fbf-aa4c-aa0fa8d6bc17 None None] MFA Rules not processed for user `07407375990f4a069c3096cf67d4de4d`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:29.703640 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-c79d315a-272c-4fbf-aa4c-aa0fa8d6bc17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:29.757577 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad54a6ea-25b2-4b80-b7d6-1c5e35924666 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:29.764375 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53b65c5-2411-4059-8a57-85c83fdf618e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:29.765030 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b65c5-2411-4059-8a57-85c83fdf618e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:29.765295 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b65c5-2411-4059-8a57-85c83fdf618e admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:29.765624 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b65c5-2411-4059-8a57-85c83fdf618e admin admin] PATH_INFO: `/v3/projects/7c4b58bed04e45748fae114619989cdf` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:29.772562 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53b65c5-2411-4059-8a57-85c83fdf618e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c4b58bed04e45748fae114619989cdf)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:29.776099 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53b65c5-2411-4059-8a57-85c83fdf618e admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:29.830935 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 959/1909] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:12:29 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:29.853768 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-b53b65c5-2411-4059-8a57-85c83fdf618e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c4b58bed04e45748fae114619989cdf', 'request_id': 'req-b53b65c5-2411-4059-8a57-85c83fdf618e'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:29.880779 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-b53b65c5-2411-4059-8a57-85c83fdf618e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c4b58bed04e45748fae114619989cdf', 'request_id': 'req-b53b65c5-2411-4059-8a57-85c83fdf618e'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:29.897883 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79d315a-272c-4fbf-aa4c-aa0fa8d6bc17 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:29.899943 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-b53b65c5-2411-4059-8a57-85c83fdf618e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c4b58bed04e45748fae114619989cdf', 'request_id': 'req-b53b65c5-2411-4059-8a57-85c83fdf618e'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:29.911328 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-c79d315a-272c-4fbf-aa4c-aa0fa8d6bc17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:29.932546 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-b53b65c5-2411-4059-8a57-85c83fdf618e admin admin] The token cache is being invalidate because project 7c4b58bed04e45748fae114619989cdf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81649) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:12:29.933944 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-b53b65c5-2411-4059-8a57-85c83fdf618e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:29.935360 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-b53b65c5-2411-4059-8a57-85c83fdf618e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:29.937822 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 951/1910] 10.222.0.49 () {58 vars in 1233 bytes} [Thu Sep 29 02:12:29 2022] DELETE /identity/v3/projects/7c4b58bed04e45748fae114619989cdf => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:29.944830 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e5fbb9-ca91-4b39-8f14-aa43487e9c45 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:29.946614 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e5fbb9-ca91-4b39-8f14-aa43487e9c45 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:29.947200 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e5fbb9-ca91-4b39-8f14-aa43487e9c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:29.966629 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:29.981701 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-30e5fbb9-ca91-4b39-8f14-aa43487e9c45 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:29.982940 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-30e5fbb9-ca91-4b39-8f14-aa43487e9c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:29.995451 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79d315a-272c-4fbf-aa4c-aa0fa8d6bc17 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:30.017897 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:30.069540 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 952/1911] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:12:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:30.079079 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e37fa3e-17e2-4168-a15b-446a02c92b18 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:30.079885 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e37fa3e-17e2-4168-a15b-446a02c92b18 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:30.080168 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e37fa3e-17e2-4168-a15b-446a02c92b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:30.091548 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b41e29-834b-4396-91d3-4d9615399870 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75135b856134ba4b9ccac337886f682', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:30.093248 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b41e29-834b-4396-91d3-4d9615399870 service cinder] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:30.093908 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b41e29-834b-4396-91d3-4d9615399870 service cinder] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:30.094554 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b41e29-834b-4396-91d3-4d9615399870 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:30.097928 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-c1b41e29-834b-4396-91d3-4d9615399870 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:30.126212 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-0e37fa3e-17e2-4168-a15b-446a02c92b18 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:30.127554 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-0e37fa3e-17e2-4168-a15b-446a02c92b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:30.138474 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 953/1912] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:12:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:30.143155 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e37fa3e-17e2-4168-a15b-446a02c92b18 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:30.157860 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e37fa3e-17e2-4168-a15b-446a02c92b18 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:30.163566 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85217f86-ece3-4ebb-9c31-21f6ce5bf356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:30.164533 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85217f86-ece3-4ebb-9c31-21f6ce5bf356 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:30.164923 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85217f86-ece3-4ebb-9c31-21f6ce5bf356 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:30.165286 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85217f86-ece3-4ebb-9c31-21f6ce5bf356 admin admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:30.166074 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85217f86-ece3-4ebb-9c31-21f6ce5bf356 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:12:30.166615 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85217f86-ece3-4ebb-9c31-21f6ce5bf356 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:30.168353 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85217f86-ece3-4ebb-9c31-21f6ce5bf356 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:30.188764 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 954/1913] 10.222.0.49 () {58 vars in 1153 bytes} [Thu Sep 29 02:12:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:12:30.192565 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85217f86-ece3-4ebb-9c31-21f6ce5bf356 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:30.217703 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85217f86-ece3-4ebb-9c31-21f6ce5bf356 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:30.223588 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4274e16a-0904-46fb-92bc-12f286107dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:30.223936 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4274e16a-0904-46fb-92bc-12f286107dee admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:30.224217 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4274e16a-0904-46fb-92bc-12f286107dee admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:30.224493 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4274e16a-0904-46fb-92bc-12f286107dee admin admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:30.225141 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4274e16a-0904-46fb-92bc-12f286107dee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:30.228129 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4274e16a-0904-46fb-92bc-12f286107dee admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:30.228631 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b41e29-834b-4396-91d3-4d9615399870 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:30.230236 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b41e29-834b-4396-91d3-4d9615399870 service cinder] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:30.248098 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 960/1914] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:29 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:12:30.269248 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b41e29-834b-4396-91d3-4d9615399870 service cinder] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:30.275340 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-c1b41e29-834b-4396-91d3-4d9615399870 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:30.298189 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 955/1915] 10.222.0.49 () {60 vars in 1153 bytes} [Thu Sep 29 02:12:30 2022] POST /identity/v3/projects => generated 407 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:30.300610 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4274e16a-0904-46fb-92bc-12f286107dee admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:30.315467 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b41e29-834b-4396-91d3-4d9615399870 service cinder] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:30.426693 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4274e16a-0904-46fb-92bc-12f286107dee admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:30.428355 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc3e8b0-2663-4ec4-9764-368e3f9c5f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:30.429037 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc3e8b0-2663-4ec4-9764-368e3f9c5f91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:30.429301 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc3e8b0-2663-4ec4-9764-368e3f9c5f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:30.429616 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc3e8b0-2663-4ec4-9764-368e3f9c5f91 admin admin] PATH_INFO: `/v3/users/07407375990f4a069c3096cf67d4de4d` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:30.432144 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc3e8b0-2663-4ec4-9764-368e3f9c5f91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07407375990f4a069c3096cf67d4de4d)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:30.434907 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a208397-f96c-4e05-9932-c6af2c558db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:30.435134 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc3e8b0-2663-4ec4-9764-368e3f9c5f91 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:30.436062 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a208397-f96c-4e05-9932-c6af2c558db3 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:30.436556 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a208397-f96c-4e05-9932-c6af2c558db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:30.437023 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a208397-f96c-4e05-9932-c6af2c558db3 admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:30.437795 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a208397-f96c-4e05-9932-c6af2c558db3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:30.440120 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a208397-f96c-4e05-9932-c6af2c558db3 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:30.471990 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 956/1916] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 02:12:30 2022] POST /identity/v3/users => generated 304 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:30.472876 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a208397-f96c-4e05-9932-c6af2c558db3 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:30.477201 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-5a208397-f96c-4e05-9932-c6af2c558db3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:30.503189 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:30.509093 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-8dc3e8b0-2663-4ec4-9764-368e3f9c5f91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07407375990f4a069c3096cf67d4de4d'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:30.511710 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-8dc3e8b0-2663-4ec4-9764-368e3f9c5f91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07407375990f4a069c3096cf67d4de4d'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:30.542241 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-8dc3e8b0-2663-4ec4-9764-368e3f9c5f91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07407375990f4a069c3096cf67d4de4d'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:30.553303 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-8dc3e8b0-2663-4ec4-9764-368e3f9c5f91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07407375990f4a069c3096cf67d4de4d'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:30.553985 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-8dc3e8b0-2663-4ec4-9764-368e3f9c5f91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07407375990f4a069c3096cf67d4de4d'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:30.569420 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 961/1917] 10.222.0.49 () {58 vars in 1224 bytes} [Thu Sep 29 02:12:30 2022] DELETE /identity/v3/users/07407375990f4a069c3096cf67d4de4d => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:30.571766 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc3e8b0-2663-4ec4-9764-368e3f9c5f91 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:30.573261 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-8dc3e8b0-2663-4ec4-9764-368e3f9c5f91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:30.583079 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a208397-f96c-4e05-9932-c6af2c558db3 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:30.637752 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:30.655866 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc3e8b0-2663-4ec4-9764-368e3f9c5f91 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:30.662228 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb94a56-aa61-4a91-96b5-f0ad27535023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:30.665396 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb94a56-aa61-4a91-96b5-f0ad27535023 admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:30.665700 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb94a56-aa61-4a91-96b5-f0ad27535023 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:30.665980 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb94a56-aa61-4a91-96b5-f0ad27535023 admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:30.666615 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fae320-2d01-43fd-b2fa-06cfd1ff36ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75135b856134ba4b9ccac337886f682', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:30.666744 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb94a56-aa61-4a91-96b5-f0ad27535023 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:30.667710 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fae320-2d01-43fd-b2fa-06cfd1ff36ac service cinder] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:30.668359 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb94a56-aa61-4a91-96b5-f0ad27535023 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:30.668932 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fae320-2d01-43fd-b2fa-06cfd1ff36ac service cinder] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:30.669243 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fae320-2d01-43fd-b2fa-06cfd1ff36ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:30.671686 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-16fae320-2d01-43fd-b2fa-06cfd1ff36ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:30.683142 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 962/1918] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:30 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:30.684511 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc77ebf3-2489-47b0-ba69-0de8286c2198 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:30.684861 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc77ebf3-2489-47b0-ba69-0de8286c2198 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:30.685284 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc77ebf3-2489-47b0-ba69-0de8286c2198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:30.713164 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-fc77ebf3-2489-47b0-ba69-0de8286c2198 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:30.714559 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-fc77ebf3-2489-47b0-ba69-0de8286c2198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:30.724802 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 963/1919] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:12:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:30.726058 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc77ebf3-2489-47b0-ba69-0de8286c2198 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:30.737612 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc77ebf3-2489-47b0-ba69-0de8286c2198 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:30.743473 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd0077a-3239-4ba4-9c4c-53a280f461c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:30.746343 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd0077a-3239-4ba4-9c4c-53a280f461c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:30.746630 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd0077a-3239-4ba4-9c4c-53a280f461c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:30.746905 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd0077a-3239-4ba4-9c4c-53a280f461c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:30.750068 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd0077a-3239-4ba4-9c4c-53a280f461c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:30.751804 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd0077a-3239-4ba4-9c4c-53a280f461c8 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:30.765670 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 964/1920] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:30 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:30.767888 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fae320-2d01-43fd-b2fa-06cfd1ff36ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:30.769849 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd0077a-3239-4ba4-9c4c-53a280f461c8 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:30.770814 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fae320-2d01-43fd-b2fa-06cfd1ff36ac service cinder] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:30.771742 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-9fd0077a-3239-4ba4-9c4c-53a280f461c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:30.786416 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 957/1921] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:30 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:12:30.798754 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fae320-2d01-43fd-b2fa-06cfd1ff36ac service cinder] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:30.827580 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fae320-2d01-43fd-b2fa-06cfd1ff36ac service cinder] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:30.839207 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b45a1dd-0423-4f5a-986c-1ae2d2822ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:30.839889 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b45a1dd-0423-4f5a-986c-1ae2d2822ad2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:30.840171 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b45a1dd-0423-4f5a-986c-1ae2d2822ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:30.840447 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b45a1dd-0423-4f5a-986c-1ae2d2822ad2 admin admin] PATH_INFO: `/v3/projects/7a0a8e1273c34f56bf58c30581a611fb/users/3dcfc962512748e692ffae884df16e93/roles/f157f905c9c94ccfbfb46e52d443e8f2` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:30.905532 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd0077a-3239-4ba4-9c4c-53a280f461c8 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:30.905875 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b45a1dd-0423-4f5a-986c-1ae2d2822ad2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a0a8e1273c34f56bf58c30581a611fb, user_id=3dcfc962512748e692ffae884df16e93, role_id=f157f905c9c94ccfbfb46e52d443e8f2)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:30.919373 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80aa4c5-3278-4f87-9ab3-dcc384392e2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:30.920186 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80aa4c5-3278-4f87-9ab3-dcc384392e2b service neutron] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:30.920647 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80aa4c5-3278-4f87-9ab3-dcc384392e2b service neutron] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:30.920928 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80aa4c5-3278-4f87-9ab3-dcc384392e2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:30.923262 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b45a1dd-0423-4f5a-986c-1ae2d2822ad2 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:30.948708 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80aa4c5-3278-4f87-9ab3-dcc384392e2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:30.950382 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80aa4c5-3278-4f87-9ab3-dcc384392e2b service neutron] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:30.975971 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 958/1922] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:12:30 2022] PUT /identity/v3/projects/7a0a8e1273c34f56bf58c30581a611fb/users/3dcfc962512748e692ffae884df16e93/roles/f157f905c9c94ccfbfb46e52d443e8f2 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:30.987116 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 965/1923] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:12:30.987569 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7cdfc3-2189-4ea8-ae78-10ae1436d164 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:30.987910 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7cdfc3-2189-4ea8-ae78-10ae1436d164 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:30.988295 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7cdfc3-2189-4ea8-ae78-10ae1436d164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:31.057378 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-8e7cdfc3-2189-4ea8-ae78-10ae1436d164 None None] MFA Rules not processed for user `3dcfc962512748e692ffae884df16e93`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:31.058680 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-8e7cdfc3-2189-4ea8-ae78-10ae1436d164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:31.171787 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 959/1924] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:12:30 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 29 02:12:31.175043 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80aa4c5-3278-4f87-9ab3-dcc384392e2b service neutron] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:31.188301 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80aa4c5-3278-4f87-9ab3-dcc384392e2b service neutron] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:31.262216 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:31.289795 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd081371-26bd-4465-9ae9-bc45a3b52adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:31.290584 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd081371-26bd-4465-9ae9-bc45a3b52adb admin admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:31.290865 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd081371-26bd-4465-9ae9-bc45a3b52adb admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:31.291143 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd081371-26bd-4465-9ae9-bc45a3b52adb admin admin] PATH_INFO: `/v3/projects` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:31.291803 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd081371-26bd-4465-9ae9-bc45a3b52adb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:31.294485 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd081371-26bd-4465-9ae9-bc45a3b52adb admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:31.344367 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 966/1925] 10.222.0.49 () {60 vars in 1153 bytes} [Thu Sep 29 02:12:31 2022] POST /identity/v3/projects => generated 409 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:31.349586 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7cdfc3-2189-4ea8-ae78-10ae1436d164 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:31.366066 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7cdfc3-2189-4ea8-ae78-10ae1436d164 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:31.463655 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:31.480130 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41aa820-8fc1-4fc2-8de9-ee000f3c9d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:31.480804 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41aa820-8fc1-4fc2-8de9-ee000f3c9d3c admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:31.481106 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41aa820-8fc1-4fc2-8de9-ee000f3c9d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:31.481442 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41aa820-8fc1-4fc2-8de9-ee000f3c9d3c admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:31.483657 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41aa820-8fc1-4fc2-8de9-ee000f3c9d3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:31.487482 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41aa820-8fc1-4fc2-8de9-ee000f3c9d3c admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:31.549058 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd081371-26bd-4465-9ae9-bc45a3b52adb admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:31.556541 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 960/1926] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 02:12:31 2022] POST /identity/v3/users => generated 311 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:31.575245 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd081371-26bd-4465-9ae9-bc45a3b52adb admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:31.608656 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82c60c6-bb92-45dd-b26b-e2c5f8f9e3f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:31.609409 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82c60c6-bb92-45dd-b26b-e2c5f8f9e3f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:31.613235 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82c60c6-bb92-45dd-b26b-e2c5f8f9e3f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:31.613757 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82c60c6-bb92-45dd-b26b-e2c5f8f9e3f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:31.615196 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82c60c6-bb92-45dd-b26b-e2c5f8f9e3f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:31.620209 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82c60c6-bb92-45dd-b26b-e2c5f8f9e3f9 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:31.646124 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 967/1927] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:31 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:31.651249 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41aa820-8fc1-4fc2-8de9-ee000f3c9d3c admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:31.670359 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41aa820-8fc1-4fc2-8de9-ee000f3c9d3c admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:31.679012 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d53cb3d-4156-474e-8fee-7687cd31aeb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:31.680265 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d53cb3d-4156-474e-8fee-7687cd31aeb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:31.680516 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d53cb3d-4156-474e-8fee-7687cd31aeb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:31.680787 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d53cb3d-4156-474e-8fee-7687cd31aeb5 admin admin] PATH_INFO: `/v3/projects/d29f04e7ae684cc89c572ed305b85143/users/c8a2fed140fd431ab35238348e9b905c/roles/fe9bbc67742f4f5893f39b18eb31d59a` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:31.721415 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d53cb3d-4156-474e-8fee-7687cd31aeb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d29f04e7ae684cc89c572ed305b85143, user_id=c8a2fed140fd431ab35238348e9b905c, role_id=fe9bbc67742f4f5893f39b18eb31d59a)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:31.724126 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d53cb3d-4156-474e-8fee-7687cd31aeb5 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:31.742493 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 961/1928] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:12:31 2022] PUT /identity/v3/projects/d29f04e7ae684cc89c572ed305b85143/users/c8a2fed140fd431ab35238348e9b905c/roles/fe9bbc67742f4f5893f39b18eb31d59a => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:31.746474 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82c60c6-bb92-45dd-b26b-e2c5f8f9e3f9 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:31.759004 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82c60c6-bb92-45dd-b26b-e2c5f8f9e3f9 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:31.840908 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ca11af-d706-4eb6-99a8-17c2c6494308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:31.841618 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ca11af-d706-4eb6-99a8-17c2c6494308 admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:31.841932 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ca11af-d706-4eb6-99a8-17c2c6494308 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:31.842203 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ca11af-d706-4eb6-99a8-17c2c6494308 admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:31.843395 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ca11af-d706-4eb6-99a8-17c2c6494308 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:31.849863 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ca11af-d706-4eb6-99a8-17c2c6494308 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:31.879720 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 968/1929] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:31 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:31.880977 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d53cb3d-4156-474e-8fee-7687cd31aeb5 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:31.901475 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d53cb3d-4156-474e-8fee-7687cd31aeb5 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:31.908780 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13763d5f-0369-480f-8539-2c6a3d9cf651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:31.909020 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13763d5f-0369-480f-8539-2c6a3d9cf651 admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:31.909225 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13763d5f-0369-480f-8539-2c6a3d9cf651 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:31.909526 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13763d5f-0369-480f-8539-2c6a3d9cf651 admin admin] PATH_INFO: `/v3/projects/d29f04e7ae684cc89c572ed305b85143/users/c8a2fed140fd431ab35238348e9b905c/roles/fe9bbc67742f4f5893f39b18eb31d59a` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:31.912533 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13763d5f-0369-480f-8539-2c6a3d9cf651 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d29f04e7ae684cc89c572ed305b85143, user_id=c8a2fed140fd431ab35238348e9b905c, role_id=fe9bbc67742f4f5893f39b18eb31d59a)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:31.916528 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13763d5f-0369-480f-8539-2c6a3d9cf651 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:31.932233 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 962/1930] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:12:31 2022] PUT /identity/v3/projects/d29f04e7ae684cc89c572ed305b85143/users/c8a2fed140fd431ab35238348e9b905c/roles/fe9bbc67742f4f5893f39b18eb31d59a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:31.944250 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53eff31-38d6-4c94-bb24-4e513b6a10ac None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:31.944818 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53eff31-38d6-4c94-bb24-4e513b6a10ac None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:31.946014 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53eff31-38d6-4c94-bb24-4e513b6a10ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:31.996622 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-c53eff31-38d6-4c94-bb24-4e513b6a10ac None None] MFA Rules not processed for user `c8a2fed140fd431ab35238348e9b905c`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:31.999238 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-c53eff31-38d6-4c94-bb24-4e513b6a10ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:32.084412 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13763d5f-0369-480f-8539-2c6a3d9cf651 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:32.086527 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-13763d5f-0369-480f-8539-2c6a3d9cf651 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:32.129150 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 969/1931] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:12:31 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 29 02:12:32.140031 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53eff31-38d6-4c94-bb24-4e513b6a10ac None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:32.141775 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-c53eff31-38d6-4c94-bb24-4e513b6a10ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:32.174241 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13763d5f-0369-480f-8539-2c6a3d9cf651 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:32.179152 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f8ab29-baab-4cc6-907f-129dbf6f8f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:32.180364 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8ab29-baab-4cc6-907f-129dbf6f8f52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:32.180731 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8ab29-baab-4cc6-907f-129dbf6f8f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:32.181005 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8ab29-baab-4cc6-907f-129dbf6f8f52 admin admin] PATH_INFO: `/v3/projects/1f11222e56e04c019d0d18a73e5d3ead` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:32.182284 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f8ab29-baab-4cc6-907f-129dbf6f8f52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f11222e56e04c019d0d18a73e5d3ead)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:32.184633 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f8ab29-baab-4cc6-907f-129dbf6f8f52 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:32.204367 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:32.223803 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53eff31-38d6-4c94-bb24-4e513b6a10ac None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:32.238259 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-15f8ab29-baab-4cc6-907f-129dbf6f8f52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f11222e56e04c019d0d18a73e5d3ead', 'request_id': 'req-15f8ab29-baab-4cc6-907f-129dbf6f8f52'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:32.245537 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-15f8ab29-baab-4cc6-907f-129dbf6f8f52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f11222e56e04c019d0d18a73e5d3ead', 'request_id': 'req-15f8ab29-baab-4cc6-907f-129dbf6f8f52'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:32.254671 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-15f8ab29-baab-4cc6-907f-129dbf6f8f52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f11222e56e04c019d0d18a73e5d3ead', 'request_id': 'req-15f8ab29-baab-4cc6-907f-129dbf6f8f52'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:32.267617 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-15f8ab29-baab-4cc6-907f-129dbf6f8f52 admin admin] The token cache is being invalidate because project 1f11222e56e04c019d0d18a73e5d3ead was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81649) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:12:32.268187 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-15f8ab29-baab-4cc6-907f-129dbf6f8f52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:32.269695 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-15f8ab29-baab-4cc6-907f-129dbf6f8f52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:32.271483 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 963/1932] 10.222.0.49 () {58 vars in 1233 bytes} [Thu Sep 29 02:12:32 2022] DELETE /identity/v3/projects/1f11222e56e04c019d0d18a73e5d3ead => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:12:32.276601 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e410bd7c-3e6b-446c-84d7-9678d2a61416 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:32.276885 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e410bd7c-3e6b-446c-84d7-9678d2a61416 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:32.277484 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e410bd7c-3e6b-446c-84d7-9678d2a61416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:32.282369 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8454238-be09-49cf-9d4a-892236e8594b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75135b856134ba4b9ccac337886f682', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:32.283398 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8454238-be09-49cf-9d4a-892236e8594b service cinder] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:32.283729 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8454238-be09-49cf-9d4a-892236e8594b service cinder] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:32.283959 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8454238-be09-49cf-9d4a-892236e8594b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:32.285855 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-c8454238-be09-49cf-9d4a-892236e8594b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:32.299090 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-e410bd7c-3e6b-446c-84d7-9678d2a61416 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:32.300511 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-e410bd7c-3e6b-446c-84d7-9678d2a61416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:32.332290 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:32.362801 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8454238-be09-49cf-9d4a-892236e8594b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:32.364635 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8454238-be09-49cf-9d4a-892236e8594b service cinder] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:32.374483 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 964/1933] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:12:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 29 02:12:32.376972 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 970/1934] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:32 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 29 02:12:32.382191 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc3aa6d-fcab-4767-b05d-dc9a3f8eb369 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:32.382467 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc3aa6d-fcab-4767-b05d-dc9a3f8eb369 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:32.383608 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc3aa6d-fcab-4767-b05d-dc9a3f8eb369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:32.407852 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-afc3aa6d-fcab-4767-b05d-dc9a3f8eb369 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:32.409193 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-afc3aa6d-fcab-4767-b05d-dc9a3f8eb369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:32.418572 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 965/1935] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:12:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 29 02:12:32.422760 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8454238-be09-49cf-9d4a-892236e8594b service cinder] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:32.435158 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8454238-be09-49cf-9d4a-892236e8594b service cinder] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:32.440103 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fd9ff1-8e4d-4107-a20c-389a15c34953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:32.441092 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fd9ff1-8e4d-4107-a20c-389a15c34953 admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:32.441471 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fd9ff1-8e4d-4107-a20c-389a15c34953 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:32.441933 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fd9ff1-8e4d-4107-a20c-389a15c34953 admin admin] PATH_INFO: `/v3/domains` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:32.442653 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fd9ff1-8e4d-4107-a20c-389a15c34953 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:12:32.443024 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fd9ff1-8e4d-4107-a20c-389a15c34953 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:32.444870 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fd9ff1-8e4d-4107-a20c-389a15c34953 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:32.473484 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 971/1936] 10.222.0.49 () {58 vars in 1153 bytes} [Thu Sep 29 02:12:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:12:32.475281 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc3aa6d-fcab-4767-b05d-dc9a3f8eb369 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:32.484990 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc3aa6d-fcab-4767-b05d-dc9a3f8eb369 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:32.489974 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6520b4f5-0e09-455a-a423-d60a094c99e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:32.490787 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6520b4f5-0e09-455a-a423-d60a094c99e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:32.491066 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6520b4f5-0e09-455a-a423-d60a094c99e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:32.491441 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6520b4f5-0e09-455a-a423-d60a094c99e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:32.491980 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6520b4f5-0e09-455a-a423-d60a094c99e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:32.494544 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6520b4f5-0e09-455a-a423-d60a094c99e5 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:32.530467 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 966/1937] 10.222.0.49 () {60 vars in 1153 bytes} [Thu Sep 29 02:12:32 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:32.531942 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fd9ff1-8e4d-4107-a20c-389a15c34953 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:32.543203 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fd9ff1-8e4d-4107-a20c-389a15c34953 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:32.560620 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6520b4f5-0e09-455a-a423-d60a094c99e5 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:32.562418 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-6520b4f5-0e09-455a-a423-d60a094c99e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:32.607864 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e421494-613d-4817-a9c2-5b04a0ec88c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:32.608487 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e421494-613d-4817-a9c2-5b04a0ec88c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:32.608768 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e421494-613d-4817-a9c2-5b04a0ec88c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:32.609044 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e421494-613d-4817-a9c2-5b04a0ec88c6 admin admin] PATH_INFO: `/v3/users` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:32.609718 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e421494-613d-4817-a9c2-5b04a0ec88c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:32.611833 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e421494-613d-4817-a9c2-5b04a0ec88c6 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:32.629600 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6520b4f5-0e09-455a-a423-d60a094c99e5 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:32.634285 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395a732f-1f9c-4ce9-8dd4-d90481d7260e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75135b856134ba4b9ccac337886f682', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:32.635267 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395a732f-1f9c-4ce9-8dd4-d90481d7260e service cinder] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:32.636052 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395a732f-1f9c-4ce9-8dd4-d90481d7260e service cinder] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:32.636163 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395a732f-1f9c-4ce9-8dd4-d90481d7260e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:32.636341 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 972/1938] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 02:12:32 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:32.641218 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e421494-613d-4817-a9c2-5b04a0ec88c6 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:32.642558 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-395a732f-1f9c-4ce9-8dd4-d90481d7260e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:32.653698 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e421494-613d-4817-a9c2-5b04a0ec88c6 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:32.659101 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520ead99-ac9d-4de8-9ddf-600890e2000a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:32.659693 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520ead99-ac9d-4de8-9ddf-600890e2000a admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:32.660048 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520ead99-ac9d-4de8-9ddf-600890e2000a admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:32.660395 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520ead99-ac9d-4de8-9ddf-600890e2000a admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:32.661120 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520ead99-ac9d-4de8-9ddf-600890e2000a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:32.663005 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520ead99-ac9d-4de8-9ddf-600890e2000a admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:32.684233 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 973/1939] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:32 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:32.685603 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520ead99-ac9d-4de8-9ddf-600890e2000a admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:32.702170 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520ead99-ac9d-4de8-9ddf-600890e2000a admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:32.711704 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eae906-eb26-4d46-908a-39d72047a06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:32.712613 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eae906-eb26-4d46-908a-39d72047a06b admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:32.712904 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eae906-eb26-4d46-908a-39d72047a06b admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:32.713176 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eae906-eb26-4d46-908a-39d72047a06b admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:32.727365 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eae906-eb26-4d46-908a-39d72047a06b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:32.732377 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eae906-eb26-4d46-908a-39d72047a06b admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:32.735816 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:32.748283 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 974/1940] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:32 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 29 02:12:32.752940 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eae906-eb26-4d46-908a-39d72047a06b admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:32.755694 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395a732f-1f9c-4ce9-8dd4-d90481d7260e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:32.757234 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395a732f-1f9c-4ce9-8dd4-d90481d7260e service cinder] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:32.768759 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eae906-eb26-4d46-908a-39d72047a06b admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:32.768885 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 967/1941] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:32 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 29 02:12:32.775127 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199eb5d2-1425-4d4d-aa58-adb6a1cf5010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:32.775994 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199eb5d2-1425-4d4d-aa58-adb6a1cf5010 admin admin] REQUEST_METHOD: `PUT` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:32.776353 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199eb5d2-1425-4d4d-aa58-adb6a1cf5010 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:32.776729 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199eb5d2-1425-4d4d-aa58-adb6a1cf5010 admin admin] PATH_INFO: `/v3/projects/298c589123ef473a82ca7ea19da531f4/users/d2ffe30e7c32415d99530eb43c20485b/roles/f157f905c9c94ccfbfb46e52d443e8f2` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:32.793661 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199eb5d2-1425-4d4d-aa58-adb6a1cf5010 admin admin] RBAC: Authorizing `identity:create_grant(project_id=298c589123ef473a82ca7ea19da531f4, user_id=d2ffe30e7c32415d99530eb43c20485b, role_id=f157f905c9c94ccfbfb46e52d443e8f2)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:32.796380 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199eb5d2-1425-4d4d-aa58-adb6a1cf5010 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:32.812681 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 975/1942] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:12:32 2022] PUT /identity/v3/projects/298c589123ef473a82ca7ea19da531f4/users/d2ffe30e7c32415d99530eb43c20485b/roles/f157f905c9c94ccfbfb46e52d443e8f2 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:12:32.823159 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901fc127-fb15-4ba4-b462-56f94fb94ce1 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:32.823480 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901fc127-fb15-4ba4-b462-56f94fb94ce1 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:32.823717 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901fc127-fb15-4ba4-b462-56f94fb94ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:32.857491 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-901fc127-fb15-4ba4-b462-56f94fb94ce1 None None] MFA Rules not processed for user `d2ffe30e7c32415d99530eb43c20485b`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:32.859050 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-901fc127-fb15-4ba4-b462-56f94fb94ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:32.929341 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:32.949383 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 968/1943] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:12:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:32.952685 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199eb5d2-1425-4d4d-aa58-adb6a1cf5010 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:33.042419 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199eb5d2-1425-4d4d-aa58-adb6a1cf5010 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:33.057376 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b358605-e7a5-434d-aaa9-4d8a78174d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:33.058016 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b358605-e7a5-434d-aaa9-4d8a78174d75 admin admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:33.058340 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b358605-e7a5-434d-aaa9-4d8a78174d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:33.058617 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b358605-e7a5-434d-aaa9-4d8a78174d75 admin admin] PATH_INFO: `/v3/projects` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:33.060185 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b358605-e7a5-434d-aaa9-4d8a78174d75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:33.062605 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b358605-e7a5-434d-aaa9-4d8a78174d75 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:33.098324 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 976/1944] 10.222.0.49 () {60 vars in 1153 bytes} [Thu Sep 29 02:12:32 2022] POST /identity/v3/projects => generated 383 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 29 02:12:33.100832 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901fc127-fb15-4ba4-b462-56f94fb94ce1 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:33.124523 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901fc127-fb15-4ba4-b462-56f94fb94ce1 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:33.243856 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0095b043-ec5c-4341-b825-041f63b96474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:33.244554 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0095b043-ec5c-4341-b825-041f63b96474 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:33.245043 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0095b043-ec5c-4341-b825-041f63b96474 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:33.245452 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0095b043-ec5c-4341-b825-041f63b96474 admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:33.246172 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0095b043-ec5c-4341-b825-041f63b96474 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:33.248084 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0095b043-ec5c-4341-b825-041f63b96474 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:33.274891 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 969/1945] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 02:12:33 2022] POST /identity/v3/users => generated 292 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:33.275846 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b358605-e7a5-434d-aaa9-4d8a78174d75 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:33.287565 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b358605-e7a5-434d-aaa9-4d8a78174d75 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:33.292313 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a917539c-f728-4786-b97e-f9a47429c17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:33.292918 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a917539c-f728-4786-b97e-f9a47429c17e admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:33.293192 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a917539c-f728-4786-b97e-f9a47429c17e admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:33.293491 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a917539c-f728-4786-b97e-f9a47429c17e admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:33.294130 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a917539c-f728-4786-b97e-f9a47429c17e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:33.295713 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a917539c-f728-4786-b97e-f9a47429c17e admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:33.306723 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 977/1946] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 29 02:12:33.310904 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0095b043-ec5c-4341-b825-041f63b96474 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:33.334873 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0095b043-ec5c-4341-b825-041f63b96474 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:33.346326 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7c8aa9-59b7-4b72-9b00-b87222935a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:33.346967 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c8aa9-59b7-4b72-9b00-b87222935a37 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:33.347294 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c8aa9-59b7-4b72-9b00-b87222935a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:33.347569 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c8aa9-59b7-4b72-9b00-b87222935a37 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:33.348209 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7c8aa9-59b7-4b72-9b00-b87222935a37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:33.349830 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7c8aa9-59b7-4b72-9b00-b87222935a37 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:33.360197 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 970/1947] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:33 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:33.364522 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a917539c-f728-4786-b97e-f9a47429c17e admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:33.376025 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a917539c-f728-4786-b97e-f9a47429c17e admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:33.380692 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d763567-6d35-4257-b3ab-4a1cb225a163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:33.381370 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d763567-6d35-4257-b3ab-4a1cb225a163 admin admin] REQUEST_METHOD: `PUT` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:33.381652 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d763567-6d35-4257-b3ab-4a1cb225a163 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:33.381923 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d763567-6d35-4257-b3ab-4a1cb225a163 admin admin] PATH_INFO: `/v3/projects/e58341d535af494b8049022421956e7d/users/95f02ee1aefb4775ab62ea453540a98c/roles/f157f905c9c94ccfbfb46e52d443e8f2` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:33.397214 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d763567-6d35-4257-b3ab-4a1cb225a163 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e58341d535af494b8049022421956e7d, user_id=95f02ee1aefb4775ab62ea453540a98c, role_id=f157f905c9c94ccfbfb46e52d443e8f2)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:33.401000 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d763567-6d35-4257-b3ab-4a1cb225a163 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:33.413687 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 978/1948] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:12:33 2022] PUT /identity/v3/projects/e58341d535af494b8049022421956e7d/users/95f02ee1aefb4775ab62ea453540a98c/roles/f157f905c9c94ccfbfb46e52d443e8f2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:33.424744 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c09e63-2bac-4ff1-b3d3-98cc67e53b13 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:33.425213 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c09e63-2bac-4ff1-b3d3-98cc67e53b13 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:33.425304 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c09e63-2bac-4ff1-b3d3-98cc67e53b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:33.453112 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-c9c09e63-2bac-4ff1-b3d3-98cc67e53b13 None None] MFA Rules not processed for user `95f02ee1aefb4775ab62ea453540a98c`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:33.454361 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-c9c09e63-2bac-4ff1-b3d3-98cc67e53b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:33.519804 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 971/1949] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:12:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:33.525575 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d763567-6d35-4257-b3ab-4a1cb225a163 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:33.588949 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d763567-6d35-4257-b3ab-4a1cb225a163 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:33.593583 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39acf13f-8aea-4e33-bfb2-2a158088fdf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:33.594185 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39acf13f-8aea-4e33-bfb2-2a158088fdf3 admin admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:33.594463 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39acf13f-8aea-4e33-bfb2-2a158088fdf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:33.594732 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39acf13f-8aea-4e33-bfb2-2a158088fdf3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:33.595358 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39acf13f-8aea-4e33-bfb2-2a158088fdf3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:33.597266 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39acf13f-8aea-4e33-bfb2-2a158088fdf3 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:33.629084 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 979/1950] 10.222.0.49 () {60 vars in 1153 bytes} [Thu Sep 29 02:12:33 2022] POST /identity/v3/projects => generated 385 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:33.630721 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c09e63-2bac-4ff1-b3d3-98cc67e53b13 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:33.645228 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c09e63-2bac-4ff1-b3d3-98cc67e53b13 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:33.706477 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:33.713815 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2577dc7b-0185-4579-8475-c0e357de4218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:33.714595 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577dc7b-0185-4579-8475-c0e357de4218 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:33.714869 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577dc7b-0185-4579-8475-c0e357de4218 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:33.715172 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577dc7b-0185-4579-8475-c0e357de4218 admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:33.715826 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2577dc7b-0185-4579-8475-c0e357de4218 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:33.717923 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2577dc7b-0185-4579-8475-c0e357de4218 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:33.745526 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 972/1951] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 02:12:33 2022] POST /identity/v3/users => generated 299 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 29 02:12:33.745999 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39acf13f-8aea-4e33-bfb2-2a158088fdf3 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:33.759163 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39acf13f-8aea-4e33-bfb2-2a158088fdf3 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:33.764099 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5be2c9-4514-414e-a2ca-1c4499efdfb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:33.764736 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5be2c9-4514-414e-a2ca-1c4499efdfb3 admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:33.765016 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5be2c9-4514-414e-a2ca-1c4499efdfb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:33.765286 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5be2c9-4514-414e-a2ca-1c4499efdfb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:33.765960 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5be2c9-4514-414e-a2ca-1c4499efdfb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:33.767784 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5be2c9-4514-414e-a2ca-1c4499efdfb3 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:33.770112 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:33.781612 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 980/1952] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:33 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:33.786137 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2577dc7b-0185-4579-8475-c0e357de4218 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:33.797144 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2577dc7b-0185-4579-8475-c0e357de4218 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:33.802630 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68822de9-901d-4737-a4b0-3388f26b6666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:33.803331 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68822de9-901d-4737-a4b0-3388f26b6666 admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:33.803628 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68822de9-901d-4737-a4b0-3388f26b6666 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:33.803926 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68822de9-901d-4737-a4b0-3388f26b6666 admin admin] PATH_INFO: `/v3/projects/708491115cd0466898f1b8b050251e69/users/587efdbefc444a799cb9c0e1e90f7b2b/roles/fe9bbc67742f4f5893f39b18eb31d59a` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:33.822131 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68822de9-901d-4737-a4b0-3388f26b6666 admin admin] RBAC: Authorizing `identity:create_grant(project_id=708491115cd0466898f1b8b050251e69, user_id=587efdbefc444a799cb9c0e1e90f7b2b, role_id=fe9bbc67742f4f5893f39b18eb31d59a)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:33.824830 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68822de9-901d-4737-a4b0-3388f26b6666 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:33.839493 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 973/1953] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:12:33 2022] PUT /identity/v3/projects/708491115cd0466898f1b8b050251e69/users/587efdbefc444a799cb9c0e1e90f7b2b/roles/fe9bbc67742f4f5893f39b18eb31d59a => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:12:33.843395 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5be2c9-4514-414e-a2ca-1c4499efdfb3 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:33.855639 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5be2c9-4514-414e-a2ca-1c4499efdfb3 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:33.923952 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b5ae3a-966f-4dbb-992a-90718d9632c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:33.924663 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b5ae3a-966f-4dbb-992a-90718d9632c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:33.925015 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b5ae3a-966f-4dbb-992a-90718d9632c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:33.925395 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b5ae3a-966f-4dbb-992a-90718d9632c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:33.926255 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b5ae3a-966f-4dbb-992a-90718d9632c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:33.928058 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b5ae3a-966f-4dbb-992a-90718d9632c8 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:33.939430 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 981/1954] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:33 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:33.946694 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68822de9-901d-4737-a4b0-3388f26b6666 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:33.957426 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68822de9-901d-4737-a4b0-3388f26b6666 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:33.963040 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8031ef80-2d4a-44b8-9204-7a9573b51f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:33.963770 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8031ef80-2d4a-44b8-9204-7a9573b51f3a admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:33.964140 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8031ef80-2d4a-44b8-9204-7a9573b51f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:33.964479 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8031ef80-2d4a-44b8-9204-7a9573b51f3a admin admin] PATH_INFO: `/v3/projects/708491115cd0466898f1b8b050251e69/users/587efdbefc444a799cb9c0e1e90f7b2b/roles/fe9bbc67742f4f5893f39b18eb31d59a` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:33.966611 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8031ef80-2d4a-44b8-9204-7a9573b51f3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=708491115cd0466898f1b8b050251e69, user_id=587efdbefc444a799cb9c0e1e90f7b2b, role_id=fe9bbc67742f4f5893f39b18eb31d59a)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:33.969321 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8031ef80-2d4a-44b8-9204-7a9573b51f3a admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:33.980394 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 974/1955] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:12:33 2022] PUT /identity/v3/projects/708491115cd0466898f1b8b050251e69/users/587efdbefc444a799cb9c0e1e90f7b2b/roles/fe9bbc67742f4f5893f39b18eb31d59a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:33.990533 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48e3c06-5d68-4190-aeb1-fde2a6e05bf9 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:33.990829 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48e3c06-5d68-4190-aeb1-fde2a6e05bf9 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:33.991104 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48e3c06-5d68-4190-aeb1-fde2a6e05bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:34.044604 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-e48e3c06-5d68-4190-aeb1-fde2a6e05bf9 None None] MFA Rules not processed for user `587efdbefc444a799cb9c0e1e90f7b2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:34.046257 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-e48e3c06-5d68-4190-aeb1-fde2a6e05bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:34.139985 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 982/1956] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:12:33 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:34.152199 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8031ef80-2d4a-44b8-9204-7a9573b51f3a admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:34.257276 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8031ef80-2d4a-44b8-9204-7a9573b51f3a admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:34.261967 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bff563-5e54-4765-9b76-72d365b5db27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75135b856134ba4b9ccac337886f682', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:34.262586 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bff563-5e54-4765-9b76-72d365b5db27 service cinder] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:34.262922 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bff563-5e54-4765-9b76-72d365b5db27 service cinder] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:34.263315 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bff563-5e54-4765-9b76-72d365b5db27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:34.334231 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bff563-5e54-4765-9b76-72d365b5db27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:34.335837 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bff563-5e54-4765-9b76-72d365b5db27 service cinder] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:34.345783 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 975/1957] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:34 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:12:34.803375 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48e3c06-5d68-4190-aeb1-fde2a6e05bf9 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:34.805969 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-e48e3c06-5d68-4190-aeb1-fde2a6e05bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:34.876510 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48e3c06-5d68-4190-aeb1-fde2a6e05bf9 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:34.884648 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd8f93a-9b50-4bdd-9a70-565fd2ac0b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:34.885341 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd8f93a-9b50-4bdd-9a70-565fd2ac0b03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:34.885624 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd8f93a-9b50-4bdd-9a70-565fd2ac0b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:34.885896 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd8f93a-9b50-4bdd-9a70-565fd2ac0b03 admin admin] PATH_INFO: `/v3/users/ea1ec9394bd048949350e07b17689b18` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:34.887050 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd8f93a-9b50-4bdd-9a70-565fd2ac0b03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea1ec9394bd048949350e07b17689b18)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:34.888972 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd8f93a-9b50-4bdd-9a70-565fd2ac0b03 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:34.914561 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:34.951607 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-8bd8f93a-9b50-4bdd-9a70-565fd2ac0b03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea1ec9394bd048949350e07b17689b18'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:34.952433 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-8bd8f93a-9b50-4bdd-9a70-565fd2ac0b03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea1ec9394bd048949350e07b17689b18'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:34.974245 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-8bd8f93a-9b50-4bdd-9a70-565fd2ac0b03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea1ec9394bd048949350e07b17689b18'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:34.987417 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-8bd8f93a-9b50-4bdd-9a70-565fd2ac0b03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea1ec9394bd048949350e07b17689b18'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:34.988590 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-8bd8f93a-9b50-4bdd-9a70-565fd2ac0b03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea1ec9394bd048949350e07b17689b18'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:35.012066 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 983/1958] 10.222.0.49 () {58 vars in 1224 bytes} [Thu Sep 29 02:12:34 2022] DELETE /identity/v3/users/ea1ec9394bd048949350e07b17689b18 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:35.014048 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d570e6-d74d-4966-b5ee-507e4da8eea5 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:35.014541 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d570e6-d74d-4966-b5ee-507e4da8eea5 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:35.014692 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d570e6-d74d-4966-b5ee-507e4da8eea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:35.071210 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-b2d570e6-d74d-4966-b5ee-507e4da8eea5 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:35.072722 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-b2d570e6-d74d-4966-b5ee-507e4da8eea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:35.147368 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 976/1959] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:12:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:35.158327 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd8f93a-9b50-4bdd-9a70-565fd2ac0b03 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:35.160964 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-8bd8f93a-9b50-4bdd-9a70-565fd2ac0b03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:35.239826 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd8f93a-9b50-4bdd-9a70-565fd2ac0b03 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:35.244906 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47c5a21-4d86-4d16-8df5-95647a62cb3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:35.245740 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c5a21-4d86-4d16-8df5-95647a62cb3a service neutron] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:35.246090 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c5a21-4d86-4d16-8df5-95647a62cb3a service neutron] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:35.246356 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c5a21-4d86-4d16-8df5-95647a62cb3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:35.259003 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47c5a21-4d86-4d16-8df5-95647a62cb3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:35.263888 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47c5a21-4d86-4d16-8df5-95647a62cb3a service neutron] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:35.292494 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 984/1960] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:12:35.573433 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d570e6-d74d-4966-b5ee-507e4da8eea5 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:35.574952 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-b2d570e6-d74d-4966-b5ee-507e4da8eea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:35.590626 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:35.599459 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d570e6-d74d-4966-b5ee-507e4da8eea5 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:35.613018 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba07593a-f9fd-4a03-9a4a-44fedfee20d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:35.613707 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba07593a-f9fd-4a03-9a4a-44fedfee20d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:35.613984 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba07593a-f9fd-4a03-9a4a-44fedfee20d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:35.614249 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba07593a-f9fd-4a03-9a4a-44fedfee20d3 admin admin] PATH_INFO: `/v3/projects/178beb90fee4480f9e34665beb71cf3d` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:35.615421 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba07593a-f9fd-4a03-9a4a-44fedfee20d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=178beb90fee4480f9e34665beb71cf3d)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:35.617462 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba07593a-f9fd-4a03-9a4a-44fedfee20d3 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:35.669459 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-ba07593a-f9fd-4a03-9a4a-44fedfee20d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '178beb90fee4480f9e34665beb71cf3d', 'request_id': 'req-ba07593a-f9fd-4a03-9a4a-44fedfee20d3'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:35.676360 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-ba07593a-f9fd-4a03-9a4a-44fedfee20d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '178beb90fee4480f9e34665beb71cf3d', 'request_id': 'req-ba07593a-f9fd-4a03-9a4a-44fedfee20d3'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:35.684016 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-ba07593a-f9fd-4a03-9a4a-44fedfee20d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '178beb90fee4480f9e34665beb71cf3d', 'request_id': 'req-ba07593a-f9fd-4a03-9a4a-44fedfee20d3'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:35.696742 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-ba07593a-f9fd-4a03-9a4a-44fedfee20d3 admin admin] The token cache is being invalidate because project 178beb90fee4480f9e34665beb71cf3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81649) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:12:35.697085 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-ba07593a-f9fd-4a03-9a4a-44fedfee20d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:35.697959 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-ba07593a-f9fd-4a03-9a4a-44fedfee20d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:35.699551 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 977/1961] 10.222.0.49 () {58 vars in 1233 bytes} [Thu Sep 29 02:12:35 2022] DELETE /identity/v3/projects/178beb90fee4480f9e34665beb71cf3d => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:35.703653 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47c5a21-4d86-4d16-8df5-95647a62cb3a service neutron] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:35.715141 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47c5a21-4d86-4d16-8df5-95647a62cb3a service neutron] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:35.794881 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf0d8fc-07d6-421d-bda1-0a3a3378ae4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:35.795802 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf0d8fc-07d6-421d-bda1-0a3a3378ae4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:35.796204 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf0d8fc-07d6-421d-bda1-0a3a3378ae4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:35.796590 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf0d8fc-07d6-421d-bda1-0a3a3378ae4b admin admin] PATH_INFO: `/v3/users/89d7266589034648838eb80a62af64d8` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:35.798866 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf0d8fc-07d6-421d-bda1-0a3a3378ae4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=89d7266589034648838eb80a62af64d8)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:35.802978 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf0d8fc-07d6-421d-bda1-0a3a3378ae4b admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:35.903190 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:35.908482 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-aaf0d8fc-07d6-421d-bda1-0a3a3378ae4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89d7266589034648838eb80a62af64d8'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:35.909404 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-aaf0d8fc-07d6-421d-bda1-0a3a3378ae4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89d7266589034648838eb80a62af64d8'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:35.931573 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-aaf0d8fc-07d6-421d-bda1-0a3a3378ae4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89d7266589034648838eb80a62af64d8'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:35.952157 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-aaf0d8fc-07d6-421d-bda1-0a3a3378ae4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89d7266589034648838eb80a62af64d8'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:35.952881 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-aaf0d8fc-07d6-421d-bda1-0a3a3378ae4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89d7266589034648838eb80a62af64d8'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:35.970599 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 985/1962] 10.222.0.49 () {58 vars in 1224 bytes} [Thu Sep 29 02:12:35 2022] DELETE /identity/v3/users/89d7266589034648838eb80a62af64d8 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:36.097081 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba07593a-f9fd-4a03-9a4a-44fedfee20d3 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:36.098607 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-ba07593a-f9fd-4a03-9a4a-44fedfee20d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:36.159072 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba07593a-f9fd-4a03-9a4a-44fedfee20d3 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:36.217659 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d26e0a4-826d-488f-a476-cd3d20d4d053 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75135b856134ba4b9ccac337886f682', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:36.218215 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d26e0a4-826d-488f-a476-cd3d20d4d053 service cinder] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:36.218494 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d26e0a4-826d-488f-a476-cd3d20d4d053 service cinder] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:36.218766 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d26e0a4-826d-488f-a476-cd3d20d4d053 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:36.220700 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-5d26e0a4-826d-488f-a476-cd3d20d4d053 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:36.297591 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d26e0a4-826d-488f-a476-cd3d20d4d053 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:36.299324 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d26e0a4-826d-488f-a476-cd3d20d4d053 service cinder] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:36.303679 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:36.317097 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf0d8fc-07d6-421d-bda1-0a3a3378ae4b admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:36.318946 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-aaf0d8fc-07d6-421d-bda1-0a3a3378ae4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:36.321734 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 978/1963] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:36 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:12:36.406089 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf0d8fc-07d6-421d-bda1-0a3a3378ae4b admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:36.411224 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c387a2d7-3bec-473e-a8c5-d9941b5686d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:36.411857 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c387a2d7-3bec-473e-a8c5-d9941b5686d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:36.412131 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c387a2d7-3bec-473e-a8c5-d9941b5686d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:36.412399 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c387a2d7-3bec-473e-a8c5-d9941b5686d4 admin admin] PATH_INFO: `/v3/projects/4bedff2b4b4f48739d4ff78831ce1f1a` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:36.413552 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c387a2d7-3bec-473e-a8c5-d9941b5686d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bedff2b4b4f48739d4ff78831ce1f1a)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:36.416021 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c387a2d7-3bec-473e-a8c5-d9941b5686d4 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:36.472385 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-c387a2d7-3bec-473e-a8c5-d9941b5686d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bedff2b4b4f48739d4ff78831ce1f1a', 'request_id': 'req-c387a2d7-3bec-473e-a8c5-d9941b5686d4'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:36.485954 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-c387a2d7-3bec-473e-a8c5-d9941b5686d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bedff2b4b4f48739d4ff78831ce1f1a', 'request_id': 'req-c387a2d7-3bec-473e-a8c5-d9941b5686d4'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:36.504441 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-c387a2d7-3bec-473e-a8c5-d9941b5686d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bedff2b4b4f48739d4ff78831ce1f1a', 'request_id': 'req-c387a2d7-3bec-473e-a8c5-d9941b5686d4'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:36.520685 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-c387a2d7-3bec-473e-a8c5-d9941b5686d4 admin admin] The token cache is being invalidate because project 4bedff2b4b4f48739d4ff78831ce1f1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81648) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:12:36.520974 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-c387a2d7-3bec-473e-a8c5-d9941b5686d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:36.521677 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-c387a2d7-3bec-473e-a8c5-d9941b5686d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:36.523940 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 986/1964] 10.222.0.49 () {58 vars in 1233 bytes} [Thu Sep 29 02:12:36 2022] DELETE /identity/v3/projects/4bedff2b4b4f48739d4ff78831ce1f1a => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:12:36.529442 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9b48ee-9d1a-4174-a2ec-248a640ea4f1 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:36.529442 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9b48ee-9d1a-4174-a2ec-248a640ea4f1 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:36.529645 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9b48ee-9d1a-4174-a2ec-248a640ea4f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:36.558302 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-ff9b48ee-9d1a-4174-a2ec-248a640ea4f1 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:36.562153 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-ff9b48ee-9d1a-4174-a2ec-248a640ea4f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:36.650343 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 979/1965] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:12:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:36.658290 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a24096-e3b2-4b7b-8b6f-a4de5f8008ab None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:36.658583 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a24096-e3b2-4b7b-8b6f-a4de5f8008ab None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:36.658878 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a24096-e3b2-4b7b-8b6f-a4de5f8008ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:36.688860 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-f6a24096-e3b2-4b7b-8b6f-a4de5f8008ab None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:36.690126 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-f6a24096-e3b2-4b7b-8b6f-a4de5f8008ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:36.700242 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 987/1966] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:12:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:36.705097 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9b48ee-9d1a-4174-a2ec-248a640ea4f1 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:36.719403 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9b48ee-9d1a-4174-a2ec-248a640ea4f1 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:36.726436 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39663678-5ad5-433d-a593-062f4a511275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:36.726892 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39663678-5ad5-433d-a593-062f4a511275 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:36.727292 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39663678-5ad5-433d-a593-062f4a511275 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:36.727590 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39663678-5ad5-433d-a593-062f4a511275 admin admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:36.728293 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39663678-5ad5-433d-a593-062f4a511275 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:12:36.728592 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39663678-5ad5-433d-a593-062f4a511275 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:36.730302 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39663678-5ad5-433d-a593-062f4a511275 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:36.743343 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 980/1967] 10.222.0.49 () {58 vars in 1153 bytes} [Thu Sep 29 02:12:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:12:36.748220 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a24096-e3b2-4b7b-8b6f-a4de5f8008ab None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:36.759165 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a24096-e3b2-4b7b-8b6f-a4de5f8008ab None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:36.764718 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c82f7e-a7cf-41f5-be00-1250d20c8a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:36.765557 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c82f7e-a7cf-41f5-be00-1250d20c8a1a admin admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:36.765938 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c82f7e-a7cf-41f5-be00-1250d20c8a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:36.766304 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c82f7e-a7cf-41f5-be00-1250d20c8a1a admin admin] PATH_INFO: `/v3/projects` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:36.767011 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c82f7e-a7cf-41f5-be00-1250d20c8a1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:36.769170 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c82f7e-a7cf-41f5-be00-1250d20c8a1a admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:36.797161 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 988/1968] 10.222.0.49 () {60 vars in 1153 bytes} [Thu Sep 29 02:12:36 2022] POST /identity/v3/projects => generated 387 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:36.802020 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39663678-5ad5-433d-a593-062f4a511275 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:36.814292 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39663678-5ad5-433d-a593-062f4a511275 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:36.875624 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554340e2-ee24-407b-b568-e9f9f2dbdbcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:36.876234 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554340e2-ee24-407b-b568-e9f9f2dbdbcd admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:36.876512 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554340e2-ee24-407b-b568-e9f9f2dbdbcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:36.876789 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554340e2-ee24-407b-b568-e9f9f2dbdbcd admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:36.877452 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554340e2-ee24-407b-b568-e9f9f2dbdbcd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:36.879382 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554340e2-ee24-407b-b568-e9f9f2dbdbcd admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:36.903382 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 981/1969] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 02:12:36 2022] POST /identity/v3/users => generated 294 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 29 02:12:36.915541 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c82f7e-a7cf-41f5-be00-1250d20c8a1a admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:36.926710 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c82f7e-a7cf-41f5-be00-1250d20c8a1a admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:36.932459 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52174041-db72-468c-ac90-37380161b5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:36.933063 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52174041-db72-468c-ac90-37380161b5da admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:36.933561 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52174041-db72-468c-ac90-37380161b5da admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:36.933980 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52174041-db72-468c-ac90-37380161b5da admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:36.934620 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52174041-db72-468c-ac90-37380161b5da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:36.936438 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52174041-db72-468c-ac90-37380161b5da admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:36.948205 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 989/1970] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:36.952359 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554340e2-ee24-407b-b568-e9f9f2dbdbcd admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:36.964258 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554340e2-ee24-407b-b568-e9f9f2dbdbcd admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:36.970895 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52174041-db72-468c-ac90-37380161b5da admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:36.972862 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-52174041-db72-468c-ac90-37380161b5da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:36.973265 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba09c215-5b05-482f-8605-1a53235be7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:36.973904 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba09c215-5b05-482f-8605-1a53235be7b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:36.974223 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba09c215-5b05-482f-8605-1a53235be7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:36.974494 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba09c215-5b05-482f-8605-1a53235be7b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:36.975132 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba09c215-5b05-482f-8605-1a53235be7b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:36.977477 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba09c215-5b05-482f-8605-1a53235be7b1 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:36.988674 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:DELETE=11,keystone:SELECT=86,keystone:INSERT=3 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:36.989351 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 982/1971] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:36 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 29 02:12:36.994390 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba09c215-5b05-482f-8605-1a53235be7b1 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:37.004617 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba09c215-5b05-482f-8605-1a53235be7b1 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:37.009944 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a690e0c-81b8-47d6-aa32-5214999da3d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:37.010601 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a690e0c-81b8-47d6-aa32-5214999da3d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:37.010883 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a690e0c-81b8-47d6-aa32-5214999da3d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:37.011342 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a690e0c-81b8-47d6-aa32-5214999da3d4 admin admin] PATH_INFO: `/v3/projects/391d77bc62294774adf2d5f5626f7922/users/0c95789caa404545ab40edc29f8e2596/roles/f157f905c9c94ccfbfb46e52d443e8f2` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:37.036609 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a690e0c-81b8-47d6-aa32-5214999da3d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=391d77bc62294774adf2d5f5626f7922, user_id=0c95789caa404545ab40edc29f8e2596, role_id=f157f905c9c94ccfbfb46e52d443e8f2)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:37.040078 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a690e0c-81b8-47d6-aa32-5214999da3d4 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:37.079016 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52174041-db72-468c-ac90-37380161b5da admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:37.087518 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 983/1972] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:12:36 2022] PUT /identity/v3/projects/391d77bc62294774adf2d5f5626f7922/users/0c95789caa404545ab40edc29f8e2596/roles/f157f905c9c94ccfbfb46e52d443e8f2 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:37.097341 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ba5adc-335f-4b33-9f51-86c28c390242 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:37.103362 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ba5adc-335f-4b33-9f51-86c28c390242 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:37.103696 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ba5adc-335f-4b33-9f51-86c28c390242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:37.203611 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-c8ba5adc-335f-4b33-9f51-86c28c390242 None None] MFA Rules not processed for user `0c95789caa404545ab40edc29f8e2596`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:37.208720 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb1ee8b-c707-44d7-9e73-65da8183b75a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75135b856134ba4b9ccac337886f682', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:37.209707 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb1ee8b-c707-44d7-9e73-65da8183b75a service cinder] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:37.209925 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-c8ba5adc-335f-4b33-9f51-86c28c390242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:37.210220 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb1ee8b-c707-44d7-9e73-65da8183b75a service cinder] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:37.210927 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb1ee8b-c707-44d7-9e73-65da8183b75a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:37.218176 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-ebb1ee8b-c707-44d7-9e73-65da8183b75a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:37.267095 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:37.332525 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 984/1973] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:12:37 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:37.338058 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ba5adc-335f-4b33-9f51-86c28c390242 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:37.423927 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb1ee8b-c707-44d7-9e73-65da8183b75a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:37.425800 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb1ee8b-c707-44d7-9e73-65da8183b75a service cinder] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:37.451831 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 990/1974] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:36 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 29 02:12:37.455629 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ba5adc-335f-4b33-9f51-86c28c390242 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:37.463170 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db00a10-5c96-46a7-97a0-c7e1da4639aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:37.464589 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db00a10-5c96-46a7-97a0-c7e1da4639aa admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:37.464832 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db00a10-5c96-46a7-97a0-c7e1da4639aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:37.465608 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db00a10-5c96-46a7-97a0-c7e1da4639aa admin admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:37.465895 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db00a10-5c96-46a7-97a0-c7e1da4639aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:37.468851 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db00a10-5c96-46a7-97a0-c7e1da4639aa admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:37.521332 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 985/1975] 10.222.0.49 () {60 vars in 1153 bytes} [Thu Sep 29 02:12:37 2022] POST /identity/v3/projects => generated 387 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:37.524971 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb1ee8b-c707-44d7-9e73-65da8183b75a service cinder] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:37.548885 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb1ee8b-c707-44d7-9e73-65da8183b75a service cinder] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:37.660422 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d5f336-2c43-4fa7-854e-ac0f29030032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:37.661502 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d5f336-2c43-4fa7-854e-ac0f29030032 admin admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:37.662131 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d5f336-2c43-4fa7-854e-ac0f29030032 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:37.662788 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d5f336-2c43-4fa7-854e-ac0f29030032 admin admin] PATH_INFO: `/v3/users` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:37.663747 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d5f336-2c43-4fa7-854e-ac0f29030032 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:37.666283 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d5f336-2c43-4fa7-854e-ac0f29030032 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:37.727382 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 991/1976] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 02:12:37 2022] POST /identity/v3/users => generated 300 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:37.728639 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db00a10-5c96-46a7-97a0-c7e1da4639aa admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:37.743763 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db00a10-5c96-46a7-97a0-c7e1da4639aa admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:37.766161 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187bbd86-b1ef-4945-b970-57728b47dc17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:37.766800 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187bbd86-b1ef-4945-b970-57728b47dc17 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:37.767087 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187bbd86-b1ef-4945-b970-57728b47dc17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:37.767360 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187bbd86-b1ef-4945-b970-57728b47dc17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:37.768025 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187bbd86-b1ef-4945-b970-57728b47dc17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:37.779255 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187bbd86-b1ef-4945-b970-57728b47dc17 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:37.803679 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 986/1977] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:37 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:37.808625 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d5f336-2c43-4fa7-854e-ac0f29030032 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:37.821213 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d5f336-2c43-4fa7-854e-ac0f29030032 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:37.827082 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f016c8c1-33e8-40b1-aabb-68b5ef937f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:37.827760 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f016c8c1-33e8-40b1-aabb-68b5ef937f2c admin admin] REQUEST_METHOD: `PUT` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:37.828910 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f016c8c1-33e8-40b1-aabb-68b5ef937f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:37.829213 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f016c8c1-33e8-40b1-aabb-68b5ef937f2c admin admin] PATH_INFO: `/v3/projects/496f2eda2d3543c3bfa1c81f4c4b74f4/users/0242c77055874c23bd37d0b2c482c9f3/roles/fe9bbc67742f4f5893f39b18eb31d59a` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:37.833206 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:37.858931 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f016c8c1-33e8-40b1-aabb-68b5ef937f2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=496f2eda2d3543c3bfa1c81f4c4b74f4, user_id=0242c77055874c23bd37d0b2c482c9f3, role_id=fe9bbc67742f4f5893f39b18eb31d59a)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:37.861718 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f016c8c1-33e8-40b1-aabb-68b5ef937f2c admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:37.884056 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 992/1978] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:12:37 2022] PUT /identity/v3/projects/496f2eda2d3543c3bfa1c81f4c4b74f4/users/0242c77055874c23bd37d0b2c482c9f3/roles/fe9bbc67742f4f5893f39b18eb31d59a => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:37.889462 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187bbd86-b1ef-4945-b970-57728b47dc17 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:37.921265 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187bbd86-b1ef-4945-b970-57728b47dc17 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:37.995819 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a52d2f1-ffc9-4dc2-976a-1e96edce0eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:37.996468 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a52d2f1-ffc9-4dc2-976a-1e96edce0eea admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:37.996782 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a52d2f1-ffc9-4dc2-976a-1e96edce0eea admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:37.997088 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a52d2f1-ffc9-4dc2-976a-1e96edce0eea admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:37.997832 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a52d2f1-ffc9-4dc2-976a-1e96edce0eea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:37.999914 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a52d2f1-ffc9-4dc2-976a-1e96edce0eea admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:38.017520 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 987/1979] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:37 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:38.018644 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f016c8c1-33e8-40b1-aabb-68b5ef937f2c admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:38.033692 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f016c8c1-33e8-40b1-aabb-68b5ef937f2c admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:38.041561 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3722bc34-e2da-4cf4-827e-db53bdd9448d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:38.042512 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3722bc34-e2da-4cf4-827e-db53bdd9448d admin admin] REQUEST_METHOD: `PUT` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:38.042970 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3722bc34-e2da-4cf4-827e-db53bdd9448d admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:38.043404 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3722bc34-e2da-4cf4-827e-db53bdd9448d admin admin] PATH_INFO: `/v3/projects/496f2eda2d3543c3bfa1c81f4c4b74f4/users/0242c77055874c23bd37d0b2c482c9f3/roles/fe9bbc67742f4f5893f39b18eb31d59a` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:38.046989 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3722bc34-e2da-4cf4-827e-db53bdd9448d admin admin] RBAC: Authorizing `identity:create_grant(project_id=496f2eda2d3543c3bfa1c81f4c4b74f4, user_id=0242c77055874c23bd37d0b2c482c9f3, role_id=fe9bbc67742f4f5893f39b18eb31d59a)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:38.053645 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3722bc34-e2da-4cf4-827e-db53bdd9448d admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:38.081647 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 993/1980] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:12:38 2022] PUT /identity/v3/projects/496f2eda2d3543c3bfa1c81f4c4b74f4/users/0242c77055874c23bd37d0b2c482c9f3/roles/fe9bbc67742f4f5893f39b18eb31d59a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:38.083751 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e094dbc-2851-4906-8e74-7752bebe107f None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:38.084105 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e094dbc-2851-4906-8e74-7752bebe107f None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:38.084446 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e094dbc-2851-4906-8e74-7752bebe107f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:38.129586 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-5e094dbc-2851-4906-8e74-7752bebe107f None None] MFA Rules not processed for user `0242c77055874c23bd37d0b2c482c9f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:38.133821 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-5e094dbc-2851-4906-8e74-7752bebe107f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:38.174389 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:38.226548 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 988/1981] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:12:38 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:38.234797 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3722bc34-e2da-4cf4-827e-db53bdd9448d admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:38.303142 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3722bc34-e2da-4cf4-827e-db53bdd9448d admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:38.307111 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320666a2-16e8-4c8c-a1f3-742752a97b29 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75135b856134ba4b9ccac337886f682', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:38.307728 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320666a2-16e8-4c8c-a1f3-742752a97b29 service cinder] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:38.308074 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320666a2-16e8-4c8c-a1f3-742752a97b29 service cinder] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:38.308353 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320666a2-16e8-4c8c-a1f3-742752a97b29 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:38.322405 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320666a2-16e8-4c8c-a1f3-742752a97b29 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:38.323817 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320666a2-16e8-4c8c-a1f3-742752a97b29 service cinder] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:38.333346 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 994/1982] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:38 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:12:38.620599 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e094dbc-2851-4906-8e74-7752bebe107f None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:38.622110 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-5e094dbc-2851-4906-8e74-7752bebe107f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:38.732918 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e094dbc-2851-4906-8e74-7752bebe107f None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:38.738365 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db73d6c4-fea4-41aa-bc9a-0b7abba02504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:38.739042 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db73d6c4-fea4-41aa-bc9a-0b7abba02504 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:38.739353 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db73d6c4-fea4-41aa-bc9a-0b7abba02504 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:38.745853 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db73d6c4-fea4-41aa-bc9a-0b7abba02504 admin admin] PATH_INFO: `/v3/users/3dcfc962512748e692ffae884df16e93` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:38.747264 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db73d6c4-fea4-41aa-bc9a-0b7abba02504 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3dcfc962512748e692ffae884df16e93)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:38.749458 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db73d6c4-fea4-41aa-bc9a-0b7abba02504 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:38.829075 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-db73d6c4-fea4-41aa-bc9a-0b7abba02504 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3dcfc962512748e692ffae884df16e93'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:38.830640 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-db73d6c4-fea4-41aa-bc9a-0b7abba02504 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3dcfc962512748e692ffae884df16e93'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:38.848148 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-db73d6c4-fea4-41aa-bc9a-0b7abba02504 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3dcfc962512748e692ffae884df16e93'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:38.859544 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-db73d6c4-fea4-41aa-bc9a-0b7abba02504 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3dcfc962512748e692ffae884df16e93'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:38.860724 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-db73d6c4-fea4-41aa-bc9a-0b7abba02504 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3dcfc962512748e692ffae884df16e93'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:38.882031 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 989/1983] 10.222.0.49 () {58 vars in 1224 bytes} [Thu Sep 29 02:12:38 2022] DELETE /identity/v3/users/3dcfc962512748e692ffae884df16e93 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:38.886935 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1862ec21-85eb-4b50-82e1-57bf05dbe085 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:38.887469 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1862ec21-85eb-4b50-82e1-57bf05dbe085 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:38.887859 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1862ec21-85eb-4b50-82e1-57bf05dbe085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:38.930676 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-1862ec21-85eb-4b50-82e1-57bf05dbe085 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:38.932075 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-1862ec21-85eb-4b50-82e1-57bf05dbe085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:39.060309 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 995/1984] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:12:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:39.069814 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db73d6c4-fea4-41aa-bc9a-0b7abba02504 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:39.071796 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-db73d6c4-fea4-41aa-bc9a-0b7abba02504 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:39.076770 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1862ec21-85eb-4b50-82e1-57bf05dbe085 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:39.078407 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-1862ec21-85eb-4b50-82e1-57bf05dbe085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:39.096742 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1862ec21-85eb-4b50-82e1-57bf05dbe085 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:39.103124 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87bb1c1-d8e1-42d7-9c83-686aa57aa4a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:39.104176 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87bb1c1-d8e1-42d7-9c83-686aa57aa4a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:39.104657 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87bb1c1-d8e1-42d7-9c83-686aa57aa4a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:39.105068 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87bb1c1-d8e1-42d7-9c83-686aa57aa4a2 admin admin] PATH_INFO: `/v3/users/0c95789caa404545ab40edc29f8e2596` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:39.106936 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87bb1c1-d8e1-42d7-9c83-686aa57aa4a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c95789caa404545ab40edc29f8e2596)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:39.109120 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87bb1c1-d8e1-42d7-9c83-686aa57aa4a2 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:39.207862 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-e87bb1c1-d8e1-42d7-9c83-686aa57aa4a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c95789caa404545ab40edc29f8e2596'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:39.209045 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-e87bb1c1-d8e1-42d7-9c83-686aa57aa4a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c95789caa404545ab40edc29f8e2596'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:39.234498 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:39.243543 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-e87bb1c1-d8e1-42d7-9c83-686aa57aa4a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c95789caa404545ab40edc29f8e2596'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:39.251482 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:39.262163 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-e87bb1c1-d8e1-42d7-9c83-686aa57aa4a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c95789caa404545ab40edc29f8e2596'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:39.264253 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-e87bb1c1-d8e1-42d7-9c83-686aa57aa4a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c95789caa404545ab40edc29f8e2596'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:39.273557 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db73d6c4-fea4-41aa-bc9a-0b7abba02504 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:39.287463 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9a1398-4d10-4330-b662-4f32065a49da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:39.289644 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a1398-4d10-4330-b662-4f32065a49da service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:39.289928 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a1398-4d10-4330-b662-4f32065a49da service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:39.290202 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a1398-4d10-4330-b662-4f32065a49da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:39.300012 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-de9a1398-4d10-4330-b662-4f32065a49da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:39.300342 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 996/1985] 10.222.0.49 () {58 vars in 1224 bytes} [Thu Sep 29 02:12:39 2022] DELETE /identity/v3/users/0c95789caa404545ab40edc29f8e2596 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:12:39.318187 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94755c99-6a79-408a-8bd1-6a72e87accdb None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:39.318187 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94755c99-6a79-408a-8bd1-6a72e87accdb None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:39.318187 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94755c99-6a79-408a-8bd1-6a72e87accdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:39.335218 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9a1398-4d10-4330-b662-4f32065a49da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:39.337502 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9a1398-4d10-4330-b662-4f32065a49da service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:39.356634 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 990/1986] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:12:39.360211 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-94755c99-6a79-408a-8bd1-6a72e87accdb None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:39.361645 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-94755c99-6a79-408a-8bd1-6a72e87accdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:39.439672 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 997/1987] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:12:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:39.461033 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9a1398-4d10-4330-b662-4f32065a49da service neutron] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:39.462543 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-de9a1398-4d10-4330-b662-4f32065a49da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:39.473657 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9a1398-4d10-4330-b662-4f32065a49da service neutron] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:39.539961 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc0f134-74be-49e5-8dee-5098699d77ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:39.540749 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc0f134-74be-49e5-8dee-5098699d77ca service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:39.541027 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc0f134-74be-49e5-8dee-5098699d77ca service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:39.541294 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc0f134-74be-49e5-8dee-5098699d77ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:39.551943 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc0f134-74be-49e5-8dee-5098699d77ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:39.553406 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc0f134-74be-49e5-8dee-5098699d77ca service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:39.564686 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 991/1988] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:12:39.817663 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94755c99-6a79-408a-8bd1-6a72e87accdb None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:39.819066 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-94755c99-6a79-408a-8bd1-6a72e87accdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:39.842970 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94755c99-6a79-408a-8bd1-6a72e87accdb None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:39.852917 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0439f92-b858-4f07-864a-b9f8bd7bb0d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:39.853612 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0439f92-b858-4f07-864a-b9f8bd7bb0d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:39.853893 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0439f92-b858-4f07-864a-b9f8bd7bb0d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:39.854164 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0439f92-b858-4f07-864a-b9f8bd7bb0d2 admin admin] PATH_INFO: `/v3/projects/7a0a8e1273c34f56bf58c30581a611fb` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:39.855398 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0439f92-b858-4f07-864a-b9f8bd7bb0d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a0a8e1273c34f56bf58c30581a611fb)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:39.857242 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0439f92-b858-4f07-864a-b9f8bd7bb0d2 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:39.919291 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-a0439f92-b858-4f07-864a-b9f8bd7bb0d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a0a8e1273c34f56bf58c30581a611fb', 'request_id': 'req-a0439f92-b858-4f07-864a-b9f8bd7bb0d2'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:39.930933 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-a0439f92-b858-4f07-864a-b9f8bd7bb0d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a0a8e1273c34f56bf58c30581a611fb', 'request_id': 'req-a0439f92-b858-4f07-864a-b9f8bd7bb0d2'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:39.945942 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-a0439f92-b858-4f07-864a-b9f8bd7bb0d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a0a8e1273c34f56bf58c30581a611fb', 'request_id': 'req-a0439f92-b858-4f07-864a-b9f8bd7bb0d2'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:39.967872 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-a0439f92-b858-4f07-864a-b9f8bd7bb0d2 admin admin] The token cache is being invalidate because project 7a0a8e1273c34f56bf58c30581a611fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81648) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:12:39.968179 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-a0439f92-b858-4f07-864a-b9f8bd7bb0d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:39.968811 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-a0439f92-b858-4f07-864a-b9f8bd7bb0d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:39.970444 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 998/1989] 10.222.0.49 () {58 vars in 1233 bytes} [Thu Sep 29 02:12:39 2022] DELETE /identity/v3/projects/7a0a8e1273c34f56bf58c30581a611fb => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:39.974990 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc0f134-74be-49e5-8dee-5098699d77ca service neutron] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:39.990178 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc0f134-74be-49e5-8dee-5098699d77ca service neutron] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:39.992178 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0439f92-b858-4f07-864a-b9f8bd7bb0d2 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:39.994290 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-a0439f92-b858-4f07-864a-b9f8bd7bb0d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:40.083735 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de72d974-61fb-499b-aad1-983e172ae435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:40.084529 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de72d974-61fb-499b-aad1-983e172ae435 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:40.085045 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de72d974-61fb-499b-aad1-983e172ae435 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:40.085546 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de72d974-61fb-499b-aad1-983e172ae435 admin admin] PATH_INFO: `/v3/users/c8a2fed140fd431ab35238348e9b905c` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:40.087376 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de72d974-61fb-499b-aad1-983e172ae435 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8a2fed140fd431ab35238348e9b905c)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:40.089542 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de72d974-61fb-499b-aad1-983e172ae435 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:40.111784 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0439f92-b858-4f07-864a-b9f8bd7bb0d2 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:40.122281 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e67115a-50eb-492f-8302-dd1433e79958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:40.126285 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e67115a-50eb-492f-8302-dd1433e79958 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:40.126285 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e67115a-50eb-492f-8302-dd1433e79958 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:40.126285 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e67115a-50eb-492f-8302-dd1433e79958 admin admin] PATH_INFO: `/v3/projects/391d77bc62294774adf2d5f5626f7922` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:40.131104 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e67115a-50eb-492f-8302-dd1433e79958 admin admin] RBAC: Authorizing `identity:delete_project(project_id=391d77bc62294774adf2d5f5626f7922)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:40.136793 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e67115a-50eb-492f-8302-dd1433e79958 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:40.151337 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:40.169493 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-de72d974-61fb-499b-aad1-983e172ae435 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8a2fed140fd431ab35238348e9b905c'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:40.169493 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-de72d974-61fb-499b-aad1-983e172ae435 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8a2fed140fd431ab35238348e9b905c'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:40.176335 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-de72d974-61fb-499b-aad1-983e172ae435 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8a2fed140fd431ab35238348e9b905c'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:40.186911 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-de72d974-61fb-499b-aad1-983e172ae435 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8a2fed140fd431ab35238348e9b905c'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:40.188669 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-de72d974-61fb-499b-aad1-983e172ae435 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8a2fed140fd431ab35238348e9b905c'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:40.204756 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 992/1990] 10.222.0.49 () {58 vars in 1224 bytes} [Thu Sep 29 02:12:39 2022] DELETE /identity/v3/users/c8a2fed140fd431ab35238348e9b905c => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:40.210011 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-1e67115a-50eb-492f-8302-dd1433e79958 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '391d77bc62294774adf2d5f5626f7922', 'request_id': 'req-1e67115a-50eb-492f-8302-dd1433e79958'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:40.218594 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-1e67115a-50eb-492f-8302-dd1433e79958 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '391d77bc62294774adf2d5f5626f7922', 'request_id': 'req-1e67115a-50eb-492f-8302-dd1433e79958'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:40.227802 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-1e67115a-50eb-492f-8302-dd1433e79958 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '391d77bc62294774adf2d5f5626f7922', 'request_id': 'req-1e67115a-50eb-492f-8302-dd1433e79958'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:40.241077 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-1e67115a-50eb-492f-8302-dd1433e79958 admin admin] The token cache is being invalidate because project 391d77bc62294774adf2d5f5626f7922 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81648) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:12:40.241663 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-1e67115a-50eb-492f-8302-dd1433e79958 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:40.242521 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-1e67115a-50eb-492f-8302-dd1433e79958 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:40.244372 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 999/1991] 10.222.0.49 () {58 vars in 1233 bytes} [Thu Sep 29 02:12:39 2022] DELETE /identity/v3/projects/391d77bc62294774adf2d5f5626f7922 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:12:40.248725 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de72d974-61fb-499b-aad1-983e172ae435 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:40.250868 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-de72d974-61fb-499b-aad1-983e172ae435 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:40.263120 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:40.326348 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de72d974-61fb-499b-aad1-983e172ae435 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:40.331466 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399a6db3-90d1-4766-834c-315de9ddd49f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:40.332201 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a6db3-90d1-4766-834c-315de9ddd49f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:40.332546 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a6db3-90d1-4766-834c-315de9ddd49f admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:40.332894 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a6db3-90d1-4766-834c-315de9ddd49f admin admin] PATH_INFO: `/v3/users/0242c77055874c23bd37d0b2c482c9f3` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:40.334161 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399a6db3-90d1-4766-834c-315de9ddd49f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0242c77055874c23bd37d0b2c482c9f3)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:40.337049 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399a6db3-90d1-4766-834c-315de9ddd49f admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:40.397431 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-399a6db3-90d1-4766-834c-315de9ddd49f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0242c77055874c23bd37d0b2c482c9f3'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:40.399066 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-399a6db3-90d1-4766-834c-315de9ddd49f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0242c77055874c23bd37d0b2c482c9f3'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:40.415058 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-399a6db3-90d1-4766-834c-315de9ddd49f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0242c77055874c23bd37d0b2c482c9f3'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:40.427888 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-399a6db3-90d1-4766-834c-315de9ddd49f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0242c77055874c23bd37d0b2c482c9f3'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:40.428615 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-399a6db3-90d1-4766-834c-315de9ddd49f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0242c77055874c23bd37d0b2c482c9f3'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:40.449653 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 993/1992] 10.222.0.49 () {58 vars in 1224 bytes} [Thu Sep 29 02:12:40 2022] DELETE /identity/v3/users/0242c77055874c23bd37d0b2c482c9f3 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:40.507060 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e67115a-50eb-492f-8302-dd1433e79958 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:40.508828 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-1e67115a-50eb-492f-8302-dd1433e79958 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:40.608153 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e67115a-50eb-492f-8302-dd1433e79958 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:40.700899 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaacb93-6edc-4308-a94b-0abe84bfce6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:40.701679 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaacb93-6edc-4308-a94b-0abe84bfce6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:40.702099 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaacb93-6edc-4308-a94b-0abe84bfce6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:40.702452 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaacb93-6edc-4308-a94b-0abe84bfce6c admin admin] PATH_INFO: `/v3/projects/d29f04e7ae684cc89c572ed305b85143` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:40.703667 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaacb93-6edc-4308-a94b-0abe84bfce6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d29f04e7ae684cc89c572ed305b85143)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:40.705980 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaacb93-6edc-4308-a94b-0abe84bfce6c admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:40.771822 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:40.774784 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-aeaacb93-6edc-4308-a94b-0abe84bfce6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd29f04e7ae684cc89c572ed305b85143', 'request_id': 'req-aeaacb93-6edc-4308-a94b-0abe84bfce6c'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:40.783932 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-aeaacb93-6edc-4308-a94b-0abe84bfce6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd29f04e7ae684cc89c572ed305b85143', 'request_id': 'req-aeaacb93-6edc-4308-a94b-0abe84bfce6c'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:40.795263 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-aeaacb93-6edc-4308-a94b-0abe84bfce6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd29f04e7ae684cc89c572ed305b85143', 'request_id': 'req-aeaacb93-6edc-4308-a94b-0abe84bfce6c'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:40.814053 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-aeaacb93-6edc-4308-a94b-0abe84bfce6c admin admin] The token cache is being invalidate because project d29f04e7ae684cc89c572ed305b85143 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81648) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:12:40.814354 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-aeaacb93-6edc-4308-a94b-0abe84bfce6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:40.815124 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-aeaacb93-6edc-4308-a94b-0abe84bfce6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:40.816732 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1000/1993] 10.222.0.49 () {58 vars in 1233 bytes} [Thu Sep 29 02:12:40 2022] DELETE /identity/v3/projects/d29f04e7ae684cc89c572ed305b85143 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:40.826336 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20497513-4a2c-498e-a585-7036d845685b None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:40.826668 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20497513-4a2c-498e-a585-7036d845685b None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:40.826956 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20497513-4a2c-498e-a585-7036d845685b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:40.852834 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-20497513-4a2c-498e-a585-7036d845685b None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:40.854104 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-20497513-4a2c-498e-a585-7036d845685b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:40.939637 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaacb93-6edc-4308-a94b-0abe84bfce6c admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:40.941565 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-aeaacb93-6edc-4308-a94b-0abe84bfce6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:40.995005 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 994/1994] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:12:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:41.005200 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15bdc2d-5307-4178-9927-0417db3e1212 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:41.006267 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15bdc2d-5307-4178-9927-0417db3e1212 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:41.006681 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15bdc2d-5307-4178-9927-0417db3e1212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:41.043737 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-b15bdc2d-5307-4178-9927-0417db3e1212 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:41.044931 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-b15bdc2d-5307-4178-9927-0417db3e1212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:41.054893 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaacb93-6edc-4308-a94b-0abe84bfce6c admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:41.057173 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 995/1995] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:12:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:41.062556 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15bdc2d-5307-4178-9927-0417db3e1212 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:41.062905 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3f7b89-ff3b-416b-9ae1-1ba5f415f363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:41.063639 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f7b89-ff3b-416b-9ae1-1ba5f415f363 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:41.063973 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f7b89-ff3b-416b-9ae1-1ba5f415f363 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:41.064309 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f7b89-ff3b-416b-9ae1-1ba5f415f363 admin admin] PATH_INFO: `/v3/projects/496f2eda2d3543c3bfa1c81f4c4b74f4` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:41.065623 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3f7b89-ff3b-416b-9ae1-1ba5f415f363 admin admin] RBAC: Authorizing `identity:delete_project(project_id=496f2eda2d3543c3bfa1c81f4c4b74f4)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:41.067788 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3f7b89-ff3b-416b-9ae1-1ba5f415f363 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:41.074791 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15bdc2d-5307-4178-9927-0417db3e1212 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:41.080505 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcd6cb6-21c2-475a-9840-7577d8bcf481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:41.081152 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd6cb6-21c2-475a-9840-7577d8bcf481 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:41.081474 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd6cb6-21c2-475a-9840-7577d8bcf481 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:41.081751 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd6cb6-21c2-475a-9840-7577d8bcf481 admin admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:41.082428 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcd6cb6-21c2-475a-9840-7577d8bcf481 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:12:41.082989 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcd6cb6-21c2-475a-9840-7577d8bcf481 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:41.084533 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcd6cb6-21c2-475a-9840-7577d8bcf481 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:41.098257 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 996/1996] 10.222.0.49 () {58 vars in 1153 bytes} [Thu Sep 29 02:12:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 02:12:41.103385 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcd6cb6-21c2-475a-9840-7577d8bcf481 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:41.123167 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcd6cb6-21c2-475a-9840-7577d8bcf481 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:41.130922 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:41.139678 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-8d3f7b89-ff3b-416b-9ae1-1ba5f415f363 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '496f2eda2d3543c3bfa1c81f4c4b74f4', 'request_id': 'req-8d3f7b89-ff3b-416b-9ae1-1ba5f415f363'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:41.149736 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-8d3f7b89-ff3b-416b-9ae1-1ba5f415f363 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '496f2eda2d3543c3bfa1c81f4c4b74f4', 'request_id': 'req-8d3f7b89-ff3b-416b-9ae1-1ba5f415f363'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:41.160954 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-8d3f7b89-ff3b-416b-9ae1-1ba5f415f363 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '496f2eda2d3543c3bfa1c81f4c4b74f4', 'request_id': 'req-8d3f7b89-ff3b-416b-9ae1-1ba5f415f363'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:41.175473 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-8d3f7b89-ff3b-416b-9ae1-1ba5f415f363 admin admin] The token cache is being invalidate because project 496f2eda2d3543c3bfa1c81f4c4b74f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81648) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:12:41.175767 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-8d3f7b89-ff3b-416b-9ae1-1ba5f415f363 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:41.176426 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-8d3f7b89-ff3b-416b-9ae1-1ba5f415f363 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:41.178040 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1001/1997] 10.222.0.49 () {58 vars in 1233 bytes} [Thu Sep 29 02:12:40 2022] DELETE /identity/v3/projects/496f2eda2d3543c3bfa1c81f4c4b74f4 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:12:41.183644 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e596283e-55e6-4081-a596-029eeff4f664 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:41.183964 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e596283e-55e6-4081-a596-029eeff4f664 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:41.184238 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e596283e-55e6-4081-a596-029eeff4f664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:41.208757 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-e596283e-55e6-4081-a596-029eeff4f664 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:41.211209 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-e596283e-55e6-4081-a596-029eeff4f664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:41.222899 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5163e5bc-dc92-44c3-80a7-dab316d9b2f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:41.224954 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5163e5bc-dc92-44c3-80a7-dab316d9b2f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:41.225591 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5163e5bc-dc92-44c3-80a7-dab316d9b2f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:41.227094 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5163e5bc-dc92-44c3-80a7-dab316d9b2f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:41.228257 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5163e5bc-dc92-44c3-80a7-dab316d9b2f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:41.230633 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5163e5bc-dc92-44c3-80a7-dab316d9b2f9 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:41.266230 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 997/1998] 10.222.0.49 () {60 vars in 1153 bytes} [Thu Sep 29 02:12:41 2022] POST /identity/v3/projects => generated 383 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 29 02:12:41.269882 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5163e5bc-dc92-44c3-80a7-dab316d9b2f9 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:41.271917 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-5163e5bc-dc92-44c3-80a7-dab316d9b2f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:41.309371 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1002/1999] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:12:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:41.317105 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff0890d-04c9-4f5b-9c9f-f1ba33bb4bb3 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:41.317501 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff0890d-04c9-4f5b-9c9f-f1ba33bb4bb3 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:41.317969 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff0890d-04c9-4f5b-9c9f-f1ba33bb4bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:41.334219 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:41.342098 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-4ff0890d-04c9-4f5b-9c9f-f1ba33bb4bb3 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:41.344399 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-4ff0890d-04c9-4f5b-9c9f-f1ba33bb4bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:41.393077 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5163e5bc-dc92-44c3-80a7-dab316d9b2f9 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:41.399953 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6de524-8f94-4c6d-8fde-d63857387d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:41.400676 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6de524-8f94-4c6d-8fde-d63857387d0b admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:41.401050 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6de524-8f94-4c6d-8fde-d63857387d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:41.401465 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6de524-8f94-4c6d-8fde-d63857387d0b admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:41.402968 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6de524-8f94-4c6d-8fde-d63857387d0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:41.406264 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6de524-8f94-4c6d-8fde-d63857387d0b admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:41.434943 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 998/2000] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 02:12:41 2022] POST /identity/v3/users => generated 292 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 29 02:12:41.439077 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6de524-8f94-4c6d-8fde-d63857387d0b admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:41.446987 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1003/2001] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:12:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:41.451853 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6de524-8f94-4c6d-8fde-d63857387d0b admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:41.453440 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff0890d-04c9-4f5b-9c9f-f1ba33bb4bb3 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:41.458472 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bbaba8-17bc-4670-b966-614706aa744f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:41.459763 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bbaba8-17bc-4670-b966-614706aa744f admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:41.460720 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bbaba8-17bc-4670-b966-614706aa744f admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:41.461519 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bbaba8-17bc-4670-b966-614706aa744f admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:41.462171 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bbaba8-17bc-4670-b966-614706aa744f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:41.463354 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff0890d-04c9-4f5b-9c9f-f1ba33bb4bb3 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:41.463880 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bbaba8-17bc-4670-b966-614706aa744f admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:41.468660 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85436a7e-5626-464c-81b3-33373b7ac408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:41.469415 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85436a7e-5626-464c-81b3-33373b7ac408 admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:41.470180 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85436a7e-5626-464c-81b3-33373b7ac408 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:41.470523 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85436a7e-5626-464c-81b3-33373b7ac408 admin admin] PATH_INFO: `/v3/domains` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:41.471248 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85436a7e-5626-464c-81b3-33373b7ac408 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:12:41.471622 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85436a7e-5626-464c-81b3-33373b7ac408 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:41.473294 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85436a7e-5626-464c-81b3-33373b7ac408 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:41.479525 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 999/2002] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:41 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:41.481928 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bbaba8-17bc-4670-b966-614706aa744f admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:41.489082 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1004/2003] 10.222.0.49 () {58 vars in 1153 bytes} [Thu Sep 29 02:12:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:12:41.494255 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85436a7e-5626-464c-81b3-33373b7ac408 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:41.495311 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bbaba8-17bc-4670-b966-614706aa744f admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:41.500342 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d041b-45cd-4398-902f-b87890b83a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:41.501665 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d041b-45cd-4398-902f-b87890b83a5e admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:41.501943 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d041b-45cd-4398-902f-b87890b83a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:41.502371 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d041b-45cd-4398-902f-b87890b83a5e admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:41.503011 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5d041b-45cd-4398-902f-b87890b83a5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:41.504326 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85436a7e-5626-464c-81b3-33373b7ac408 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:41.504586 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5d041b-45cd-4398-902f-b87890b83a5e admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:41.510287 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf6f9f7-8d8d-46fc-9a32-01303f165bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:41.511396 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6f9f7-8d8d-46fc-9a32-01303f165bf0 admin admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:41.511396 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6f9f7-8d8d-46fc-9a32-01303f165bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:41.511748 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6f9f7-8d8d-46fc-9a32-01303f165bf0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:41.512526 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf6f9f7-8d8d-46fc-9a32-01303f165bf0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:41.514568 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf6f9f7-8d8d-46fc-9a32-01303f165bf0 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:41.516444 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1000/2004] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:41.520645 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d041b-45cd-4398-902f-b87890b83a5e admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:41.530965 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d041b-45cd-4398-902f-b87890b83a5e admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:41.536666 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea2c032-dfdc-4497-a189-49f1b09ab33e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:41.537335 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea2c032-dfdc-4497-a189-49f1b09ab33e admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:41.537622 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea2c032-dfdc-4497-a189-49f1b09ab33e admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:41.537892 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea2c032-dfdc-4497-a189-49f1b09ab33e admin admin] PATH_INFO: `/v3/projects/6262595fd97144c6960b167f78a13b95/users/81f3f2d06cc4491f816af4b690aa31ae/roles/f157f905c9c94ccfbfb46e52d443e8f2` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:41.546510 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1005/2005] 10.222.0.49 () {60 vars in 1153 bytes} [Thu Sep 29 02:12:41 2022] POST /identity/v3/projects => generated 379 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:41.550765 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf6f9f7-8d8d-46fc-9a32-01303f165bf0 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:41.557331 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea2c032-dfdc-4497-a189-49f1b09ab33e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6262595fd97144c6960b167f78a13b95, user_id=81f3f2d06cc4491f816af4b690aa31ae, role_id=f157f905c9c94ccfbfb46e52d443e8f2)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:41.560753 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea2c032-dfdc-4497-a189-49f1b09ab33e admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:41.577769 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1001/2006] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:12:41 2022] PUT /identity/v3/projects/6262595fd97144c6960b167f78a13b95/users/81f3f2d06cc4491f816af4b690aa31ae/roles/f157f905c9c94ccfbfb46e52d443e8f2 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:12:41.588354 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ac2c4-c6c4-4d67-aaec-7264088abbd5 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:41.589268 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ac2c4-c6c4-4d67-aaec-7264088abbd5 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:41.589687 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ac2c4-c6c4-4d67-aaec-7264088abbd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:41.630005 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf6f9f7-8d8d-46fc-9a32-01303f165bf0 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:41.631399 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-4b4ac2c4-c6c4-4d67-aaec-7264088abbd5 None None] MFA Rules not processed for user `81f3f2d06cc4491f816af4b690aa31ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:41.634006 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-4b4ac2c4-c6c4-4d67-aaec-7264088abbd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:41.677177 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:41.715768 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a3f15f-b288-435f-940a-46c4b1cdd3cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:41.716434 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3f15f-b288-435f-940a-46c4b1cdd3cf admin admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:41.717354 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3f15f-b288-435f-940a-46c4b1cdd3cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:41.717354 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3f15f-b288-435f-940a-46c4b1cdd3cf admin admin] PATH_INFO: `/v3/users` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:41.717652 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a3f15f-b288-435f-940a-46c4b1cdd3cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:41.720500 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a3f15f-b288-435f-940a-46c4b1cdd3cf admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:41.739365 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1002/2007] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:12:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 29 02:12:41.748808 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1006/2008] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 02:12:41 2022] POST /identity/v3/users => generated 290 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 29 02:12:41.752146 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4ac2c4-c6c4-4d67-aaec-7264088abbd5 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:41.752982 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a3f15f-b288-435f-940a-46c4b1cdd3cf admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:41.753615 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-4b4ac2c4-c6c4-4d67-aaec-7264088abbd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:41.764952 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a3f15f-b288-435f-940a-46c4b1cdd3cf admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:41.770252 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd01d9e4-446d-4ac4-ae34-24536ac29d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:41.771141 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd01d9e4-446d-4ac4-ae34-24536ac29d41 admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:41.771449 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd01d9e4-446d-4ac4-ae34-24536ac29d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:41.771700 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd01d9e4-446d-4ac4-ae34-24536ac29d41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:41.772450 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd01d9e4-446d-4ac4-ae34-24536ac29d41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:41.774508 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd01d9e4-446d-4ac4-ae34-24536ac29d41 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:41.776877 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:41.789480 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1007/2009] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:41 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 29 02:12:41.792827 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd01d9e4-446d-4ac4-ae34-24536ac29d41 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:41.804739 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd01d9e4-446d-4ac4-ae34-24536ac29d41 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:41.811850 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a42188e-98ff-4a16-9499-d8a576b588a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:41.812349 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a42188e-98ff-4a16-9499-d8a576b588a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:41.812685 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a42188e-98ff-4a16-9499-d8a576b588a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:41.812983 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a42188e-98ff-4a16-9499-d8a576b588a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:41.813753 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a42188e-98ff-4a16-9499-d8a576b588a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:41.815694 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a42188e-98ff-4a16-9499-d8a576b588a9 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:41.820060 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4ac2c4-c6c4-4d67-aaec-7264088abbd5 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:41.824067 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d36903-dd8d-45cc-adb6-8380e0527994 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75135b856134ba4b9ccac337886f682', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:41.824707 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d36903-dd8d-45cc-adb6-8380e0527994 service cinder] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:41.824960 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d36903-dd8d-45cc-adb6-8380e0527994 service cinder] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:41.825898 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d36903-dd8d-45cc-adb6-8380e0527994 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:41.828756 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1008/2010] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:41 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 29 02:12:41.832881 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a42188e-98ff-4a16-9499-d8a576b588a9 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:41.838032 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d36903-dd8d-45cc-adb6-8380e0527994 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:41.839643 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d36903-dd8d-45cc-adb6-8380e0527994 service cinder] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:41.846043 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a42188e-98ff-4a16-9499-d8a576b588a9 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:41.853282 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc309f34-8545-4333-9309-0a8d9d0ac030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:41.853491 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1003/2011] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:41 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:12:41.853851 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc309f34-8545-4333-9309-0a8d9d0ac030 admin admin] REQUEST_METHOD: `PUT` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:41.854158 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc309f34-8545-4333-9309-0a8d9d0ac030 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:41.854437 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc309f34-8545-4333-9309-0a8d9d0ac030 admin admin] PATH_INFO: `/v3/projects/3287dce5f39746509c2917244fc3e951/users/e8066734143c47338ae5e7c59a4cf1a9/roles/f157f905c9c94ccfbfb46e52d443e8f2` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:41.880101 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc309f34-8545-4333-9309-0a8d9d0ac030 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3287dce5f39746509c2917244fc3e951, user_id=e8066734143c47338ae5e7c59a4cf1a9, role_id=f157f905c9c94ccfbfb46e52d443e8f2)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:41.884208 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc309f34-8545-4333-9309-0a8d9d0ac030 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:41.905412 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1009/2012] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:12:41 2022] PUT /identity/v3/projects/3287dce5f39746509c2917244fc3e951/users/e8066734143c47338ae5e7c59a4cf1a9/roles/f157f905c9c94ccfbfb46e52d443e8f2 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:12:41.922294 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07fe61d-85a9-45c7-ab44-41433c64b363 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:41.922688 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07fe61d-85a9-45c7-ab44-41433c64b363 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:41.923246 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07fe61d-85a9-45c7-ab44-41433c64b363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:41.969831 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-b07fe61d-85a9-45c7-ab44-41433c64b363 None None] MFA Rules not processed for user `e8066734143c47338ae5e7c59a4cf1a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:41.972744 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-b07fe61d-85a9-45c7-ab44-41433c64b363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:42.015009 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc309f34-8545-4333-9309-0a8d9d0ac030 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:42.017235 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-cc309f34-8545-4333-9309-0a8d9d0ac030 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:42.111118 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1004/2013] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:12:41 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:42.118072 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07fe61d-85a9-45c7-ab44-41433c64b363 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:42.198110 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc309f34-8545-4333-9309-0a8d9d0ac030 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:42.218134 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ce7db0-8d4f-4cb6-8028-be29d48e1ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:42.220220 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce7db0-8d4f-4cb6-8028-be29d48e1ed5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:42.222569 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce7db0-8d4f-4cb6-8028-be29d48e1ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:42.222873 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce7db0-8d4f-4cb6-8028-be29d48e1ed5 admin admin] PATH_INFO: `/v3/users/d2ffe30e7c32415d99530eb43c20485b` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:42.225385 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ce7db0-8d4f-4cb6-8028-be29d48e1ed5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2ffe30e7c32415d99530eb43c20485b)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:42.232697 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ce7db0-8d4f-4cb6-8028-be29d48e1ed5 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:42.265570 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07fe61d-85a9-45c7-ab44-41433c64b363 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:42.280657 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4f6094-0463-49da-aab6-1e9e41a6b753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:42.281671 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4f6094-0463-49da-aab6-1e9e41a6b753 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:42.282060 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4f6094-0463-49da-aab6-1e9e41a6b753 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:42.282437 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4f6094-0463-49da-aab6-1e9e41a6b753 admin admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:42.283358 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4f6094-0463-49da-aab6-1e9e41a6b753 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:42.286340 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4f6094-0463-49da-aab6-1e9e41a6b753 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:42.293671 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:42.329023 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-60ce7db0-8d4f-4cb6-8028-be29d48e1ed5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2ffe30e7c32415d99530eb43c20485b'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:42.331764 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-60ce7db0-8d4f-4cb6-8028-be29d48e1ed5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2ffe30e7c32415d99530eb43c20485b'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:42.339315 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1005/2014] 10.222.0.49 () {60 vars in 1153 bytes} [Thu Sep 29 02:12:42 2022] POST /identity/v3/projects => generated 379 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:42.344161 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4f6094-0463-49da-aab6-1e9e41a6b753 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:42.346628 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-aa4f6094-0463-49da-aab6-1e9e41a6b753 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:42.379486 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-60ce7db0-8d4f-4cb6-8028-be29d48e1ed5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2ffe30e7c32415d99530eb43c20485b'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:42.379486 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-60ce7db0-8d4f-4cb6-8028-be29d48e1ed5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2ffe30e7c32415d99530eb43c20485b'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:42.382900 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-60ce7db0-8d4f-4cb6-8028-be29d48e1ed5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2ffe30e7c32415d99530eb43c20485b'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:42.426681 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1010/2015] 10.222.0.49 () {58 vars in 1224 bytes} [Thu Sep 29 02:12:42 2022] DELETE /identity/v3/users/d2ffe30e7c32415d99530eb43c20485b => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:42.430892 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b7956a-2ef9-427c-8c98-0a8aae748f03 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:42.431250 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b7956a-2ef9-427c-8c98-0a8aae748f03 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:42.431443 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b7956a-2ef9-427c-8c98-0a8aae748f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:42.476532 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-21b7956a-2ef9-427c-8c98-0a8aae748f03 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:42.480334 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-21b7956a-2ef9-427c-8c98-0a8aae748f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:42.501596 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4f6094-0463-49da-aab6-1e9e41a6b753 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:42.550306 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:42.582087 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f5a552-ab7d-4857-869f-4d911785919e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:42.583042 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f5a552-ab7d-4857-869f-4d911785919e admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:42.583265 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f5a552-ab7d-4857-869f-4d911785919e admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:42.583537 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f5a552-ab7d-4857-869f-4d911785919e admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:42.584847 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f5a552-ab7d-4857-869f-4d911785919e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:42.589113 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1011/2016] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:12:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 29 02:12:42.589266 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f5a552-ab7d-4857-869f-4d911785919e admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:42.596823 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b7956a-2ef9-427c-8c98-0a8aae748f03 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:42.598760 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-21b7956a-2ef9-427c-8c98-0a8aae748f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:42.612547 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1006/2017] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 02:12:42 2022] POST /identity/v3/users => generated 296 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:42.616978 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f5a552-ab7d-4857-869f-4d911785919e admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:42.627978 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f5a552-ab7d-4857-869f-4d911785919e admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:42.634284 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba60cb3-a0d2-468d-ae8e-44d00f54125c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:42.635313 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba60cb3-a0d2-468d-ae8e-44d00f54125c admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:42.635852 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba60cb3-a0d2-468d-ae8e-44d00f54125c admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:42.636195 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba60cb3-a0d2-468d-ae8e-44d00f54125c admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:42.637203 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba60cb3-a0d2-468d-ae8e-44d00f54125c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:42.640590 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba60cb3-a0d2-468d-ae8e-44d00f54125c admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:42.656762 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1007/2018] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:42 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 29 02:12:42.660878 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba60cb3-a0d2-468d-ae8e-44d00f54125c admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:42.666816 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b7956a-2ef9-427c-8c98-0a8aae748f03 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:42.671866 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa86c6b-bfee-4a82-bcc1-788cbe91a9c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:42.672482 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba60cb3-a0d2-468d-ae8e-44d00f54125c admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:42.672591 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa86c6b-bfee-4a82-bcc1-788cbe91a9c1 service neutron] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:42.672755 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa86c6b-bfee-4a82-bcc1-788cbe91a9c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:42.673028 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa86c6b-bfee-4a82-bcc1-788cbe91a9c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:42.677831 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f17059-4c31-40e9-b623-6c389011d1d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:42.678603 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f17059-4c31-40e9-b623-6c389011d1d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:42.679551 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f17059-4c31-40e9-b623-6c389011d1d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:42.680112 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f17059-4c31-40e9-b623-6c389011d1d9 admin admin] PATH_INFO: `/v3/projects/c7a1d6f863b14229ae788cb59e7a003a/users/412aebdd2ef14ef6bc1a6380eb16f898/roles/fe9bbc67742f4f5893f39b18eb31d59a` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:42.683271 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa86c6b-bfee-4a82-bcc1-788cbe91a9c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:42.684846 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa86c6b-bfee-4a82-bcc1-788cbe91a9c1 service neutron] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:42.698207 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f17059-4c31-40e9-b623-6c389011d1d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7a1d6f863b14229ae788cb59e7a003a, user_id=412aebdd2ef14ef6bc1a6380eb16f898, role_id=fe9bbc67742f4f5893f39b18eb31d59a)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:42.701573 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f17059-4c31-40e9-b623-6c389011d1d9 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:42.706117 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1012/2019] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:12:42.727664 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1008/2020] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:12:42 2022] PUT /identity/v3/projects/c7a1d6f863b14229ae788cb59e7a003a/users/412aebdd2ef14ef6bc1a6380eb16f898/roles/fe9bbc67742f4f5893f39b18eb31d59a => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:12:42.728258 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa86c6b-bfee-4a82-bcc1-788cbe91a9c1 service neutron] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:42.739724 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa86c6b-bfee-4a82-bcc1-788cbe91a9c1 service neutron] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:42.827573 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6afbd2-502e-4f3a-8959-aaea63317cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:42.828233 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6afbd2-502e-4f3a-8959-aaea63317cbf admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:42.828552 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6afbd2-502e-4f3a-8959-aaea63317cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:42.828829 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6afbd2-502e-4f3a-8959-aaea63317cbf admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:42.829541 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6afbd2-502e-4f3a-8959-aaea63317cbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:42.831199 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6afbd2-502e-4f3a-8959-aaea63317cbf admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:42.842736 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1013/2021] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:42 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:42.846886 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f17059-4c31-40e9-b623-6c389011d1d9 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:42.862339 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f17059-4c31-40e9-b623-6c389011d1d9 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:42.868259 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed6af70-e564-4833-851f-fc6bcb497f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:42.869142 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed6af70-e564-4833-851f-fc6bcb497f94 admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:42.869357 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed6af70-e564-4833-851f-fc6bcb497f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:42.869729 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed6af70-e564-4833-851f-fc6bcb497f94 admin admin] PATH_INFO: `/v3/projects/c7a1d6f863b14229ae788cb59e7a003a/users/412aebdd2ef14ef6bc1a6380eb16f898/roles/fe9bbc67742f4f5893f39b18eb31d59a` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:42.871894 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed6af70-e564-4833-851f-fc6bcb497f94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7a1d6f863b14229ae788cb59e7a003a, user_id=412aebdd2ef14ef6bc1a6380eb16f898, role_id=fe9bbc67742f4f5893f39b18eb31d59a)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:42.874762 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed6af70-e564-4833-851f-fc6bcb497f94 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:42.902458 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1009/2022] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:12:42 2022] PUT /identity/v3/projects/c7a1d6f863b14229ae788cb59e7a003a/users/412aebdd2ef14ef6bc1a6380eb16f898/roles/fe9bbc67742f4f5893f39b18eb31d59a => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:12:42.918954 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cae92a5-ba0f-4378-9e1f-a0989807a9d7 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:42.919386 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cae92a5-ba0f-4378-9e1f-a0989807a9d7 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:42.919757 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cae92a5-ba0f-4378-9e1f-a0989807a9d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:42.964941 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-8cae92a5-ba0f-4378-9e1f-a0989807a9d7 None None] MFA Rules not processed for user `412aebdd2ef14ef6bc1a6380eb16f898`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:42.967613 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-8cae92a5-ba0f-4378-9e1f-a0989807a9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:43.106095 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed6af70-e564-4833-851f-fc6bcb497f94 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:43.107904 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-6ed6af70-e564-4833-851f-fc6bcb497f94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:43.114557 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1014/2023] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:12:42 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:43.129591 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cae92a5-ba0f-4378-9e1f-a0989807a9d7 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:43.130520 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-8cae92a5-ba0f-4378-9e1f-a0989807a9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:43.141700 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:43.167217 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:43.202542 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed6af70-e564-4833-851f-fc6bcb497f94 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:43.213545 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e77b112-7ea4-47ba-bc39-31194603537b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:43.214558 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e77b112-7ea4-47ba-bc39-31194603537b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:43.215225 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e77b112-7ea4-47ba-bc39-31194603537b admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:43.215788 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e77b112-7ea4-47ba-bc39-31194603537b admin admin] PATH_INFO: `/v3/projects/298c589123ef473a82ca7ea19da531f4` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:43.217974 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e77b112-7ea4-47ba-bc39-31194603537b admin admin] RBAC: Authorizing `identity:delete_project(project_id=298c589123ef473a82ca7ea19da531f4)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:43.221576 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e77b112-7ea4-47ba-bc39-31194603537b admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:43.228688 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cae92a5-ba0f-4378-9e1f-a0989807a9d7 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:43.234844 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c1e32d-55c3-4018-b816-3f652e8d8f6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75135b856134ba4b9ccac337886f682', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:43.235932 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c1e32d-55c3-4018-b816-3f652e8d8f6e service cinder] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:43.236226 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c1e32d-55c3-4018-b816-3f652e8d8f6e service cinder] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:43.236506 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c1e32d-55c3-4018-b816-3f652e8d8f6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:43.247264 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c1e32d-55c3-4018-b816-3f652e8d8f6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:43.248703 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c1e32d-55c3-4018-b816-3f652e8d8f6e service cinder] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:43.259089 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1015/2024] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:43 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 29 02:12:43.284489 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-7e77b112-7ea4-47ba-bc39-31194603537b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '298c589123ef473a82ca7ea19da531f4', 'request_id': 'req-7e77b112-7ea4-47ba-bc39-31194603537b'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:43.295305 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-7e77b112-7ea4-47ba-bc39-31194603537b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '298c589123ef473a82ca7ea19da531f4', 'request_id': 'req-7e77b112-7ea4-47ba-bc39-31194603537b'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:43.304958 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-7e77b112-7ea4-47ba-bc39-31194603537b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '298c589123ef473a82ca7ea19da531f4', 'request_id': 'req-7e77b112-7ea4-47ba-bc39-31194603537b'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:43.319153 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-7e77b112-7ea4-47ba-bc39-31194603537b admin admin] The token cache is being invalidate because project 298c589123ef473a82ca7ea19da531f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81649) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:12:43.319485 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-7e77b112-7ea4-47ba-bc39-31194603537b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:43.320249 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-7e77b112-7ea4-47ba-bc39-31194603537b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:43.321773 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1010/2025] 10.222.0.49 () {58 vars in 1233 bytes} [Thu Sep 29 02:12:43 2022] DELETE /identity/v3/projects/298c589123ef473a82ca7ea19da531f4 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:43.326209 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c1e32d-55c3-4018-b816-3f652e8d8f6e service cinder] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:43.339194 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c1e32d-55c3-4018-b816-3f652e8d8f6e service cinder] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:43.399869 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2110a6a-7e61-4081-881a-397e5bf08521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:43.400534 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2110a6a-7e61-4081-881a-397e5bf08521 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:43.400820 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2110a6a-7e61-4081-881a-397e5bf08521 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:43.401096 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2110a6a-7e61-4081-881a-397e5bf08521 admin admin] PATH_INFO: `/v3/users/95f02ee1aefb4775ab62ea453540a98c` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:43.402276 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2110a6a-7e61-4081-881a-397e5bf08521 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95f02ee1aefb4775ab62ea453540a98c)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:43.404214 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2110a6a-7e61-4081-881a-397e5bf08521 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:43.557621 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-f2110a6a-7e61-4081-881a-397e5bf08521 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95f02ee1aefb4775ab62ea453540a98c'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:43.560748 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-f2110a6a-7e61-4081-881a-397e5bf08521 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95f02ee1aefb4775ab62ea453540a98c'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:43.598325 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-f2110a6a-7e61-4081-881a-397e5bf08521 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95f02ee1aefb4775ab62ea453540a98c'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:43.630578 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-f2110a6a-7e61-4081-881a-397e5bf08521 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95f02ee1aefb4775ab62ea453540a98c'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:43.631512 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-f2110a6a-7e61-4081-881a-397e5bf08521 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95f02ee1aefb4775ab62ea453540a98c'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:43.653559 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1016/2026] 10.222.0.49 () {58 vars in 1224 bytes} [Thu Sep 29 02:12:43 2022] DELETE /identity/v3/users/95f02ee1aefb4775ab62ea453540a98c => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:44.114182 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e77b112-7ea4-47ba-bc39-31194603537b admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:44.115619 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-7e77b112-7ea4-47ba-bc39-31194603537b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:44.133776 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e77b112-7ea4-47ba-bc39-31194603537b admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:44.238182 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34bb758-07fd-4e68-8e7e-7be1f007ae1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:44.238877 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34bb758-07fd-4e68-8e7e-7be1f007ae1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:44.239207 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34bb758-07fd-4e68-8e7e-7be1f007ae1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:44.239472 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34bb758-07fd-4e68-8e7e-7be1f007ae1a admin admin] PATH_INFO: `/v3/users/e8066734143c47338ae5e7c59a4cf1a9` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:44.241212 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34bb758-07fd-4e68-8e7e-7be1f007ae1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8066734143c47338ae5e7c59a4cf1a9)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:44.244664 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34bb758-07fd-4e68-8e7e-7be1f007ae1a admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:44.325555 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-e34bb758-07fd-4e68-8e7e-7be1f007ae1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8066734143c47338ae5e7c59a4cf1a9'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:44.328192 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-e34bb758-07fd-4e68-8e7e-7be1f007ae1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8066734143c47338ae5e7c59a4cf1a9'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:44.344560 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-e34bb758-07fd-4e68-8e7e-7be1f007ae1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8066734143c47338ae5e7c59a4cf1a9'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:44.347839 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:44.357526 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-e34bb758-07fd-4e68-8e7e-7be1f007ae1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8066734143c47338ae5e7c59a4cf1a9'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:44.359648 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-e34bb758-07fd-4e68-8e7e-7be1f007ae1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8066734143c47338ae5e7c59a4cf1a9'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:44.387474 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1011/2027] 10.222.0.49 () {58 vars in 1224 bytes} [Thu Sep 29 02:12:44 2022] DELETE /identity/v3/users/e8066734143c47338ae5e7c59a4cf1a9 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:44.388809 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea1f4e9-f571-4892-8005-2c50fd5d39bf None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:44.389282 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea1f4e9-f571-4892-8005-2c50fd5d39bf None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:44.389385 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea1f4e9-f571-4892-8005-2c50fd5d39bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:44.430342 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-4ea1f4e9-f571-4892-8005-2c50fd5d39bf None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:44.432446 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-4ea1f4e9-f571-4892-8005-2c50fd5d39bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:44.440971 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34bb758-07fd-4e68-8e7e-7be1f007ae1a admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:44.443283 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-e34bb758-07fd-4e68-8e7e-7be1f007ae1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:44.470693 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:44.525844 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1017/2028] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:12:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 29 02:12:44.540552 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea1f4e9-f571-4892-8005-2c50fd5d39bf None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:44.541987 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-4ea1f4e9-f571-4892-8005-2c50fd5d39bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:44.555752 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34bb758-07fd-4e68-8e7e-7be1f007ae1a admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:44.562249 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4104bce-6b5d-4c1f-845c-e238ff28dbc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:44.563001 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4104bce-6b5d-4c1f-845c-e238ff28dbc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:44.563286 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4104bce-6b5d-4c1f-845c-e238ff28dbc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:44.563559 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4104bce-6b5d-4c1f-845c-e238ff28dbc5 admin admin] PATH_INFO: `/v3/projects/e58341d535af494b8049022421956e7d` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:44.565292 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4104bce-6b5d-4c1f-845c-e238ff28dbc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e58341d535af494b8049022421956e7d)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:44.569024 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4104bce-6b5d-4c1f-845c-e238ff28dbc5 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:44.615631 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea1f4e9-f571-4892-8005-2c50fd5d39bf None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:44.633193 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-a4104bce-6b5d-4c1f-845c-e238ff28dbc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e58341d535af494b8049022421956e7d', 'request_id': 'req-a4104bce-6b5d-4c1f-845c-e238ff28dbc5'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:44.642338 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-a4104bce-6b5d-4c1f-845c-e238ff28dbc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e58341d535af494b8049022421956e7d', 'request_id': 'req-a4104bce-6b5d-4c1f-845c-e238ff28dbc5'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:44.652989 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-a4104bce-6b5d-4c1f-845c-e238ff28dbc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e58341d535af494b8049022421956e7d', 'request_id': 'req-a4104bce-6b5d-4c1f-845c-e238ff28dbc5'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:44.665562 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-a4104bce-6b5d-4c1f-845c-e238ff28dbc5 admin admin] The token cache is being invalidate because project e58341d535af494b8049022421956e7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81649) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:12:44.665841 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-a4104bce-6b5d-4c1f-845c-e238ff28dbc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:44.666620 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-a4104bce-6b5d-4c1f-845c-e238ff28dbc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:44.668337 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1012/2029] 10.222.0.49 () {58 vars in 1233 bytes} [Thu Sep 29 02:12:44 2022] DELETE /identity/v3/projects/e58341d535af494b8049022421956e7d => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:44.671916 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4104bce-6b5d-4c1f-845c-e238ff28dbc5 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:44.673524 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-a4104bce-6b5d-4c1f-845c-e238ff28dbc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:44.679482 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a5d566-40b3-4c59-862c-0971134812ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:44.680086 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a5d566-40b3-4c59-862c-0971134812ac service neutron] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:44.680734 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a5d566-40b3-4c59-862c-0971134812ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:44.680734 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a5d566-40b3-4c59-862c-0971134812ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:44.682459 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-60a5d566-40b3-4c59-862c-0971134812ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:44.746252 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4104bce-6b5d-4c1f-845c-e238ff28dbc5 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:44.751251 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0736f231-5803-4710-b0e0-62906c31116e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:44.751891 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0736f231-5803-4710-b0e0-62906c31116e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:44.752179 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0736f231-5803-4710-b0e0-62906c31116e admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:44.752452 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0736f231-5803-4710-b0e0-62906c31116e admin admin] PATH_INFO: `/v3/users/587efdbefc444a799cb9c0e1e90f7b2b` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:44.753787 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0736f231-5803-4710-b0e0-62906c31116e admin admin] RBAC: Authorizing `identity:delete_user(user_id=587efdbefc444a799cb9c0e1e90f7b2b)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:44.755710 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0736f231-5803-4710-b0e0-62906c31116e admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:44.757393 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a5d566-40b3-4c59-862c-0971134812ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:44.759066 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a5d566-40b3-4c59-862c-0971134812ac service neutron] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:44.769106 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1018/2030] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 29 02:12:44.771755 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:INSERT=2,keystone:DELETE=9,keystone:SELECT=89 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:44.808592 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-0736f231-5803-4710-b0e0-62906c31116e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '587efdbefc444a799cb9c0e1e90f7b2b'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:44.809328 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-0736f231-5803-4710-b0e0-62906c31116e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '587efdbefc444a799cb9c0e1e90f7b2b'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:44.821115 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-0736f231-5803-4710-b0e0-62906c31116e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '587efdbefc444a799cb9c0e1e90f7b2b'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:44.828680 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-0736f231-5803-4710-b0e0-62906c31116e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '587efdbefc444a799cb9c0e1e90f7b2b'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:44.829616 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-0736f231-5803-4710-b0e0-62906c31116e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '587efdbefc444a799cb9c0e1e90f7b2b'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:44.843262 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1013/2031] 10.222.0.49 () {58 vars in 1224 bytes} [Thu Sep 29 02:12:44 2022] DELETE /identity/v3/users/587efdbefc444a799cb9c0e1e90f7b2b => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:12:45.694504 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a5d566-40b3-4c59-862c-0971134812ac service neutron] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:45.695960 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-60a5d566-40b3-4c59-862c-0971134812ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:45.719603 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a5d566-40b3-4c59-862c-0971134812ac service neutron] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:45.740159 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0736f231-5803-4710-b0e0-62906c31116e admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:45.742312 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-0736f231-5803-4710-b0e0-62906c31116e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:45.783166 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:45.815978 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bcfa7a-90e2-422c-8268-290d779c11ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:45.817105 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bcfa7a-90e2-422c-8268-290d779c11ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:45.817701 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bcfa7a-90e2-422c-8268-290d779c11ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:45.818329 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bcfa7a-90e2-422c-8268-290d779c11ae admin admin] PATH_INFO: `/v3/projects/3287dce5f39746509c2917244fc3e951` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:45.819949 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bcfa7a-90e2-422c-8268-290d779c11ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=3287dce5f39746509c2917244fc3e951)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:45.822330 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bcfa7a-90e2-422c-8268-290d779c11ae admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:45.915076 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0736f231-5803-4710-b0e0-62906c31116e admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:45.919531 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-20bcfa7a-90e2-422c-8268-290d779c11ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3287dce5f39746509c2917244fc3e951', 'request_id': 'req-20bcfa7a-90e2-422c-8268-290d779c11ae'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:45.938062 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-20bcfa7a-90e2-422c-8268-290d779c11ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3287dce5f39746509c2917244fc3e951', 'request_id': 'req-20bcfa7a-90e2-422c-8268-290d779c11ae'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:45.953899 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-20bcfa7a-90e2-422c-8268-290d779c11ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3287dce5f39746509c2917244fc3e951', 'request_id': 'req-20bcfa7a-90e2-422c-8268-290d779c11ae'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:45.965928 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-20bcfa7a-90e2-422c-8268-290d779c11ae admin admin] The token cache is being invalidate because project 3287dce5f39746509c2917244fc3e951 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81648) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:12:45.966247 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-20bcfa7a-90e2-422c-8268-290d779c11ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:45.966932 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-20bcfa7a-90e2-422c-8268-290d779c11ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:45.969194 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1019/2032] 10.222.0.49 () {58 vars in 1233 bytes} [Thu Sep 29 02:12:45 2022] DELETE /identity/v3/projects/3287dce5f39746509c2917244fc3e951 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:45.972871 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bcfa7a-90e2-422c-8268-290d779c11ae admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:45.976141 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-20bcfa7a-90e2-422c-8268-290d779c11ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:46.004441 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f11855-8857-4da7-99ee-5dc7d72709cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:46.005176 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f11855-8857-4da7-99ee-5dc7d72709cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:46.005559 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f11855-8857-4da7-99ee-5dc7d72709cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:46.005904 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f11855-8857-4da7-99ee-5dc7d72709cf admin admin] PATH_INFO: `/v3/projects/708491115cd0466898f1b8b050251e69` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:46.007604 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f11855-8857-4da7-99ee-5dc7d72709cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=708491115cd0466898f1b8b050251e69)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:46.009630 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f11855-8857-4da7-99ee-5dc7d72709cf admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:46.056208 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:46.057490 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bcfa7a-90e2-422c-8268-290d779c11ae admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:46.066698 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-50f11855-8857-4da7-99ee-5dc7d72709cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '708491115cd0466898f1b8b050251e69', 'request_id': 'req-50f11855-8857-4da7-99ee-5dc7d72709cf'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:46.076155 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-50f11855-8857-4da7-99ee-5dc7d72709cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '708491115cd0466898f1b8b050251e69', 'request_id': 'req-50f11855-8857-4da7-99ee-5dc7d72709cf'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:46.087908 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-50f11855-8857-4da7-99ee-5dc7d72709cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '708491115cd0466898f1b8b050251e69', 'request_id': 'req-50f11855-8857-4da7-99ee-5dc7d72709cf'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:46.103139 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-50f11855-8857-4da7-99ee-5dc7d72709cf admin admin] The token cache is being invalidate because project 708491115cd0466898f1b8b050251e69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81649) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:12:46.103447 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-50f11855-8857-4da7-99ee-5dc7d72709cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:46.104040 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-50f11855-8857-4da7-99ee-5dc7d72709cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:46.109522 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1014/2033] 10.222.0.49 () {58 vars in 1233 bytes} [Thu Sep 29 02:12:45 2022] DELETE /identity/v3/projects/708491115cd0466898f1b8b050251e69 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:12:46.112318 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73292109-d8e9-4a4e-922d-e62b7f9a3b0a None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:46.113665 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73292109-d8e9-4a4e-922d-e62b7f9a3b0a None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:46.113993 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73292109-d8e9-4a4e-922d-e62b7f9a3b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:46.141129 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c5c3f3-61d8-4ffa-9862-0ccc3213705e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:46.141412 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c5c3f3-61d8-4ffa-9862-0ccc3213705e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:46.141816 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c5c3f3-61d8-4ffa-9862-0ccc3213705e admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:46.142092 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c5c3f3-61d8-4ffa-9862-0ccc3213705e admin admin] PATH_INFO: `/v3/users/412aebdd2ef14ef6bc1a6380eb16f898` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:46.142788 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-73292109-d8e9-4a4e-922d-e62b7f9a3b0a None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:46.143410 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c5c3f3-61d8-4ffa-9862-0ccc3213705e admin admin] RBAC: Authorizing `identity:delete_user(user_id=412aebdd2ef14ef6bc1a6380eb16f898)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:46.144030 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-73292109-d8e9-4a4e-922d-e62b7f9a3b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:46.145410 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c5c3f3-61d8-4ffa-9862-0ccc3213705e admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:46.153679 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1015/2034] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:12:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:46.160886 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:46.161374 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f66d83e-0ab4-45e8-8acf-b10c639c443d None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:46.161941 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f66d83e-0ab4-45e8-8acf-b10c639c443d None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:46.161941 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f66d83e-0ab4-45e8-8acf-b10c639c443d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:46.196302 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-9f66d83e-0ab4-45e8-8acf-b10c639c443d None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:46.197735 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-9f66d83e-0ab4-45e8-8acf-b10c639c443d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:46.215236 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1016/2035] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:12:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 29 02:12:46.215709 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-54c5c3f3-61d8-4ffa-9862-0ccc3213705e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '412aebdd2ef14ef6bc1a6380eb16f898'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:46.216358 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f66d83e-0ab4-45e8-8acf-b10c639c443d None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:46.216948 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-54c5c3f3-61d8-4ffa-9862-0ccc3213705e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '412aebdd2ef14ef6bc1a6380eb16f898'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:46.234361 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f66d83e-0ab4-45e8-8acf-b10c639c443d None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:46.236501 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-54c5c3f3-61d8-4ffa-9862-0ccc3213705e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '412aebdd2ef14ef6bc1a6380eb16f898'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:46.240701 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f4010d-b87b-476a-851f-f81711af430a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:46.241530 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f4010d-b87b-476a-851f-f81711af430a admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:46.242024 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f4010d-b87b-476a-851f-f81711af430a admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:46.242298 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f4010d-b87b-476a-851f-f81711af430a admin admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:46.242957 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f4010d-b87b-476a-851f-f81711af430a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:12:46.243267 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f4010d-b87b-476a-851f-f81711af430a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:46.244928 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f4010d-b87b-476a-851f-f81711af430a admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:46.247317 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-54c5c3f3-61d8-4ffa-9862-0ccc3213705e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '412aebdd2ef14ef6bc1a6380eb16f898'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:46.248345 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-54c5c3f3-61d8-4ffa-9862-0ccc3213705e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '412aebdd2ef14ef6bc1a6380eb16f898'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:46.258111 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1017/2036] 10.222.0.49 () {58 vars in 1153 bytes} [Thu Sep 29 02:12:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:12:46.262542 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f4010d-b87b-476a-851f-f81711af430a admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:46.265052 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-f7f4010d-b87b-476a-851f-f81711af430a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:46.270091 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1020/2037] 10.222.0.49 () {58 vars in 1224 bytes} [Thu Sep 29 02:12:45 2022] DELETE /identity/v3/users/412aebdd2ef14ef6bc1a6380eb16f898 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:12:46.280194 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f4010d-b87b-476a-851f-f81711af430a admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:46.347726 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acea90da-0591-4eb5-8543-27a0fc53a92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:46.347917 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acea90da-0591-4eb5-8543-27a0fc53a92e admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:46.348272 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acea90da-0591-4eb5-8543-27a0fc53a92e admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:46.348619 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acea90da-0591-4eb5-8543-27a0fc53a92e admin admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:46.349453 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acea90da-0591-4eb5-8543-27a0fc53a92e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:46.352652 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acea90da-0591-4eb5-8543-27a0fc53a92e admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:46.383337 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1018/2038] 10.222.0.49 () {60 vars in 1153 bytes} [Thu Sep 29 02:12:46 2022] POST /identity/v3/projects => generated 371 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 29 02:12:46.388305 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c5c3f3-61d8-4ffa-9862-0ccc3213705e admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:46.403123 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c5c3f3-61d8-4ffa-9862-0ccc3213705e admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:46.494816 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839b8f08-4564-44d8-92a6-628e072de96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:46.495467 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b8f08-4564-44d8-92a6-628e072de96a admin admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:46.495794 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b8f08-4564-44d8-92a6-628e072de96a admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:46.496111 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b8f08-4564-44d8-92a6-628e072de96a admin admin] PATH_INFO: `/v3/users` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:46.496792 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839b8f08-4564-44d8-92a6-628e072de96a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:46.503570 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839b8f08-4564-44d8-92a6-628e072de96a admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:46.547445 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1021/2039] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 02:12:46 2022] POST /identity/v3/users => generated 286 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:46.551528 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acea90da-0591-4eb5-8543-27a0fc53a92e admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:46.584763 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acea90da-0591-4eb5-8543-27a0fc53a92e admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:46.596196 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e0e7ab-0e6d-4d9c-b638-55e6150bfb8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:46.597683 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e0e7ab-0e6d-4d9c-b638-55e6150bfb8b admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:46.598359 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e0e7ab-0e6d-4d9c-b638-55e6150bfb8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:46.598852 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e0e7ab-0e6d-4d9c-b638-55e6150bfb8b admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:46.601911 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e0e7ab-0e6d-4d9c-b638-55e6150bfb8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:46.604123 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e0e7ab-0e6d-4d9c-b638-55e6150bfb8b admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:46.620528 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1019/2040] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:46 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:46.620903 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839b8f08-4564-44d8-92a6-628e072de96a admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:46.634233 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839b8f08-4564-44d8-92a6-628e072de96a admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:46.644084 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb5a509-c225-44e7-a377-6ac9b84ac7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:46.644746 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb5a509-c225-44e7-a377-6ac9b84ac7f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:46.645087 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb5a509-c225-44e7-a377-6ac9b84ac7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:46.645689 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb5a509-c225-44e7-a377-6ac9b84ac7f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:46.646602 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb5a509-c225-44e7-a377-6ac9b84ac7f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:46.650070 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb5a509-c225-44e7-a377-6ac9b84ac7f2 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:46.669761 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1022/2041] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:46 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 29 02:12:46.670596 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e0e7ab-0e6d-4d9c-b638-55e6150bfb8b admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:46.682019 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e0e7ab-0e6d-4d9c-b638-55e6150bfb8b admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:46.686986 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec651456-166e-40f1-8c69-c1f420c207a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:46.687972 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec651456-166e-40f1-8c69-c1f420c207a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:46.688107 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec651456-166e-40f1-8c69-c1f420c207a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:46.688353 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec651456-166e-40f1-8c69-c1f420c207a1 admin admin] PATH_INFO: `/v3/projects/e5ee0732e2d3455a8863b5b97cf86dcd/users/d81afc1d7c574e4588ddea6dba5a094d/roles/f157f905c9c94ccfbfb46e52d443e8f2` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:46.706153 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec651456-166e-40f1-8c69-c1f420c207a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5ee0732e2d3455a8863b5b97cf86dcd, user_id=d81afc1d7c574e4588ddea6dba5a094d, role_id=f157f905c9c94ccfbfb46e52d443e8f2)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:46.709217 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec651456-166e-40f1-8c69-c1f420c207a1 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:46.727813 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1020/2042] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:12:46 2022] PUT /identity/v3/projects/e5ee0732e2d3455a8863b5b97cf86dcd/users/d81afc1d7c574e4588ddea6dba5a094d/roles/f157f905c9c94ccfbfb46e52d443e8f2 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:12:46.729148 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb5a509-c225-44e7-a377-6ac9b84ac7f2 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:46.731226 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-cfb5a509-c225-44e7-a377-6ac9b84ac7f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:46.740955 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c6713-f5bc-47a0-a4b4-62e523b1e006 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:46.741563 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c6713-f5bc-47a0-a4b4-62e523b1e006 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:46.741664 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c6713-f5bc-47a0-a4b4-62e523b1e006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:46.756506 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb5a509-c225-44e7-a377-6ac9b84ac7f2 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:46.792569 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-8d1c6713-f5bc-47a0-a4b4-62e523b1e006 None None] MFA Rules not processed for user `d81afc1d7c574e4588ddea6dba5a094d`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:46.793834 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-8d1c6713-f5bc-47a0-a4b4-62e523b1e006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:46.823818 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26729db2-7692-48ea-acaf-69d209474614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:46.824461 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26729db2-7692-48ea-acaf-69d209474614 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:46.824733 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26729db2-7692-48ea-acaf-69d209474614 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:46.825005 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26729db2-7692-48ea-acaf-69d209474614 admin admin] PATH_INFO: `/v3/projects/c7a1d6f863b14229ae788cb59e7a003a` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:46.826187 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26729db2-7692-48ea-acaf-69d209474614 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7a1d6f863b14229ae788cb59e7a003a)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:46.828123 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26729db2-7692-48ea-acaf-69d209474614 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:46.840598 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:46.845078 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:46.883377 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1021/2043] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:12:46 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:46.886759 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-26729db2-7692-48ea-acaf-69d209474614 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7a1d6f863b14229ae788cb59e7a003a', 'request_id': 'req-26729db2-7692-48ea-acaf-69d209474614'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:46.895739 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-26729db2-7692-48ea-acaf-69d209474614 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7a1d6f863b14229ae788cb59e7a003a', 'request_id': 'req-26729db2-7692-48ea-acaf-69d209474614'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:46.908643 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1c6713-f5bc-47a0-a4b4-62e523b1e006 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:46.910939 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-8d1c6713-f5bc-47a0-a4b4-62e523b1e006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:46.912577 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-26729db2-7692-48ea-acaf-69d209474614 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7a1d6f863b14229ae788cb59e7a003a', 'request_id': 'req-26729db2-7692-48ea-acaf-69d209474614'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:46.930556 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-26729db2-7692-48ea-acaf-69d209474614 admin admin] The token cache is being invalidate because project c7a1d6f863b14229ae788cb59e7a003a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81648) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:12:46.931499 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-26729db2-7692-48ea-acaf-69d209474614 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:46.932347 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-26729db2-7692-48ea-acaf-69d209474614 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:46.936813 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1023/2044] 10.222.0.49 () {58 vars in 1233 bytes} [Thu Sep 29 02:12:46 2022] DELETE /identity/v3/projects/c7a1d6f863b14229ae788cb59e7a003a => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:46.942351 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ea0de6-9411-4545-9b7c-0b51fb19e4ff None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:46.943236 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ea0de6-9411-4545-9b7c-0b51fb19e4ff None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:46.943713 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ea0de6-9411-4545-9b7c-0b51fb19e4ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:46.975045 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-38ea0de6-9411-4545-9b7c-0b51fb19e4ff None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:46.976968 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-38ea0de6-9411-4545-9b7c-0b51fb19e4ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:47.013011 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1c6713-f5bc-47a0-a4b4-62e523b1e006 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:47.081197 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce36dbc6-575d-4768-8231-4566dcae9fd9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d36669146554031ba8596cb583cd6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:47.082232 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce36dbc6-575d-4768-8231-4566dcae9fd9 service glance] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:47.082777 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce36dbc6-575d-4768-8231-4566dcae9fd9 service glance] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:47.083394 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce36dbc6-575d-4768-8231-4566dcae9fd9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:47.086715 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-ce36dbc6-575d-4768-8231-4566dcae9fd9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:47.117960 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1024/2045] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:12:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:47.126569 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cf94ad-a9e0-476c-8d6c-540a8065a5b1 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:47.127008 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cf94ad-a9e0-476c-8d6c-540a8065a5b1 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:47.127399 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cf94ad-a9e0-476c-8d6c-540a8065a5b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:47.177073 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-89cf94ad-a9e0-476c-8d6c-540a8065a5b1 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:47.178454 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-89cf94ad-a9e0-476c-8d6c-540a8065a5b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:47.188368 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1025/2046] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:12:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:47.192954 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cf94ad-a9e0-476c-8d6c-540a8065a5b1 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:47.195643 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce36dbc6-575d-4768-8231-4566dcae9fd9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:47.198706 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce36dbc6-575d-4768-8231-4566dcae9fd9 service glance] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:47.203796 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cf94ad-a9e0-476c-8d6c-540a8065a5b1 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:47.210418 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaca990-4627-4e92-86c4-12c89477fe94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:47.211039 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaca990-4627-4e92-86c4-12c89477fe94 admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:47.211693 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaca990-4627-4e92-86c4-12c89477fe94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:47.212079 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaca990-4627-4e92-86c4-12c89477fe94 admin admin] PATH_INFO: `/v3/domains` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:47.212718 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaca990-4627-4e92-86c4-12c89477fe94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:12:47.213025 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaca990-4627-4e92-86c4-12c89477fe94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:47.213217 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1022/2047] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:46 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:12:47.214816 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaca990-4627-4e92-86c4-12c89477fe94 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:47.233881 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1026/2048] 10.222.0.49 () {58 vars in 1153 bytes} [Thu Sep 29 02:12:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 02:12:47.234780 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce36dbc6-575d-4768-8231-4566dcae9fd9 service glance] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:47.254001 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce36dbc6-575d-4768-8231-4566dcae9fd9 service glance] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:47.259499 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0d618d-5e25-4460-a974-9c3dd5cd01f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:47.260541 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0d618d-5e25-4460-a974-9c3dd5cd01f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:47.260541 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0d618d-5e25-4460-a974-9c3dd5cd01f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:47.260728 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0d618d-5e25-4460-a974-9c3dd5cd01f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:47.261466 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0d618d-5e25-4460-a974-9c3dd5cd01f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:47.263472 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0d618d-5e25-4460-a974-9c3dd5cd01f8 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:47.297842 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1023/2049] 10.222.0.49 () {60 vars in 1153 bytes} [Thu Sep 29 02:12:47 2022] POST /identity/v3/projects => generated 385 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:47.302272 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaca990-4627-4e92-86c4-12c89477fe94 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:47.316209 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaca990-4627-4e92-86c4-12c89477fe94 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:47.393297 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb193f29-fc49-406f-8846-bf5ba77edcd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:47.394330 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb193f29-fc49-406f-8846-bf5ba77edcd7 admin admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:47.394706 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb193f29-fc49-406f-8846-bf5ba77edcd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:47.395045 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb193f29-fc49-406f-8846-bf5ba77edcd7 admin admin] PATH_INFO: `/v3/users` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:47.395818 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb193f29-fc49-406f-8846-bf5ba77edcd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:47.398905 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb193f29-fc49-406f-8846-bf5ba77edcd7 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:47.468114 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0d618d-5e25-4460-a974-9c3dd5cd01f8 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:47.480070 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1027/2050] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 02:12:47 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:47.483065 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0d618d-5e25-4460-a974-9c3dd5cd01f8 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:47.489371 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81146e68-84f5-4bb0-ba94-688727ab718a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:47.490131 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81146e68-84f5-4bb0-ba94-688727ab718a admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:47.490603 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81146e68-84f5-4bb0-ba94-688727ab718a admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:47.491450 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81146e68-84f5-4bb0-ba94-688727ab718a admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:47.492571 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81146e68-84f5-4bb0-ba94-688727ab718a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:47.494302 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81146e68-84f5-4bb0-ba94-688727ab718a admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:47.504770 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:47.524702 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1024/2051] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:47 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:47.524921 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb193f29-fc49-406f-8846-bf5ba77edcd7 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:47.536998 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb193f29-fc49-406f-8846-bf5ba77edcd7 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:47.547749 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f4f4de-caed-4697-b362-fff1c7b82202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:47.548459 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f4f4de-caed-4697-b362-fff1c7b82202 admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:47.548810 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f4f4de-caed-4697-b362-fff1c7b82202 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:47.549159 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f4f4de-caed-4697-b362-fff1c7b82202 admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:47.549856 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f4f4de-caed-4697-b362-fff1c7b82202 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:47.552198 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f4f4de-caed-4697-b362-fff1c7b82202 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:47.558156 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:47.564505 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1028/2052] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:47 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 29 02:12:47.582220 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81146e68-84f5-4bb0-ba94-688727ab718a admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:47.595429 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81146e68-84f5-4bb0-ba94-688727ab718a admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:47.600875 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e271682a-84c5-41d8-8b1e-24c63a51fb38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:47.601829 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e271682a-84c5-41d8-8b1e-24c63a51fb38 admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:47.602195 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e271682a-84c5-41d8-8b1e-24c63a51fb38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:47.602455 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e271682a-84c5-41d8-8b1e-24c63a51fb38 admin admin] PATH_INFO: `/v3/projects/ac2ad26dbb0549c8a9e3b63fa307d5cf/users/01a8d1676d1f43cb96d5ab40f681a60b/roles/f157f905c9c94ccfbfb46e52d443e8f2` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:47.621075 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e271682a-84c5-41d8-8b1e-24c63a51fb38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac2ad26dbb0549c8a9e3b63fa307d5cf, user_id=01a8d1676d1f43cb96d5ab40f681a60b, role_id=f157f905c9c94ccfbfb46e52d443e8f2)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:47.624106 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e271682a-84c5-41d8-8b1e-24c63a51fb38 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:47.640528 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1025/2053] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:12:47 2022] PUT /identity/v3/projects/ac2ad26dbb0549c8a9e3b63fa307d5cf/users/01a8d1676d1f43cb96d5ab40f681a60b/roles/f157f905c9c94ccfbfb46e52d443e8f2 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:47.654913 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d860b4-728a-40b1-89c9-286855cdc0e6 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:47.655258 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d860b4-728a-40b1-89c9-286855cdc0e6 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:47.655678 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d860b4-728a-40b1-89c9-286855cdc0e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:47.690222 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-a4d860b4-728a-40b1-89c9-286855cdc0e6 None None] MFA Rules not processed for user `01a8d1676d1f43cb96d5ab40f681a60b`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:47.691950 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-a4d860b4-728a-40b1-89c9-286855cdc0e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:47.821080 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1029/2054] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:12:47 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:47.833867 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e271682a-84c5-41d8-8b1e-24c63a51fb38 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:47.846048 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-e271682a-84c5-41d8-8b1e-24c63a51fb38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:47.930407 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e271682a-84c5-41d8-8b1e-24c63a51fb38 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:47.934511 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90b6f70-747e-44a3-82ab-74e2a0556138 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75135b856134ba4b9ccac337886f682', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:47.935113 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90b6f70-747e-44a3-82ab-74e2a0556138 service cinder] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:47.935488 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90b6f70-747e-44a3-82ab-74e2a0556138 service cinder] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:47.935764 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90b6f70-747e-44a3-82ab-74e2a0556138 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:47.944989 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90b6f70-747e-44a3-82ab-74e2a0556138 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:47.946623 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90b6f70-747e-44a3-82ab-74e2a0556138 service cinder] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:47.957231 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1026/2055] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:47 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:12:48.245247 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d860b4-728a-40b1-89c9-286855cdc0e6 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:48.248215 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-a4d860b4-728a-40b1-89c9-286855cdc0e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:48.386157 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d860b4-728a-40b1-89c9-286855cdc0e6 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:48.402497 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24fdad3-5404-43d9-a9c8-84e0ae4debdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:48.403904 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24fdad3-5404-43d9-a9c8-84e0ae4debdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:48.404258 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24fdad3-5404-43d9-a9c8-84e0ae4debdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:48.409812 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24fdad3-5404-43d9-a9c8-84e0ae4debdc admin admin] PATH_INFO: `/v3/users/81f3f2d06cc4491f816af4b690aa31ae` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:48.415115 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24fdad3-5404-43d9-a9c8-84e0ae4debdc admin admin] RBAC: Authorizing `identity:delete_user(user_id=81f3f2d06cc4491f816af4b690aa31ae)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:48.417112 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24fdad3-5404-43d9-a9c8-84e0ae4debdc admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:48.486434 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-b24fdad3-5404-43d9-a9c8-84e0ae4debdc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81f3f2d06cc4491f816af4b690aa31ae'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:48.487375 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-b24fdad3-5404-43d9-a9c8-84e0ae4debdc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81f3f2d06cc4491f816af4b690aa31ae'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:48.502222 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-b24fdad3-5404-43d9-a9c8-84e0ae4debdc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81f3f2d06cc4491f816af4b690aa31ae'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:48.513097 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-b24fdad3-5404-43d9-a9c8-84e0ae4debdc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81f3f2d06cc4491f816af4b690aa31ae'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:48.513752 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-b24fdad3-5404-43d9-a9c8-84e0ae4debdc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81f3f2d06cc4491f816af4b690aa31ae'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:48.528569 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1030/2056] 10.222.0.49 () {58 vars in 1224 bytes} [Thu Sep 29 02:12:48 2022] DELETE /identity/v3/users/81f3f2d06cc4491f816af4b690aa31ae => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:48.533023 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc05d0e-82f7-4a64-820e-540cfb89bac4 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:48.533578 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc05d0e-82f7-4a64-820e-540cfb89bac4 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:48.533959 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc05d0e-82f7-4a64-820e-540cfb89bac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:48.555865 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-5cc05d0e-82f7-4a64-820e-540cfb89bac4 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:48.557155 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-5cc05d0e-82f7-4a64-820e-540cfb89bac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:48.622199 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1027/2057] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:12:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:48.632309 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24fdad3-5404-43d9-a9c8-84e0ae4debdc admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:48.633785 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-b24fdad3-5404-43d9-a9c8-84e0ae4debdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:48.650926 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:48.712241 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24fdad3-5404-43d9-a9c8-84e0ae4debdc admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:48.715955 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f807db-f48f-4d3d-aca6-3c80767e6138 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:48.716567 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f807db-f48f-4d3d-aca6-3c80767e6138 service neutron] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:48.716845 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f807db-f48f-4d3d-aca6-3c80767e6138 service neutron] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:48.717110 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f807db-f48f-4d3d-aca6-3c80767e6138 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:48.726321 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f807db-f48f-4d3d-aca6-3c80767e6138 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:48.728377 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f807db-f48f-4d3d-aca6-3c80767e6138 service neutron] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:48.739025 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1031/2058] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:12:49.250245 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc05d0e-82f7-4a64-820e-540cfb89bac4 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:49.253750 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-5cc05d0e-82f7-4a64-820e-540cfb89bac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:49.275597 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc05d0e-82f7-4a64-820e-540cfb89bac4 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:49.290978 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b669f0f7-fba9-472c-8e93-b9b24dc56658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:49.291642 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b669f0f7-fba9-472c-8e93-b9b24dc56658 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:49.291916 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b669f0f7-fba9-472c-8e93-b9b24dc56658 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:49.292180 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b669f0f7-fba9-472c-8e93-b9b24dc56658 admin admin] PATH_INFO: `/v3/projects/6262595fd97144c6960b167f78a13b95` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:49.293358 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b669f0f7-fba9-472c-8e93-b9b24dc56658 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6262595fd97144c6960b167f78a13b95)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:49.295255 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b669f0f7-fba9-472c-8e93-b9b24dc56658 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:49.403244 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-b669f0f7-fba9-472c-8e93-b9b24dc56658 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6262595fd97144c6960b167f78a13b95', 'request_id': 'req-b669f0f7-fba9-472c-8e93-b9b24dc56658'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:49.417463 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-b669f0f7-fba9-472c-8e93-b9b24dc56658 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6262595fd97144c6960b167f78a13b95', 'request_id': 'req-b669f0f7-fba9-472c-8e93-b9b24dc56658'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:49.434158 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-b669f0f7-fba9-472c-8e93-b9b24dc56658 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6262595fd97144c6960b167f78a13b95', 'request_id': 'req-b669f0f7-fba9-472c-8e93-b9b24dc56658'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:49.457463 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-b669f0f7-fba9-472c-8e93-b9b24dc56658 admin admin] The token cache is being invalidate because project 6262595fd97144c6960b167f78a13b95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81649) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:12:49.458035 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-b669f0f7-fba9-472c-8e93-b9b24dc56658 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:49.458998 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-b669f0f7-fba9-472c-8e93-b9b24dc56658 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:49.463719 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1028/2059] 10.222.0.49 () {58 vars in 1233 bytes} [Thu Sep 29 02:12:49 2022] DELETE /identity/v3/projects/6262595fd97144c6960b167f78a13b95 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:49.468778 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf0e6fb-2ae8-430c-a9c6-1aa1a70d7fbc None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:49.469710 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf0e6fb-2ae8-430c-a9c6-1aa1a70d7fbc None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:49.470168 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf0e6fb-2ae8-430c-a9c6-1aa1a70d7fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:49.509764 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-6bf0e6fb-2ae8-430c-a9c6-1aa1a70d7fbc None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:49.510998 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-6bf0e6fb-2ae8-430c-a9c6-1aa1a70d7fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:49.669150 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1032/2060] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:12:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:49.677619 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc6a26c-434e-42c8-bc6d-d0dcc93ff4f2 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:49.677895 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc6a26c-434e-42c8-bc6d-d0dcc93ff4f2 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:49.678198 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc6a26c-434e-42c8-bc6d-d0dcc93ff4f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:49.695448 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:49.722034 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-7bc6a26c-434e-42c8-bc6d-d0dcc93ff4f2 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:49.723694 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-7bc6a26c-434e-42c8-bc6d-d0dcc93ff4f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:49.748483 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1029/2061] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:12:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 29 02:12:49.754110 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf0e6fb-2ae8-430c-a9c6-1aa1a70d7fbc None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:49.776707 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf0e6fb-2ae8-430c-a9c6-1aa1a70d7fbc None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:49.794204 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3026bb94-9b6b-4c10-b124-ee3dbfbd1563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:49.794830 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3026bb94-9b6b-4c10-b124-ee3dbfbd1563 admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:49.795102 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3026bb94-9b6b-4c10-b124-ee3dbfbd1563 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:49.795366 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3026bb94-9b6b-4c10-b124-ee3dbfbd1563 admin admin] PATH_INFO: `/v3/domains` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:49.796016 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3026bb94-9b6b-4c10-b124-ee3dbfbd1563 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:12:49.796314 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3026bb94-9b6b-4c10-b124-ee3dbfbd1563 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:49.797968 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3026bb94-9b6b-4c10-b124-ee3dbfbd1563 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:49.818011 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1033/2062] 10.222.0.49 () {58 vars in 1153 bytes} [Thu Sep 29 02:12:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:12:49.818178 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc6a26c-434e-42c8-bc6d-d0dcc93ff4f2 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:49.831345 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc6a26c-434e-42c8-bc6d-d0dcc93ff4f2 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:49.836713 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e688fee-1181-4526-a598-eced7059f335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:49.837560 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e688fee-1181-4526-a598-eced7059f335 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:49.837946 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e688fee-1181-4526-a598-eced7059f335 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:49.838316 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e688fee-1181-4526-a598-eced7059f335 admin admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:49.839081 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e688fee-1181-4526-a598-eced7059f335 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:49.841803 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e688fee-1181-4526-a598-eced7059f335 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:49.925454 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1030/2063] 10.222.0.49 () {60 vars in 1153 bytes} [Thu Sep 29 02:12:49 2022] POST /identity/v3/projects => generated 375 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 29 02:12:49.926876 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3026bb94-9b6b-4c10-b124-ee3dbfbd1563 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:49.939020 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3026bb94-9b6b-4c10-b124-ee3dbfbd1563 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:50.052809 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c97a96-ee22-4c73-913b-55f54260488a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:50.053619 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c97a96-ee22-4c73-913b-55f54260488a admin admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:50.053879 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c97a96-ee22-4c73-913b-55f54260488a admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:50.054156 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c97a96-ee22-4c73-913b-55f54260488a admin admin] PATH_INFO: `/v3/users` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:50.055069 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c97a96-ee22-4c73-913b-55f54260488a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:50.059300 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c97a96-ee22-4c73-913b-55f54260488a admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:50.092067 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1034/2064] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 02:12:49 2022] POST /identity/v3/users => generated 288 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 29 02:12:50.101520 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e688fee-1181-4526-a598-eced7059f335 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:50.115627 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e688fee-1181-4526-a598-eced7059f335 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:50.122538 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fbb631-5495-4f9e-ad4f-c7de2b865a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:50.123892 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fbb631-5495-4f9e-ad4f-c7de2b865a68 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:50.124290 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fbb631-5495-4f9e-ad4f-c7de2b865a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:50.125815 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fbb631-5495-4f9e-ad4f-c7de2b865a68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:50.126514 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fbb631-5495-4f9e-ad4f-c7de2b865a68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:50.129126 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fbb631-5495-4f9e-ad4f-c7de2b865a68 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:50.147865 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1031/2065] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:50 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:50.148391 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c97a96-ee22-4c73-913b-55f54260488a admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:50.159702 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c97a96-ee22-4c73-913b-55f54260488a admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:50.167124 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e31b57a-e161-45b5-b8a1-10bb3fac4167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:50.167746 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e31b57a-e161-45b5-b8a1-10bb3fac4167 admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:50.168047 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e31b57a-e161-45b5-b8a1-10bb3fac4167 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:50.168354 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e31b57a-e161-45b5-b8a1-10bb3fac4167 admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:50.169196 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e31b57a-e161-45b5-b8a1-10bb3fac4167 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:50.171068 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e31b57a-e161-45b5-b8a1-10bb3fac4167 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:50.184433 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1035/2066] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:50 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:50.188943 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fbb631-5495-4f9e-ad4f-c7de2b865a68 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:50.203084 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fbb631-5495-4f9e-ad4f-c7de2b865a68 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:50.209057 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40f78a9-f75b-4ff3-93bc-fef631798373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:50.209834 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f78a9-f75b-4ff3-93bc-fef631798373 admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:50.210111 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f78a9-f75b-4ff3-93bc-fef631798373 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:50.210380 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f78a9-f75b-4ff3-93bc-fef631798373 admin admin] PATH_INFO: `/v3/projects/2031e00545144e76916976fdf2a20c5c/users/d0664d7ca438434b86d729e79777dbf8/roles/f157f905c9c94ccfbfb46e52d443e8f2` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:50.225860 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40f78a9-f75b-4ff3-93bc-fef631798373 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2031e00545144e76916976fdf2a20c5c, user_id=d0664d7ca438434b86d729e79777dbf8, role_id=f157f905c9c94ccfbfb46e52d443e8f2)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:50.228829 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40f78a9-f75b-4ff3-93bc-fef631798373 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:50.244342 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1032/2067] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:12:50 2022] PUT /identity/v3/projects/2031e00545144e76916976fdf2a20c5c/users/d0664d7ca438434b86d729e79777dbf8/roles/f157f905c9c94ccfbfb46e52d443e8f2 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:50.254653 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398d4f34-d231-4cee-b7c2-1e1d4e3604e1 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:50.254949 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398d4f34-d231-4cee-b7c2-1e1d4e3604e1 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:50.255458 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398d4f34-d231-4cee-b7c2-1e1d4e3604e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:50.289516 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-398d4f34-d231-4cee-b7c2-1e1d4e3604e1 None None] MFA Rules not processed for user `d0664d7ca438434b86d729e79777dbf8`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:50.290958 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-398d4f34-d231-4cee-b7c2-1e1d4e3604e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:50.297928 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:50.400776 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1036/2068] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:12:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:50.414384 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40f78a9-f75b-4ff3-93bc-fef631798373 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:50.416736 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-e40f78a9-f75b-4ff3-93bc-fef631798373 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:50.490813 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40f78a9-f75b-4ff3-93bc-fef631798373 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:50.496405 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d7d464-ce3a-4984-8f5d-6d50ee43e8b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75135b856134ba4b9ccac337886f682', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:50.497046 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d7d464-ce3a-4984-8f5d-6d50ee43e8b1 service cinder] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:50.497340 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d7d464-ce3a-4984-8f5d-6d50ee43e8b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:50.497614 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d7d464-ce3a-4984-8f5d-6d50ee43e8b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:50.507239 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d7d464-ce3a-4984-8f5d-6d50ee43e8b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:50.508835 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d7d464-ce3a-4984-8f5d-6d50ee43e8b1 service cinder] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:50.520915 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1033/2069] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:12:51.090042 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398d4f34-d231-4cee-b7c2-1e1d4e3604e1 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:51.091739 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-398d4f34-d231-4cee-b7c2-1e1d4e3604e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:51.179636 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398d4f34-d231-4cee-b7c2-1e1d4e3604e1 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:51.186497 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254f40de-429a-4ff6-b6d7-79e29716afc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:51.187547 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f40de-429a-4ff6-b6d7-79e29716afc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:51.188022 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f40de-429a-4ff6-b6d7-79e29716afc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:51.188487 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f40de-429a-4ff6-b6d7-79e29716afc9 admin admin] PATH_INFO: `/v3/users/01a8d1676d1f43cb96d5ab40f681a60b` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:51.190489 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254f40de-429a-4ff6-b6d7-79e29716afc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01a8d1676d1f43cb96d5ab40f681a60b)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:51.192753 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254f40de-429a-4ff6-b6d7-79e29716afc9 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:51.262633 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-254f40de-429a-4ff6-b6d7-79e29716afc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01a8d1676d1f43cb96d5ab40f681a60b'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:51.263646 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-254f40de-429a-4ff6-b6d7-79e29716afc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01a8d1676d1f43cb96d5ab40f681a60b'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:51.290480 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-254f40de-429a-4ff6-b6d7-79e29716afc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01a8d1676d1f43cb96d5ab40f681a60b'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:51.300329 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-254f40de-429a-4ff6-b6d7-79e29716afc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01a8d1676d1f43cb96d5ab40f681a60b'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:51.301038 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-254f40de-429a-4ff6-b6d7-79e29716afc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01a8d1676d1f43cb96d5ab40f681a60b'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:51.318231 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1037/2070] 10.222.0.49 () {58 vars in 1224 bytes} [Thu Sep 29 02:12:51 2022] DELETE /identity/v3/users/01a8d1676d1f43cb96d5ab40f681a60b => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:51.322704 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc8a89e-bbb6-492a-a05d-41946735cf3a None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:51.322999 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc8a89e-bbb6-492a-a05d-41946735cf3a None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:51.323272 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc8a89e-bbb6-492a-a05d-41946735cf3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:51.351536 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-adc8a89e-bbb6-492a-a05d-41946735cf3a None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:51.352791 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-adc8a89e-bbb6-492a-a05d-41946735cf3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:51.443179 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1034/2071] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:12:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:51.454814 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254f40de-429a-4ff6-b6d7-79e29716afc9 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:51.456466 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-254f40de-429a-4ff6-b6d7-79e29716afc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:51.514045 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:51.548638 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254f40de-429a-4ff6-b6d7-79e29716afc9 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:51.552406 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe457f0-fb8a-425a-858b-8fb9688fbaf1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:51.552990 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe457f0-fb8a-425a-858b-8fb9688fbaf1 service neutron] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:51.553366 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe457f0-fb8a-425a-858b-8fb9688fbaf1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:51.553826 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe457f0-fb8a-425a-858b-8fb9688fbaf1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:51.564288 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe457f0-fb8a-425a-858b-8fb9688fbaf1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:51.565798 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe457f0-fb8a-425a-858b-8fb9688fbaf1 service neutron] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:51.577650 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1038/2072] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:12:51.937559 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc8a89e-bbb6-492a-a05d-41946735cf3a None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:51.939002 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-adc8a89e-bbb6-492a-a05d-41946735cf3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:51.957754 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc8a89e-bbb6-492a-a05d-41946735cf3a None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:51.974992 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd64cc4-2981-4f92-8edc-7674ef3623d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:51.978170 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd64cc4-2981-4f92-8edc-7674ef3623d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:51.978635 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd64cc4-2981-4f92-8edc-7674ef3623d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:51.979092 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd64cc4-2981-4f92-8edc-7674ef3623d5 admin admin] PATH_INFO: `/v3/projects/ac2ad26dbb0549c8a9e3b63fa307d5cf` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:51.993587 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd64cc4-2981-4f92-8edc-7674ef3623d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac2ad26dbb0549c8a9e3b63fa307d5cf)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:51.998102 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd64cc4-2981-4f92-8edc-7674ef3623d5 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:52.091269 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:52.107366 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-9cd64cc4-2981-4f92-8edc-7674ef3623d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac2ad26dbb0549c8a9e3b63fa307d5cf', 'request_id': 'req-9cd64cc4-2981-4f92-8edc-7674ef3623d5'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:52.118749 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-9cd64cc4-2981-4f92-8edc-7674ef3623d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac2ad26dbb0549c8a9e3b63fa307d5cf', 'request_id': 'req-9cd64cc4-2981-4f92-8edc-7674ef3623d5'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:52.130359 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-9cd64cc4-2981-4f92-8edc-7674ef3623d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac2ad26dbb0549c8a9e3b63fa307d5cf', 'request_id': 'req-9cd64cc4-2981-4f92-8edc-7674ef3623d5'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:52.145614 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-9cd64cc4-2981-4f92-8edc-7674ef3623d5 admin admin] The token cache is being invalidate because project ac2ad26dbb0549c8a9e3b63fa307d5cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81649) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:12:52.145891 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-9cd64cc4-2981-4f92-8edc-7674ef3623d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:52.146681 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-9cd64cc4-2981-4f92-8edc-7674ef3623d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:12:52.150432 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1035/2073] 10.222.0.49 () {58 vars in 1233 bytes} [Thu Sep 29 02:12:51 2022] DELETE /identity/v3/projects/ac2ad26dbb0549c8a9e3b63fa307d5cf => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:52.155379 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4720f61e-9791-48be-8ec6-5960ab453a0e None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:52.155862 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4720f61e-9791-48be-8ec6-5960ab453a0e None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:52.155976 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4720f61e-9791-48be-8ec6-5960ab453a0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:52.193223 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-4720f61e-9791-48be-8ec6-5960ab453a0e None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:52.194975 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-4720f61e-9791-48be-8ec6-5960ab453a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:52.299867 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1039/2074] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:12:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 29 02:12:52.301175 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ccc6db-39f0-4f57-ba79-d3728a933d5e None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:52.301587 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ccc6db-39f0-4f57-ba79-d3728a933d5e None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:52.301913 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ccc6db-39f0-4f57-ba79-d3728a933d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:52.335717 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-71ccc6db-39f0-4f57-ba79-d3728a933d5e None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:52.335717 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-71ccc6db-39f0-4f57-ba79-d3728a933d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:52.355523 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1036/2075] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:12:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:52.360962 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4720f61e-9791-48be-8ec6-5960ab453a0e None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:52.375010 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4720f61e-9791-48be-8ec6-5960ab453a0e None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:52.382233 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fa3b1b-d0d7-4841-96b9-599a1cdfe5c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:52.383073 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa3b1b-d0d7-4841-96b9-599a1cdfe5c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:52.383352 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa3b1b-d0d7-4841-96b9-599a1cdfe5c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:52.384347 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa3b1b-d0d7-4841-96b9-599a1cdfe5c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:52.385022 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fa3b1b-d0d7-4841-96b9-599a1cdfe5c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:12:52.385342 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fa3b1b-d0d7-4841-96b9-599a1cdfe5c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:52.388113 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fa3b1b-d0d7-4841-96b9-599a1cdfe5c3 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:52.403119 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1040/2076] 10.222.0.49 () {58 vars in 1153 bytes} [Thu Sep 29 02:12:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:12:52.407650 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ccc6db-39f0-4f57-ba79-d3728a933d5e None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:52.417908 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ccc6db-39f0-4f57-ba79-d3728a933d5e None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:52.423093 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0b3ae8-c50c-4d62-9647-56f1e1aede88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:52.423710 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0b3ae8-c50c-4d62-9647-56f1e1aede88 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:52.423985 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0b3ae8-c50c-4d62-9647-56f1e1aede88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:52.424251 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0b3ae8-c50c-4d62-9647-56f1e1aede88 admin admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:52.425036 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0b3ae8-c50c-4d62-9647-56f1e1aede88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:52.427152 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0b3ae8-c50c-4d62-9647-56f1e1aede88 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:52.457032 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1037/2077] 10.222.0.49 () {60 vars in 1153 bytes} [Thu Sep 29 02:12:52 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:52.469250 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fa3b1b-d0d7-4841-96b9-599a1cdfe5c3 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:52.480331 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fa3b1b-d0d7-4841-96b9-599a1cdfe5c3 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:52.542587 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240d626b-87f4-499d-ae1b-5c6f5d0a3ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:52.543241 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d626b-87f4-499d-ae1b-5c6f5d0a3ddc admin admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:52.543517 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d626b-87f4-499d-ae1b-5c6f5d0a3ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:52.543781 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d626b-87f4-499d-ae1b-5c6f5d0a3ddc admin admin] PATH_INFO: `/v3/users` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:52.544444 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240d626b-87f4-499d-ae1b-5c6f5d0a3ddc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:52.546389 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240d626b-87f4-499d-ae1b-5c6f5d0a3ddc admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:52.567907 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1041/2078] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 02:12:52 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:12:52.572381 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0b3ae8-c50c-4d62-9647-56f1e1aede88 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:52.582781 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0b3ae8-c50c-4d62-9647-56f1e1aede88 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:52.588209 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a70e0f-3771-4b42-aa2c-d85fc7d10a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:52.588836 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a70e0f-3771-4b42-aa2c-d85fc7d10a85 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:52.589116 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a70e0f-3771-4b42-aa2c-d85fc7d10a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:52.589410 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a70e0f-3771-4b42-aa2c-d85fc7d10a85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:52.590067 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a70e0f-3771-4b42-aa2c-d85fc7d10a85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:52.591650 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a70e0f-3771-4b42-aa2c-d85fc7d10a85 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:52.607571 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1038/2079] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:52.609010 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240d626b-87f4-499d-ae1b-5c6f5d0a3ddc admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:52.620130 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240d626b-87f4-499d-ae1b-5c6f5d0a3ddc admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:52.624976 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d435fbd1-8d67-4e94-85ed-e9db27b5be88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:52.625644 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d435fbd1-8d67-4e94-85ed-e9db27b5be88 admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:52.625930 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d435fbd1-8d67-4e94-85ed-e9db27b5be88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:52.626203 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d435fbd1-8d67-4e94-85ed-e9db27b5be88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:52.626843 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d435fbd1-8d67-4e94-85ed-e9db27b5be88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:52.628598 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d435fbd1-8d67-4e94-85ed-e9db27b5be88 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:52.639984 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1042/2080] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:12:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:12:52.644555 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a70e0f-3771-4b42-aa2c-d85fc7d10a85 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:52.659673 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a70e0f-3771-4b42-aa2c-d85fc7d10a85 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:52.667003 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4650c1-8b71-4cfe-95ef-cada1028a806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:52.667683 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4650c1-8b71-4cfe-95ef-cada1028a806 admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:52.667967 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4650c1-8b71-4cfe-95ef-cada1028a806 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:52.670891 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4650c1-8b71-4cfe-95ef-cada1028a806 admin admin] PATH_INFO: `/v3/projects/83d6d83a248e44d19dacfd099f475c1b/users/7e8180ddc8a04f15be71010fa83b7340/roles/f157f905c9c94ccfbfb46e52d443e8f2` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:52.694476 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4650c1-8b71-4cfe-95ef-cada1028a806 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83d6d83a248e44d19dacfd099f475c1b, user_id=7e8180ddc8a04f15be71010fa83b7340, role_id=f157f905c9c94ccfbfb46e52d443e8f2)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:52.697599 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4650c1-8b71-4cfe-95ef-cada1028a806 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:52.713658 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1039/2081] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:12:52 2022] PUT /identity/v3/projects/83d6d83a248e44d19dacfd099f475c1b/users/7e8180ddc8a04f15be71010fa83b7340/roles/f157f905c9c94ccfbfb46e52d443e8f2 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:12:52.725756 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89e8d37-d23e-44f7-a041-de682d087434 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:52.726060 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89e8d37-d23e-44f7-a041-de682d087434 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:52.726405 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89e8d37-d23e-44f7-a041-de682d087434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:52.767412 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-f89e8d37-d23e-44f7-a041-de682d087434 None None] MFA Rules not processed for user `7e8180ddc8a04f15be71010fa83b7340`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:52.768647 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-f89e8d37-d23e-44f7-a041-de682d087434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:52.801748 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:52.862166 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1043/2082] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:12:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:52.873864 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4650c1-8b71-4cfe-95ef-cada1028a806 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:52.876325 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-cc4650c1-8b71-4cfe-95ef-cada1028a806 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:52.971836 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4650c1-8b71-4cfe-95ef-cada1028a806 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:52.977774 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1214e6b-7c49-4184-a1c6-747df27a66a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75135b856134ba4b9ccac337886f682', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:52.978564 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1214e6b-7c49-4184-a1c6-747df27a66a5 service cinder] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:52.979196 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1214e6b-7c49-4184-a1c6-747df27a66a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:52.979471 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1214e6b-7c49-4184-a1c6-747df27a66a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:52.991699 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1214e6b-7c49-4184-a1c6-747df27a66a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:52.993438 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1214e6b-7c49-4184-a1c6-747df27a66a5 service cinder] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:53.016298 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1040/2083] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:12:54.545072 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cce35a-ede6-41a6-8c0a-1a13a5344d75 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:54.545660 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cce35a-ede6-41a6-8c0a-1a13a5344d75 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:54.545660 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cce35a-ede6-41a6-8c0a-1a13a5344d75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:54.565959 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-c3cce35a-ede6-41a6-8c0a-1a13a5344d75 None None] MFA Rules not processed for user `7e8180ddc8a04f15be71010fa83b7340`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:12:54.567174 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-c3cce35a-ede6-41a6-8c0a-1a13a5344d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:54.574632 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1044/2084] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:12:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:12:57.722548 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1214e6b-7c49-4184-a1c6-747df27a66a5 service cinder] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:12:57.723987 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-b1214e6b-7c49-4184-a1c6-747df27a66a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:57.736357 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1214e6b-7c49-4184-a1c6-747df27a66a5 service cinder] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:12:57.741550 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc3c12c-f314-45db-ab82-b1cb493390f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75135b856134ba4b9ccac337886f682', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:12:57.742156 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc3c12c-f314-45db-ab82-b1cb493390f4 service cinder] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:12:57.742434 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc3c12c-f314-45db-ab82-b1cb493390f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:12:57.742704 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc3c12c-f314-45db-ab82-b1cb493390f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:12:57.744481 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-cdc3c12c-f314-45db-ab82-b1cb493390f4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:12:57.818070 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc3c12c-f314-45db-ab82-b1cb493390f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:12:57.820652 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc3c12c-f314-45db-ab82-b1cb493390f4 service cinder] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:12:57.825043 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:57.832921 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1041/2085] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:12:57 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:13:04.214724 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b47eeb0-d378-4a5a-b9f8-00d4f3c2181e None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:04.215265 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b47eeb0-d378-4a5a-b9f8-00d4f3c2181e None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:04.215355 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b47eeb0-d378-4a5a-b9f8-00d4f3c2181e None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:04.216661 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1045/2086] 10.222.0.49 () {54 vars in 921 bytes} [Thu Sep 29 02:13:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:13:04.255398 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6229a31b-bbd2-4655-8ed7-5c7323ea0a8a None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:04.256424 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6229a31b-bbd2-4655-8ed7-5c7323ea0a8a None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:04.256705 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6229a31b-bbd2-4655-8ed7-5c7323ea0a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:04.284567 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-6229a31b-bbd2-4655-8ed7-5c7323ea0a8a None None] MFA Rules not processed for user `3cbb39731a6b42e2a6647d6134b5c7cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:04.286528 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-6229a31b-bbd2-4655-8ed7-5c7323ea0a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:04.303962 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b47eeb0-d378-4a5a-b9f8-00d4f3c2181e None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:04.306355 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-5b47eeb0-d378-4a5a-b9f8-00d4f3c2181e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:04.367113 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1042/2087] 10.222.0.49 () {58 vars in 1018 bytes} [Thu Sep 29 02:13:04 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 29 02:13:04.377892 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6229a31b-bbd2-4655-8ed7-5c7323ea0a8a None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:04.379399 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-6229a31b-bbd2-4655-8ed7-5c7323ea0a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:04.382774 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b47eeb0-d378-4a5a-b9f8-00d4f3c2181e None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:04.387380 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbc3888-7ec2-4d59-8e4d-bfc063233aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:04.388407 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbc3888-7ec2-4d59-8e4d-bfc063233aed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:04.388715 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbc3888-7ec2-4d59-8e4d-bfc063233aed admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:04.388973 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbc3888-7ec2-4d59-8e4d-bfc063233aed admin admin] PATH_INFO: `/v3/users/c7415274ccbd446fb4704389e1e68b9b` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:04.390211 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbc3888-7ec2-4d59-8e4d-bfc063233aed admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7415274ccbd446fb4704389e1e68b9b)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:04.392212 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbc3888-7ec2-4d59-8e4d-bfc063233aed admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:04.394555 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6229a31b-bbd2-4655-8ed7-5c7323ea0a8a None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:04.400813 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ffab49-b2c6-4a37-be9b-11d39683a255 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cbb39731a6b42e2a6647d6134b5c7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:04.401511 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ffab49-b2c6-4a37-be9b-11d39683a255 service placement] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:04.401939 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ffab49-b2c6-4a37-be9b-11d39683a255 service placement] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:04.402344 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ffab49-b2c6-4a37-be9b-11d39683a255 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:04.412247 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ffab49-b2c6-4a37-be9b-11d39683a255 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:04.414257 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ffab49-b2c6-4a37-be9b-11d39683a255 service placement] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:04.424942 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1043/2088] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:13:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 29 02:13:04.444396 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-dbbc3888-7ec2-4d59-8e4d-bfc063233aed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7415274ccbd446fb4704389e1e68b9b'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:04.445094 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-dbbc3888-7ec2-4d59-8e4d-bfc063233aed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7415274ccbd446fb4704389e1e68b9b'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:04.460028 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-dbbc3888-7ec2-4d59-8e4d-bfc063233aed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7415274ccbd446fb4704389e1e68b9b'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:04.469412 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-dbbc3888-7ec2-4d59-8e4d-bfc063233aed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7415274ccbd446fb4704389e1e68b9b'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:04.470039 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-dbbc3888-7ec2-4d59-8e4d-bfc063233aed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7415274ccbd446fb4704389e1e68b9b'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:04.485111 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1046/2089] 10.222.0.49 () {58 vars in 1224 bytes} [Thu Sep 29 02:13:04 2022] DELETE /identity/v3/users/c7415274ccbd446fb4704389e1e68b9b => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:13:04.666681 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ffab49-b2c6-4a37-be9b-11d39683a255 service placement] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:04.684809 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ffab49-b2c6-4a37-be9b-11d39683a255 service placement] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:04.750045 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f3beb0-dc3e-4e58-8b1f-3572780ecf99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:04.750753 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f3beb0-dc3e-4e58-8b1f-3572780ecf99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:04.751073 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f3beb0-dc3e-4e58-8b1f-3572780ecf99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:04.751387 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f3beb0-dc3e-4e58-8b1f-3572780ecf99 admin admin] PATH_INFO: `/v3/projects/8584701589bf4c849d7eba7a7d3138e3` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:04.752576 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f3beb0-dc3e-4e58-8b1f-3572780ecf99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8584701589bf4c849d7eba7a7d3138e3)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:04.754714 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f3beb0-dc3e-4e58-8b1f-3572780ecf99 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:04.802141 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-a3f3beb0-dc3e-4e58-8b1f-3572780ecf99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8584701589bf4c849d7eba7a7d3138e3', 'request_id': 'req-a3f3beb0-dc3e-4e58-8b1f-3572780ecf99'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:04.808578 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-a3f3beb0-dc3e-4e58-8b1f-3572780ecf99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8584701589bf4c849d7eba7a7d3138e3', 'request_id': 'req-a3f3beb0-dc3e-4e58-8b1f-3572780ecf99'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:04.816270 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-a3f3beb0-dc3e-4e58-8b1f-3572780ecf99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8584701589bf4c849d7eba7a7d3138e3', 'request_id': 'req-a3f3beb0-dc3e-4e58-8b1f-3572780ecf99'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:04.826779 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-a3f3beb0-dc3e-4e58-8b1f-3572780ecf99 admin admin] The token cache is being invalidate because project 8584701589bf4c849d7eba7a7d3138e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81649) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:13:04.827066 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-a3f3beb0-dc3e-4e58-8b1f-3572780ecf99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:04.827695 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-a3f3beb0-dc3e-4e58-8b1f-3572780ecf99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:04.829169 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1044/2090] 10.222.0.49 () {58 vars in 1233 bytes} [Thu Sep 29 02:13:04 2022] DELETE /identity/v3/projects/8584701589bf4c849d7eba7a7d3138e3 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:13:04.834960 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e321e-c444-42b5-8b61-a072c1bd08ed None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:04.835196 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e321e-c444-42b5-8b61-a072c1bd08ed None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:04.835498 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e321e-c444-42b5-8b61-a072c1bd08ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:04.857584 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-b25e321e-c444-42b5-8b61-a072c1bd08ed None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:04.858859 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-b25e321e-c444-42b5-8b61-a072c1bd08ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:04.894867 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:04.948752 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1047/2091] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:13:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:13:04.956666 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309f886f-a351-4ae9-859d-bbe40768b4dd None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:04.956932 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309f886f-a351-4ae9-859d-bbe40768b4dd None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:04.957210 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309f886f-a351-4ae9-859d-bbe40768b4dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:04.979123 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-309f886f-a351-4ae9-859d-bbe40768b4dd None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:04.980360 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-309f886f-a351-4ae9-859d-bbe40768b4dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:04.989274 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1045/2092] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:13:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:13:04.994398 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25e321e-c444-42b5-8b61-a072c1bd08ed None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:05.007674 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25e321e-c444-42b5-8b61-a072c1bd08ed None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:05.012397 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3b63b5-4153-42cc-a373-5190f136dd6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:05.013025 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b63b5-4153-42cc-a373-5190f136dd6a admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:05.013329 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b63b5-4153-42cc-a373-5190f136dd6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:05.014257 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b63b5-4153-42cc-a373-5190f136dd6a admin admin] PATH_INFO: `/v3/domains` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:05.014913 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3b63b5-4153-42cc-a373-5190f136dd6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:13:05.015215 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3b63b5-4153-42cc-a373-5190f136dd6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:05.016812 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3b63b5-4153-42cc-a373-5190f136dd6a admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:05.030222 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309f886f-a351-4ae9-859d-bbe40768b4dd None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:05.031639 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-309f886f-a351-4ae9-859d-bbe40768b4dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:05.034098 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1048/2093] 10.222.0.49 () {58 vars in 1153 bytes} [Thu Sep 29 02:13:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:13:05.034975 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3b63b5-4153-42cc-a373-5190f136dd6a admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:05.040732 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:05.044718 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309f886f-a351-4ae9-859d-bbe40768b4dd None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:05.046727 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3b63b5-4153-42cc-a373-5190f136dd6a admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:05.051194 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafab1c2-0286-489a-92b9-6ff564b12042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:05.052014 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ed7c0d-ff89-41fd-b30e-068a2589fe10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:05.052451 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafab1c2-0286-489a-92b9-6ff564b12042 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:05.052844 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafab1c2-0286-489a-92b9-6ff564b12042 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:05.053050 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed7c0d-ff89-41fd-b30e-068a2589fe10 admin admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:05.053586 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafab1c2-0286-489a-92b9-6ff564b12042 admin admin] PATH_INFO: `/v3/users/d0664d7ca438434b86d729e79777dbf8` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:05.055287 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafab1c2-0286-489a-92b9-6ff564b12042 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0664d7ca438434b86d729e79777dbf8)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:05.056299 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed7c0d-ff89-41fd-b30e-068a2589fe10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:05.056614 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed7c0d-ff89-41fd-b30e-068a2589fe10 admin admin] PATH_INFO: `/v3/projects` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:05.057303 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ed7c0d-ff89-41fd-b30e-068a2589fe10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:05.057675 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafab1c2-0286-489a-92b9-6ff564b12042 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:05.059274 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ed7c0d-ff89-41fd-b30e-068a2589fe10 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:05.089563 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1049/2094] 10.222.0.49 () {60 vars in 1153 bytes} [Thu Sep 29 02:13:05 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:13:05.093783 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ed7c0d-ff89-41fd-b30e-068a2589fe10 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:05.111824 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-dafab1c2-0286-489a-92b9-6ff564b12042 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0664d7ca438434b86d729e79777dbf8'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:05.112571 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-dafab1c2-0286-489a-92b9-6ff564b12042 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0664d7ca438434b86d729e79777dbf8'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:05.129861 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-dafab1c2-0286-489a-92b9-6ff564b12042 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0664d7ca438434b86d729e79777dbf8'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:05.143615 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-dafab1c2-0286-489a-92b9-6ff564b12042 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0664d7ca438434b86d729e79777dbf8'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:05.145387 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-dafab1c2-0286-489a-92b9-6ff564b12042 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0664d7ca438434b86d729e79777dbf8'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:05.165444 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1046/2095] 10.222.0.49 () {58 vars in 1224 bytes} [Thu Sep 29 02:13:05 2022] DELETE /identity/v3/users/d0664d7ca438434b86d729e79777dbf8 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:13:05.169839 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9556dcf1-59b4-4ec4-ac5f-7f38f03f9d38 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:05.170132 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9556dcf1-59b4-4ec4-ac5f-7f38f03f9d38 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:05.170430 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9556dcf1-59b4-4ec4-ac5f-7f38f03f9d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:05.171456 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ed7c0d-ff89-41fd-b30e-068a2589fe10 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:05.196966 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-9556dcf1-59b4-4ec4-ac5f-7f38f03f9d38 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:05.198289 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-9556dcf1-59b4-4ec4-ac5f-7f38f03f9d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:05.258288 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc4e300-262e-4768-af65-acfd54c27961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:05.259357 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc4e300-262e-4768-af65-acfd54c27961 admin admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:05.259647 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc4e300-262e-4768-af65-acfd54c27961 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:05.260006 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc4e300-262e-4768-af65-acfd54c27961 admin admin] PATH_INFO: `/v3/users` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:05.261238 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc4e300-262e-4768-af65-acfd54c27961 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:05.263948 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc4e300-262e-4768-af65-acfd54c27961 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:05.282953 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1047/2096] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:13:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 29 02:13:05.295960 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1050/2097] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 02:13:05 2022] POST /identity/v3/users => generated 292 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 29 02:13:05.296342 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9556dcf1-59b4-4ec4-ac5f-7f38f03f9d38 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:05.297861 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-9556dcf1-59b4-4ec4-ac5f-7f38f03f9d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:05.301902 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc4e300-262e-4768-af65-acfd54c27961 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:05.309238 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-2dc4e300-262e-4768-af65-acfd54c27961 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:05.328364 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc4e300-262e-4768-af65-acfd54c27961 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:05.335938 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd61e6eb-1f29-47ba-86ec-642d551ba7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:05.337011 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd61e6eb-1f29-47ba-86ec-642d551ba7cc admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:05.337109 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd61e6eb-1f29-47ba-86ec-642d551ba7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:05.337503 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd61e6eb-1f29-47ba-86ec-642d551ba7cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:05.338267 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd61e6eb-1f29-47ba-86ec-642d551ba7cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:05.340435 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd61e6eb-1f29-47ba-86ec-642d551ba7cc admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:05.360682 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1051/2098] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:13:05 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:13:05.365875 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd61e6eb-1f29-47ba-86ec-642d551ba7cc admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:05.382592 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd61e6eb-1f29-47ba-86ec-642d551ba7cc admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:05.400528 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aa990c-3928-485c-b819-4bff2237db34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:05.402610 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aa990c-3928-485c-b819-4bff2237db34 admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:05.403132 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aa990c-3928-485c-b819-4bff2237db34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:05.403992 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9556dcf1-59b4-4ec4-ac5f-7f38f03f9d38 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:05.404656 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aa990c-3928-485c-b819-4bff2237db34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:05.405543 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aa990c-3928-485c-b819-4bff2237db34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:05.407978 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80f6ec1-92ba-4157-a909-fe17711d2b0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:05.408587 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80f6ec1-92ba-4157-a909-fe17711d2b0f service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:05.408860 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80f6ec1-92ba-4157-a909-fe17711d2b0f service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:05.409679 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aa990c-3928-485c-b819-4bff2237db34 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:05.409807 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80f6ec1-92ba-4157-a909-fe17711d2b0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:05.429105 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80f6ec1-92ba-4157-a909-fe17711d2b0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:05.433657 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80f6ec1-92ba-4157-a909-fe17711d2b0f service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:05.437916 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1052/2099] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:13:05 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:13:05.439372 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aa990c-3928-485c-b819-4bff2237db34 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:05.453480 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aa990c-3928-485c-b819-4bff2237db34 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:05.457740 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1048/2100] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:13:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 29 02:13:05.460833 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b36a74-1abf-4a0a-bad1-e5ecea129903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:05.461718 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b36a74-1abf-4a0a-bad1-e5ecea129903 admin admin] REQUEST_METHOD: `PUT` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:05.462115 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b36a74-1abf-4a0a-bad1-e5ecea129903 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:05.462493 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b36a74-1abf-4a0a-bad1-e5ecea129903 admin admin] PATH_INFO: `/v3/projects/7aff9cdde28d44d8801462a74a8f216e/users/071f5b08a78f46fa99e3bc1c9feb876b/roles/f157f905c9c94ccfbfb46e52d443e8f2` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:05.480390 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b36a74-1abf-4a0a-bad1-e5ecea129903 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7aff9cdde28d44d8801462a74a8f216e, user_id=071f5b08a78f46fa99e3bc1c9feb876b, role_id=f157f905c9c94ccfbfb46e52d443e8f2)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:05.483204 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b36a74-1abf-4a0a-bad1-e5ecea129903 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:05.486439 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:05.507683 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1053/2101] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:13:05 2022] PUT /identity/v3/projects/7aff9cdde28d44d8801462a74a8f216e/users/071f5b08a78f46fa99e3bc1c9feb876b/roles/f157f905c9c94ccfbfb46e52d443e8f2 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:13:05.518978 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f436f86-17a1-44e7-868c-22649f0d73f2 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:05.519328 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f436f86-17a1-44e7-868c-22649f0d73f2 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:05.519534 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f436f86-17a1-44e7-868c-22649f0d73f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:05.573172 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-3f436f86-17a1-44e7-868c-22649f0d73f2 None None] MFA Rules not processed for user `071f5b08a78f46fa99e3bc1c9feb876b`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:05.574409 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-3f436f86-17a1-44e7-868c-22649f0d73f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:05.585381 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:05.689363 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1049/2102] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:13:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:13:05.700473 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b36a74-1abf-4a0a-bad1-e5ecea129903 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:05.702497 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-d9b36a74-1abf-4a0a-bad1-e5ecea129903 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:05.781406 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f436f86-17a1-44e7-868c-22649f0d73f2 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:05.783002 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-3f436f86-17a1-44e7-868c-22649f0d73f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:05.784948 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b36a74-1abf-4a0a-bad1-e5ecea129903 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:05.793383 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7306f6f-c693-450b-81c3-291a6872c0b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3325a7111d447f4a9cf00c672d5420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:05.794025 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7306f6f-c693-450b-81c3-291a6872c0b4 service nova] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:05.794288 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7306f6f-c693-450b-81c3-291a6872c0b4 service nova] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:05.794557 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7306f6f-c693-450b-81c3-291a6872c0b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:05.803965 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7306f6f-c693-450b-81c3-291a6872c0b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:05.805589 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7306f6f-c693-450b-81c3-291a6872c0b4 service nova] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:05.816715 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1054/2103] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:13:05 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:13:05.855092 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f436f86-17a1-44e7-868c-22649f0d73f2 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:05.860233 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99445872-4e02-4599-9035-5c7be1c07845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:05.860932 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99445872-4e02-4599-9035-5c7be1c07845 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:05.861215 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99445872-4e02-4599-9035-5c7be1c07845 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:05.861509 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99445872-4e02-4599-9035-5c7be1c07845 admin admin] PATH_INFO: `/v3/projects/2031e00545144e76916976fdf2a20c5c` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:05.862628 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99445872-4e02-4599-9035-5c7be1c07845 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2031e00545144e76916976fdf2a20c5c)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:05.864520 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99445872-4e02-4599-9035-5c7be1c07845 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:05.924837 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-99445872-4e02-4599-9035-5c7be1c07845 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2031e00545144e76916976fdf2a20c5c', 'request_id': 'req-99445872-4e02-4599-9035-5c7be1c07845'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:05.933347 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-99445872-4e02-4599-9035-5c7be1c07845 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2031e00545144e76916976fdf2a20c5c', 'request_id': 'req-99445872-4e02-4599-9035-5c7be1c07845'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:05.941000 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-99445872-4e02-4599-9035-5c7be1c07845 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2031e00545144e76916976fdf2a20c5c', 'request_id': 'req-99445872-4e02-4599-9035-5c7be1c07845'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:05.955120 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-99445872-4e02-4599-9035-5c7be1c07845 admin admin] The token cache is being invalidate because project 2031e00545144e76916976fdf2a20c5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81649) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:13:05.955416 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-99445872-4e02-4599-9035-5c7be1c07845 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:05.956326 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-99445872-4e02-4599-9035-5c7be1c07845 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:05.958476 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1050/2104] 10.222.0.49 () {58 vars in 1233 bytes} [Thu Sep 29 02:13:05 2022] DELETE /identity/v3/projects/2031e00545144e76916976fdf2a20c5c => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:13:05.963260 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef9dc4-fbb6-4341-bd4d-6f921cede308 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:05.963551 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef9dc4-fbb6-4341-bd4d-6f921cede308 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:05.963830 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef9dc4-fbb6-4341-bd4d-6f921cede308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:05.986362 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-6bef9dc4-fbb6-4341-bd4d-6f921cede308 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:05.987591 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-6bef9dc4-fbb6-4341-bd4d-6f921cede308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:06.078925 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1055/2105] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:13:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:13:06.086536 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7913adb4-b511-481b-9d20-96c5d8e24485 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:06.086925 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7913adb4-b511-481b-9d20-96c5d8e24485 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:06.087205 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7913adb4-b511-481b-9d20-96c5d8e24485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:06.143661 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-7913adb4-b511-481b-9d20-96c5d8e24485 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:06.144975 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-7913adb4-b511-481b-9d20-96c5d8e24485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:06.157350 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1051/2106] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:13:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:13:06.158584 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bef9dc4-fbb6-4341-bd4d-6f921cede308 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:06.170689 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bef9dc4-fbb6-4341-bd4d-6f921cede308 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:06.176326 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e6dbd5-289e-4f90-b41f-3fb1e2c08251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:06.177098 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e6dbd5-289e-4f90-b41f-3fb1e2c08251 admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:06.177960 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e6dbd5-289e-4f90-b41f-3fb1e2c08251 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:06.178999 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e6dbd5-289e-4f90-b41f-3fb1e2c08251 admin admin] PATH_INFO: `/v3/domains` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:06.178999 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e6dbd5-289e-4f90-b41f-3fb1e2c08251 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:13:06.179290 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e6dbd5-289e-4f90-b41f-3fb1e2c08251 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:06.181544 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e6dbd5-289e-4f90-b41f-3fb1e2c08251 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:06.198504 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1056/2107] 10.222.0.49 () {58 vars in 1153 bytes} [Thu Sep 29 02:13:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:13:06.201957 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7913adb4-b511-481b-9d20-96c5d8e24485 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:06.222853 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7913adb4-b511-481b-9d20-96c5d8e24485 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:06.228903 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d9aa19-f0d3-4700-97ba-7a79b5af5ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:06.229899 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d9aa19-f0d3-4700-97ba-7a79b5af5ac2 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:06.230325 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d9aa19-f0d3-4700-97ba-7a79b5af5ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:06.230691 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d9aa19-f0d3-4700-97ba-7a79b5af5ac2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:06.231539 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d9aa19-f0d3-4700-97ba-7a79b5af5ac2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:06.233761 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d9aa19-f0d3-4700-97ba-7a79b5af5ac2 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:06.269811 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1052/2108] 10.222.0.49 () {60 vars in 1153 bytes} [Thu Sep 29 02:13:06 2022] POST /identity/v3/projects => generated 383 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:13:06.272264 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e6dbd5-289e-4f90-b41f-3fb1e2c08251 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:06.282781 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e6dbd5-289e-4f90-b41f-3fb1e2c08251 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:06.339623 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ab040f-0152-47c5-bb6e-01c93d3c9e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:06.340227 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab040f-0152-47c5-bb6e-01c93d3c9e6a admin admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:06.340503 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab040f-0152-47c5-bb6e-01c93d3c9e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:06.340796 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab040f-0152-47c5-bb6e-01c93d3c9e6a admin admin] PATH_INFO: `/v3/users` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:06.341461 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ab040f-0152-47c5-bb6e-01c93d3c9e6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:06.343393 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ab040f-0152-47c5-bb6e-01c93d3c9e6a admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:06.357903 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:06.370034 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1057/2109] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 02:13:06 2022] POST /identity/v3/users => generated 292 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:13:06.374341 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d9aa19-f0d3-4700-97ba-7a79b5af5ac2 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:06.385919 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d9aa19-f0d3-4700-97ba-7a79b5af5ac2 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:06.390722 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b998b4-1240-493d-b828-43785823d5d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:06.391361 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b998b4-1240-493d-b828-43785823d5d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:06.391641 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b998b4-1240-493d-b828-43785823d5d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:06.391950 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b998b4-1240-493d-b828-43785823d5d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:06.392600 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b998b4-1240-493d-b828-43785823d5d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:06.394210 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b998b4-1240-493d-b828-43785823d5d8 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:06.399963 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:06.405211 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1053/2110] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:13:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:13:06.409501 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ab040f-0152-47c5-bb6e-01c93d3c9e6a admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:06.419281 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ab040f-0152-47c5-bb6e-01c93d3c9e6a admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:06.423839 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d70a71-d8a8-43d2-9366-b5ee1a9bf89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:06.424421 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d70a71-d8a8-43d2-9366-b5ee1a9bf89a admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:06.424697 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d70a71-d8a8-43d2-9366-b5ee1a9bf89a admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:06.424963 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d70a71-d8a8-43d2-9366-b5ee1a9bf89a admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:06.425634 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d70a71-d8a8-43d2-9366-b5ee1a9bf89a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:06.427711 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d70a71-d8a8-43d2-9366-b5ee1a9bf89a admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:06.438030 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1058/2111] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:13:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:13:06.442082 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b998b4-1240-493d-b828-43785823d5d8 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:06.452450 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b998b4-1240-493d-b828-43785823d5d8 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:06.457014 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d4c56e-7728-4b27-9503-70ea1122452a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:06.457680 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d4c56e-7728-4b27-9503-70ea1122452a admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:06.457960 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d4c56e-7728-4b27-9503-70ea1122452a admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:06.458233 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d4c56e-7728-4b27-9503-70ea1122452a admin admin] PATH_INFO: `/v3/projects/f2831aaa96c6429aa5172bff23dae70a/users/6dd0e9d26c3f4a0482f4f8fa9c1423bc/roles/f157f905c9c94ccfbfb46e52d443e8f2` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:06.472673 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d4c56e-7728-4b27-9503-70ea1122452a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2831aaa96c6429aa5172bff23dae70a, user_id=6dd0e9d26c3f4a0482f4f8fa9c1423bc, role_id=f157f905c9c94ccfbfb46e52d443e8f2)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:06.475479 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d4c56e-7728-4b27-9503-70ea1122452a admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:06.487722 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1054/2112] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:13:06 2022] PUT /identity/v3/projects/f2831aaa96c6429aa5172bff23dae70a/users/6dd0e9d26c3f4a0482f4f8fa9c1423bc/roles/f157f905c9c94ccfbfb46e52d443e8f2 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:13:06.499262 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548192b1-a383-4aa7-aec0-3a52c200b6ad None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:06.499551 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548192b1-a383-4aa7-aec0-3a52c200b6ad None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:06.499822 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548192b1-a383-4aa7-aec0-3a52c200b6ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:06.527525 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-548192b1-a383-4aa7-aec0-3a52c200b6ad None None] MFA Rules not processed for user `6dd0e9d26c3f4a0482f4f8fa9c1423bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:06.528769 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-548192b1-a383-4aa7-aec0-3a52c200b6ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:06.593036 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1059/2113] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:13:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:13:06.597447 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d4c56e-7728-4b27-9503-70ea1122452a admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:06.663805 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d4c56e-7728-4b27-9503-70ea1122452a admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:06.670168 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54baa2a-1c2a-4598-9cd6-e32cf6d228d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:06.671101 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54baa2a-1c2a-4598-9cd6-e32cf6d228d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:06.671451 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54baa2a-1c2a-4598-9cd6-e32cf6d228d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:06.671856 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54baa2a-1c2a-4598-9cd6-e32cf6d228d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:06.672847 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54baa2a-1c2a-4598-9cd6-e32cf6d228d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:06.676235 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54baa2a-1c2a-4598-9cd6-e32cf6d228d0 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:06.719192 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1055/2114] 10.222.0.49 () {60 vars in 1153 bytes} [Thu Sep 29 02:13:06 2022] POST /identity/v3/projects => generated 385 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:13:06.720765 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548192b1-a383-4aa7-aec0-3a52c200b6ad None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:06.733853 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548192b1-a383-4aa7-aec0-3a52c200b6ad None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:06.792735 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba011b3-3707-4c44-9834-fd0d7ed23c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:06.793490 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba011b3-3707-4c44-9834-fd0d7ed23c84 admin admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:06.793774 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba011b3-3707-4c44-9834-fd0d7ed23c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:06.794047 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba011b3-3707-4c44-9834-fd0d7ed23c84 admin admin] PATH_INFO: `/v3/users` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:06.795643 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba011b3-3707-4c44-9834-fd0d7ed23c84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:06.797759 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba011b3-3707-4c44-9834-fd0d7ed23c84 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:06.821123 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1060/2115] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 02:13:06 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:13:06.825200 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54baa2a-1c2a-4598-9cd6-e32cf6d228d0 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:06.836052 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54baa2a-1c2a-4598-9cd6-e32cf6d228d0 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:06.841987 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98f619c-5dda-457b-b6ca-26c666fad0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:06.842590 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98f619c-5dda-457b-b6ca-26c666fad0f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:06.842868 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98f619c-5dda-457b-b6ca-26c666fad0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:06.843134 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98f619c-5dda-457b-b6ca-26c666fad0f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:06.843774 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98f619c-5dda-457b-b6ca-26c666fad0f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:06.845411 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98f619c-5dda-457b-b6ca-26c666fad0f3 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:06.857148 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1056/2116] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:13:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:13:06.861480 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba011b3-3707-4c44-9834-fd0d7ed23c84 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:06.872318 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba011b3-3707-4c44-9834-fd0d7ed23c84 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:06.877197 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10349f8b-b947-464f-ac34-31b6ad0ed852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:06.877825 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10349f8b-b947-464f-ac34-31b6ad0ed852 admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:06.878107 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10349f8b-b947-464f-ac34-31b6ad0ed852 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:06.878393 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10349f8b-b947-464f-ac34-31b6ad0ed852 admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:06.879121 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10349f8b-b947-464f-ac34-31b6ad0ed852 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:06.880870 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10349f8b-b947-464f-ac34-31b6ad0ed852 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:06.890837 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1061/2117] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:13:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:13:06.894989 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98f619c-5dda-457b-b6ca-26c666fad0f3 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:06.906121 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98f619c-5dda-457b-b6ca-26c666fad0f3 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:06.912107 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b92790-d3a0-4b7c-8944-f567aba6ff23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:06.912761 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b92790-d3a0-4b7c-8944-f567aba6ff23 admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:06.913036 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b92790-d3a0-4b7c-8944-f567aba6ff23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:06.913301 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b92790-d3a0-4b7c-8944-f567aba6ff23 admin admin] PATH_INFO: `/v3/projects/87fb6a44bfc64debb56cb94b1e901442/users/fbe50fc8593e4579b9bf7e2e0d964fa7/roles/f157f905c9c94ccfbfb46e52d443e8f2` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:06.931429 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b92790-d3a0-4b7c-8944-f567aba6ff23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87fb6a44bfc64debb56cb94b1e901442, user_id=fbe50fc8593e4579b9bf7e2e0d964fa7, role_id=f157f905c9c94ccfbfb46e52d443e8f2)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:06.934188 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b92790-d3a0-4b7c-8944-f567aba6ff23 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:06.946694 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1057/2118] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:13:06 2022] PUT /identity/v3/projects/87fb6a44bfc64debb56cb94b1e901442/users/fbe50fc8593e4579b9bf7e2e0d964fa7/roles/f157f905c9c94ccfbfb46e52d443e8f2 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:13:06.956590 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcb647e-0c77-421f-b6a0-7fd5530d246e None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:06.956877 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcb647e-0c77-421f-b6a0-7fd5530d246e None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:06.957152 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcb647e-0c77-421f-b6a0-7fd5530d246e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:06.985659 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-efcb647e-0c77-421f-b6a0-7fd5530d246e None None] MFA Rules not processed for user `fbe50fc8593e4579b9bf7e2e0d964fa7`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:06.986874 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-efcb647e-0c77-421f-b6a0-7fd5530d246e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:07.028225 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:07.051527 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1062/2119] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:13:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:13:07.056528 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b92790-d3a0-4b7c-8944-f567aba6ff23 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:07.116137 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b92790-d3a0-4b7c-8944-f567aba6ff23 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:07.120953 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beedbd0a-742f-4239-969a-b0044df50af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:07.121573 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beedbd0a-742f-4239-969a-b0044df50af4 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:07.121850 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beedbd0a-742f-4239-969a-b0044df50af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:07.122119 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beedbd0a-742f-4239-969a-b0044df50af4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:07.122737 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beedbd0a-742f-4239-969a-b0044df50af4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:07.124589 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beedbd0a-742f-4239-969a-b0044df50af4 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:07.157692 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1058/2120] 10.222.0.49 () {60 vars in 1153 bytes} [Thu Sep 29 02:13:07 2022] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:13:07.161531 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcb647e-0c77-421f-b6a0-7fd5530d246e None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:07.179645 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcb647e-0c77-421f-b6a0-7fd5530d246e None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:07.239125 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb20d9e-792a-4965-9077-f7aa2ef6c29d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:07.240282 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb20d9e-792a-4965-9077-f7aa2ef6c29d admin admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:07.240632 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb20d9e-792a-4965-9077-f7aa2ef6c29d admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:07.240902 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb20d9e-792a-4965-9077-f7aa2ef6c29d admin admin] PATH_INFO: `/v3/users` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:07.241599 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb20d9e-792a-4965-9077-f7aa2ef6c29d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:07.243587 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb20d9e-792a-4965-9077-f7aa2ef6c29d admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:07.266719 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1063/2121] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 02:13:07 2022] POST /identity/v3/users => generated 299 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 29 02:13:07.271007 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beedbd0a-742f-4239-969a-b0044df50af4 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:07.282223 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beedbd0a-742f-4239-969a-b0044df50af4 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:07.287617 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98afc21c-6184-4eb1-9716-f19ef04e93c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:07.288302 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98afc21c-6184-4eb1-9716-f19ef04e93c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:07.288919 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98afc21c-6184-4eb1-9716-f19ef04e93c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:07.288919 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98afc21c-6184-4eb1-9716-f19ef04e93c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:07.289700 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98afc21c-6184-4eb1-9716-f19ef04e93c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:07.291395 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98afc21c-6184-4eb1-9716-f19ef04e93c4 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:07.300765 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:07.314055 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1059/2122] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:13:07 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:13:07.315607 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb20d9e-792a-4965-9077-f7aa2ef6c29d admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:07.328009 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb20d9e-792a-4965-9077-f7aa2ef6c29d admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:07.334290 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b132c974-17d9-4a66-a2d1-0caf4ca924d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:07.335266 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132c974-17d9-4a66-a2d1-0caf4ca924d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:07.335717 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132c974-17d9-4a66-a2d1-0caf4ca924d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:07.335940 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132c974-17d9-4a66-a2d1-0caf4ca924d8 admin admin] PATH_INFO: `/v3/projects/e9d9e378bb3e4a67acdec5b907934cb1/users/d601fcadb31f4684af60bfb9eac44df5/roles/fe9bbc67742f4f5893f39b18eb31d59a` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:07.365840 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b132c974-17d9-4a66-a2d1-0caf4ca924d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9d9e378bb3e4a67acdec5b907934cb1, user_id=d601fcadb31f4684af60bfb9eac44df5, role_id=fe9bbc67742f4f5893f39b18eb31d59a)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:07.371282 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b132c974-17d9-4a66-a2d1-0caf4ca924d8 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:07.391875 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1064/2123] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:13:07 2022] PUT /identity/v3/projects/e9d9e378bb3e4a67acdec5b907934cb1/users/d601fcadb31f4684af60bfb9eac44df5/roles/fe9bbc67742f4f5893f39b18eb31d59a => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:13:07.393022 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98afc21c-6184-4eb1-9716-f19ef04e93c4 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:07.404839 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98afc21c-6184-4eb1-9716-f19ef04e93c4 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:07.542171 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b582469-6003-4284-b8da-4a930621da6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:07.543287 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b582469-6003-4284-b8da-4a930621da6a admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:07.543287 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b582469-6003-4284-b8da-4a930621da6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:07.543485 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b582469-6003-4284-b8da-4a930621da6a admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:07.544127 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b582469-6003-4284-b8da-4a930621da6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:07.545851 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b582469-6003-4284-b8da-4a930621da6a admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:07.557956 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1060/2124] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:13:07 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 29 02:13:07.566069 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b132c974-17d9-4a66-a2d1-0caf4ca924d8 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:07.576845 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b132c974-17d9-4a66-a2d1-0caf4ca924d8 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:07.581869 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02a656a-9dca-4304-9df4-911b79f84e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:07.582528 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a656a-9dca-4304-9df4-911b79f84e6c admin admin] REQUEST_METHOD: `PUT` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:07.583176 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a656a-9dca-4304-9df4-911b79f84e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:07.583176 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a656a-9dca-4304-9df4-911b79f84e6c admin admin] PATH_INFO: `/v3/projects/e9d9e378bb3e4a67acdec5b907934cb1/users/d601fcadb31f4684af60bfb9eac44df5/roles/fe9bbc67742f4f5893f39b18eb31d59a` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:07.585493 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02a656a-9dca-4304-9df4-911b79f84e6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9d9e378bb3e4a67acdec5b907934cb1, user_id=d601fcadb31f4684af60bfb9eac44df5, role_id=fe9bbc67742f4f5893f39b18eb31d59a)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:07.588256 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02a656a-9dca-4304-9df4-911b79f84e6c admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:07.610301 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1065/2125] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:13:07 2022] PUT /identity/v3/projects/e9d9e378bb3e4a67acdec5b907934cb1/users/d601fcadb31f4684af60bfb9eac44df5/roles/fe9bbc67742f4f5893f39b18eb31d59a => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:13:07.612320 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ab1130-60fb-4592-877d-9dd0ee08c343 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:07.613172 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ab1130-60fb-4592-877d-9dd0ee08c343 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:07.613495 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ab1130-60fb-4592-877d-9dd0ee08c343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:07.648355 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-69ab1130-60fb-4592-877d-9dd0ee08c343 None None] MFA Rules not processed for user `d601fcadb31f4684af60bfb9eac44df5`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:07.649652 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-69ab1130-60fb-4592-877d-9dd0ee08c343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:07.725369 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1061/2126] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:13:07 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:13:07.737169 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02a656a-9dca-4304-9df4-911b79f84e6c admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:07.738904 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-d02a656a-9dca-4304-9df4-911b79f84e6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:07.801804 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02a656a-9dca-4304-9df4-911b79f84e6c admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:07.805651 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5627529-b330-4870-b9d4-89e49ef9da3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75135b856134ba4b9ccac337886f682', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:07.806261 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5627529-b330-4870-b9d4-89e49ef9da3e service cinder] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:07.806539 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5627529-b330-4870-b9d4-89e49ef9da3e service cinder] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:07.806808 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5627529-b330-4870-b9d4-89e49ef9da3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:07.856255 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:07.876665 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5627529-b330-4870-b9d4-89e49ef9da3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:07.878382 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5627529-b330-4870-b9d4-89e49ef9da3e service cinder] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:07.891670 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1066/2127] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:13:07 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:13:09.438991 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ab1130-60fb-4592-877d-9dd0ee08c343 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:09.449761 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ab1130-60fb-4592-877d-9dd0ee08c343 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:09.453291 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ecf3f1-5eb1-4af4-8200-6a288ccf13de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75135b856134ba4b9ccac337886f682', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:09.453911 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ecf3f1-5eb1-4af4-8200-6a288ccf13de service cinder] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:09.454187 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ecf3f1-5eb1-4af4-8200-6a288ccf13de service cinder] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:09.454456 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ecf3f1-5eb1-4af4-8200-6a288ccf13de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:09.512394 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ecf3f1-5eb1-4af4-8200-6a288ccf13de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:09.513869 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ecf3f1-5eb1-4af4-8200-6a288ccf13de service cinder] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:09.523776 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1062/2128] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:13:09 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:13:10.181394 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5627529-b330-4870-b9d4-89e49ef9da3e service cinder] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:10.193820 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5627529-b330-4870-b9d4-89e49ef9da3e service cinder] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:10.199329 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23334f42-8e2f-4ed3-9321-88ffbc135bb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75135b856134ba4b9ccac337886f682', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:10.200201 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23334f42-8e2f-4ed3-9321-88ffbc135bb4 service cinder] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:10.200587 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23334f42-8e2f-4ed3-9321-88ffbc135bb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:10.201351 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23334f42-8e2f-4ed3-9321-88ffbc135bb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:10.213039 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23334f42-8e2f-4ed3-9321-88ffbc135bb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:10.214656 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23334f42-8e2f-4ed3-9321-88ffbc135bb4 service cinder] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:10.227111 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1067/2129] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:13:10 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:13:11.350947 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ecf3f1-5eb1-4af4-8200-6a288ccf13de service cinder] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:11.353884 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-25ecf3f1-5eb1-4af4-8200-6a288ccf13de service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:11.375007 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:11.429956 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ecf3f1-5eb1-4af4-8200-6a288ccf13de service cinder] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:11.435130 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64437d21-d9a5-458b-ae66-1d1e8c6e8346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:11.435885 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64437d21-d9a5-458b-ae66-1d1e8c6e8346 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:11.436171 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64437d21-d9a5-458b-ae66-1d1e8c6e8346 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:11.436558 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64437d21-d9a5-458b-ae66-1d1e8c6e8346 admin admin] PATH_INFO: `/v3/users/071f5b08a78f46fa99e3bc1c9feb876b` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:11.437693 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64437d21-d9a5-458b-ae66-1d1e8c6e8346 admin admin] RBAC: Authorizing `identity:delete_user(user_id=071f5b08a78f46fa99e3bc1c9feb876b)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:11.439726 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64437d21-d9a5-458b-ae66-1d1e8c6e8346 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:11.516843 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-64437d21-d9a5-458b-ae66-1d1e8c6e8346 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '071f5b08a78f46fa99e3bc1c9feb876b'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:11.518016 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-64437d21-d9a5-458b-ae66-1d1e8c6e8346 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '071f5b08a78f46fa99e3bc1c9feb876b'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:11.553387 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-64437d21-d9a5-458b-ae66-1d1e8c6e8346 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '071f5b08a78f46fa99e3bc1c9feb876b'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:11.560205 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-64437d21-d9a5-458b-ae66-1d1e8c6e8346 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '071f5b08a78f46fa99e3bc1c9feb876b'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:11.561627 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-64437d21-d9a5-458b-ae66-1d1e8c6e8346 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '071f5b08a78f46fa99e3bc1c9feb876b'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:11.581879 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1063/2130] 10.222.0.49 () {58 vars in 1224 bytes} [Thu Sep 29 02:13:11 2022] DELETE /identity/v3/users/071f5b08a78f46fa99e3bc1c9feb876b => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:13:11.587109 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a9766f-2893-4240-ac7f-fc8b049555a9 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:11.587566 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a9766f-2893-4240-ac7f-fc8b049555a9 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:11.587658 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a9766f-2893-4240-ac7f-fc8b049555a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:11.609048 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-76a9766f-2893-4240-ac7f-fc8b049555a9 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:11.610655 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-76a9766f-2893-4240-ac7f-fc8b049555a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:11.720741 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1068/2131] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:13:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:13:11.738422 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64437d21-d9a5-458b-ae66-1d1e8c6e8346 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:11.740767 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-64437d21-d9a5-458b-ae66-1d1e8c6e8346 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:11.810165 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64437d21-d9a5-458b-ae66-1d1e8c6e8346 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:11.813875 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ddf65d-ee00-460a-806f-df118262a0c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:11.814474 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ddf65d-ee00-460a-806f-df118262a0c0 service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:11.814749 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ddf65d-ee00-460a-806f-df118262a0c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:11.815015 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ddf65d-ee00-460a-806f-df118262a0c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:11.824662 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ddf65d-ee00-460a-806f-df118262a0c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:11.826101 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ddf65d-ee00-460a-806f-df118262a0c0 service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:11.835463 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1064/2132] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:13:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:13:12.102883 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a9766f-2893-4240-ac7f-fc8b049555a9 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:12.104326 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-76a9766f-2893-4240-ac7f-fc8b049555a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:12.118539 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a9766f-2893-4240-ac7f-fc8b049555a9 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:12.123136 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c19f1a0-1141-4035-9c64-242bff0e4fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:12.123839 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c19f1a0-1141-4035-9c64-242bff0e4fda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:12.124116 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c19f1a0-1141-4035-9c64-242bff0e4fda admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:12.124386 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c19f1a0-1141-4035-9c64-242bff0e4fda admin admin] PATH_INFO: `/v3/projects/7aff9cdde28d44d8801462a74a8f216e` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:12.126124 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c19f1a0-1141-4035-9c64-242bff0e4fda admin admin] RBAC: Authorizing `identity:delete_project(project_id=7aff9cdde28d44d8801462a74a8f216e)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:12.128052 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c19f1a0-1141-4035-9c64-242bff0e4fda admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:12.174052 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-7c19f1a0-1141-4035-9c64-242bff0e4fda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7aff9cdde28d44d8801462a74a8f216e', 'request_id': 'req-7c19f1a0-1141-4035-9c64-242bff0e4fda'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:12.180691 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-7c19f1a0-1141-4035-9c64-242bff0e4fda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7aff9cdde28d44d8801462a74a8f216e', 'request_id': 'req-7c19f1a0-1141-4035-9c64-242bff0e4fda'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:12.187932 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-7c19f1a0-1141-4035-9c64-242bff0e4fda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7aff9cdde28d44d8801462a74a8f216e', 'request_id': 'req-7c19f1a0-1141-4035-9c64-242bff0e4fda'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:12.198690 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-7c19f1a0-1141-4035-9c64-242bff0e4fda admin admin] The token cache is being invalidate because project 7aff9cdde28d44d8801462a74a8f216e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81648) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:13:12.198985 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-7c19f1a0-1141-4035-9c64-242bff0e4fda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:12.199625 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-7c19f1a0-1141-4035-9c64-242bff0e4fda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:12.201229 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1069/2133] 10.222.0.49 () {58 vars in 1233 bytes} [Thu Sep 29 02:13:12 2022] DELETE /identity/v3/projects/7aff9cdde28d44d8801462a74a8f216e => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:13:12.206132 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f63740-68d4-4793-86fe-7940b85599e2 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:12.206416 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f63740-68d4-4793-86fe-7940b85599e2 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:12.206687 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f63740-68d4-4793-86fe-7940b85599e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:12.226972 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-a1f63740-68d4-4793-86fe-7940b85599e2 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:12.228186 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-a1f63740-68d4-4793-86fe-7940b85599e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:12.267890 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:12.293576 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1065/2134] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:13:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 29 02:13:12.302585 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d990c31-0c27-438b-b2b3-1d8897df2c51 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:12.302894 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d990c31-0c27-438b-b2b3-1d8897df2c51 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:12.303155 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d990c31-0c27-438b-b2b3-1d8897df2c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:12.322494 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-3d990c31-0c27-438b-b2b3-1d8897df2c51 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:12.323701 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-3d990c31-0c27-438b-b2b3-1d8897df2c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:12.331533 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1070/2135] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:13:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 29 02:13:12.336369 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f63740-68d4-4793-86fe-7940b85599e2 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:12.346503 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f63740-68d4-4793-86fe-7940b85599e2 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:12.353179 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba7256f-1a1c-4e01-8769-6fdbf2dc28a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:12.353837 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba7256f-1a1c-4e01-8769-6fdbf2dc28a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:12.354118 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba7256f-1a1c-4e01-8769-6fdbf2dc28a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:12.354389 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba7256f-1a1c-4e01-8769-6fdbf2dc28a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:12.355046 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba7256f-1a1c-4e01-8769-6fdbf2dc28a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:13:12.355348 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba7256f-1a1c-4e01-8769-6fdbf2dc28a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:12.356953 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba7256f-1a1c-4e01-8769-6fdbf2dc28a2 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:12.373741 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1066/2136] 10.222.0.49 () {58 vars in 1153 bytes} [Thu Sep 29 02:13:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:13:12.375010 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d990c31-0c27-438b-b2b3-1d8897df2c51 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:12.386502 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d990c31-0c27-438b-b2b3-1d8897df2c51 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:12.392245 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a39eff4-9108-4d01-8db6-f72b04abc0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:12.393375 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a39eff4-9108-4d01-8db6-f72b04abc0e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:12.393375 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a39eff4-9108-4d01-8db6-f72b04abc0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:12.393572 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a39eff4-9108-4d01-8db6-f72b04abc0e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:12.394675 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a39eff4-9108-4d01-8db6-f72b04abc0e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:12.397528 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a39eff4-9108-4d01-8db6-f72b04abc0e4 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:12.429364 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1071/2137] 10.222.0.49 () {60 vars in 1153 bytes} [Thu Sep 29 02:13:12 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 29 02:13:12.430883 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba7256f-1a1c-4e01-8769-6fdbf2dc28a2 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:12.440870 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba7256f-1a1c-4e01-8769-6fdbf2dc28a2 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:12.500098 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48539b70-f2ed-4199-9765-ffb8fb44a001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:12.500712 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48539b70-f2ed-4199-9765-ffb8fb44a001 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:12.501009 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48539b70-f2ed-4199-9765-ffb8fb44a001 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:12.501261 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48539b70-f2ed-4199-9765-ffb8fb44a001 admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:12.502197 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48539b70-f2ed-4199-9765-ffb8fb44a001 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:12.503807 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48539b70-f2ed-4199-9765-ffb8fb44a001 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:12.529171 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1067/2138] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 02:13:12 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:13:12.530052 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a39eff4-9108-4d01-8db6-f72b04abc0e4 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:12.541234 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a39eff4-9108-4d01-8db6-f72b04abc0e4 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:12.546499 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c6d0b4-773b-41a8-9b3c-535d05b17548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:12.547100 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c6d0b4-773b-41a8-9b3c-535d05b17548 admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:12.547378 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c6d0b4-773b-41a8-9b3c-535d05b17548 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:12.547651 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c6d0b4-773b-41a8-9b3c-535d05b17548 admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:12.548294 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c6d0b4-773b-41a8-9b3c-535d05b17548 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:12.549957 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c6d0b4-773b-41a8-9b3c-535d05b17548 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:12.560425 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1072/2139] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:13:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 29 02:13:12.564218 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48539b70-f2ed-4199-9765-ffb8fb44a001 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:12.574540 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48539b70-f2ed-4199-9765-ffb8fb44a001 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:12.579175 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f173d4ad-566d-45ba-bd49-464e246deb54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:12.579769 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f173d4ad-566d-45ba-bd49-464e246deb54 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:12.580065 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f173d4ad-566d-45ba-bd49-464e246deb54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:12.580304 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f173d4ad-566d-45ba-bd49-464e246deb54 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:12.580946 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f173d4ad-566d-45ba-bd49-464e246deb54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:12.582898 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f173d4ad-566d-45ba-bd49-464e246deb54 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:12.595560 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1068/2140] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:13:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:13:12.600581 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c6d0b4-773b-41a8-9b3c-535d05b17548 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:12.610600 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c6d0b4-773b-41a8-9b3c-535d05b17548 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:12.616024 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88532555-bb1d-42cc-afe4-d10dbded6b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:12.616693 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88532555-bb1d-42cc-afe4-d10dbded6b4c admin admin] REQUEST_METHOD: `PUT` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:12.617000 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88532555-bb1d-42cc-afe4-d10dbded6b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:12.617335 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88532555-bb1d-42cc-afe4-d10dbded6b4c admin admin] PATH_INFO: `/v3/projects/5155c124503f43a0939cdf2cb312934d/users/a17bc475e4364256b75142d36de6867b/roles/f157f905c9c94ccfbfb46e52d443e8f2` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:12.633597 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88532555-bb1d-42cc-afe4-d10dbded6b4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5155c124503f43a0939cdf2cb312934d, user_id=a17bc475e4364256b75142d36de6867b, role_id=f157f905c9c94ccfbfb46e52d443e8f2)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:12.636566 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88532555-bb1d-42cc-afe4-d10dbded6b4c admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:12.640024 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:12.655293 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1073/2141] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:13:12 2022] PUT /identity/v3/projects/5155c124503f43a0939cdf2cb312934d/users/a17bc475e4364256b75142d36de6867b/roles/f157f905c9c94ccfbfb46e52d443e8f2 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:13:12.665617 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a4ea0d-a79e-4a05-83cf-ff7c3a6c1572 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:12.665829 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a4ea0d-a79e-4a05-83cf-ff7c3a6c1572 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:12.666125 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a4ea0d-a79e-4a05-83cf-ff7c3a6c1572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:12.694644 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-c8a4ea0d-a79e-4a05-83cf-ff7c3a6c1572 None None] MFA Rules not processed for user `a17bc475e4364256b75142d36de6867b`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:12.695794 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-c8a4ea0d-a79e-4a05-83cf-ff7c3a6c1572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:12.770101 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1069/2142] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:13:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:13:13.031655 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88532555-bb1d-42cc-afe4-d10dbded6b4c admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:13.033619 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-88532555-bb1d-42cc-afe4-d10dbded6b4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:13.132490 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88532555-bb1d-42cc-afe4-d10dbded6b4c admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:13.140557 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fd51a7-8e4c-42c2-9f26-48a49694b3ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3325a7111d447f4a9cf00c672d5420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:13.141252 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fd51a7-8e4c-42c2-9f26-48a49694b3ab service nova] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:13.141630 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fd51a7-8e4c-42c2-9f26-48a49694b3ab service nova] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:13.142044 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fd51a7-8e4c-42c2-9f26-48a49694b3ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:13.152236 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fd51a7-8e4c-42c2-9f26-48a49694b3ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:13.153982 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fd51a7-8e4c-42c2-9f26-48a49694b3ab service nova] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:13.165828 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1074/2143] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:13:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 29 02:13:13.414467 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a4ea0d-a79e-4a05-83cf-ff7c3a6c1572 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:13.463406 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:13.493567 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a4ea0d-a79e-4a05-83cf-ff7c3a6c1572 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:13.498085 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e709d2e7-b2a5-4dc8-89ef-448542d8f69f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:13.498705 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e709d2e7-b2a5-4dc8-89ef-448542d8f69f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:13.499002 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e709d2e7-b2a5-4dc8-89ef-448542d8f69f admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:13.499367 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e709d2e7-b2a5-4dc8-89ef-448542d8f69f admin admin] PATH_INFO: `/v3/users/a17bc475e4364256b75142d36de6867b` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:13.500741 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e709d2e7-b2a5-4dc8-89ef-448542d8f69f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a17bc475e4364256b75142d36de6867b)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:13.502671 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e709d2e7-b2a5-4dc8-89ef-448542d8f69f admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:13.554367 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-e709d2e7-b2a5-4dc8-89ef-448542d8f69f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a17bc475e4364256b75142d36de6867b'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:13.555014 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-e709d2e7-b2a5-4dc8-89ef-448542d8f69f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a17bc475e4364256b75142d36de6867b'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:13.568193 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-e709d2e7-b2a5-4dc8-89ef-448542d8f69f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a17bc475e4364256b75142d36de6867b'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:13.576992 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-e709d2e7-b2a5-4dc8-89ef-448542d8f69f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a17bc475e4364256b75142d36de6867b'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:13.577624 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-e709d2e7-b2a5-4dc8-89ef-448542d8f69f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a17bc475e4364256b75142d36de6867b'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:13.591354 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1070/2144] 10.222.0.49 () {58 vars in 1224 bytes} [Thu Sep 29 02:13:13 2022] DELETE /identity/v3/users/a17bc475e4364256b75142d36de6867b => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:13:13.596052 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf9b172-e314-4d95-9f72-7486bada3902 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:13.596345 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf9b172-e314-4d95-9f72-7486bada3902 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:13.596615 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf9b172-e314-4d95-9f72-7486bada3902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:13.615813 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-ebf9b172-e314-4d95-9f72-7486bada3902 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:13.617024 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-ebf9b172-e314-4d95-9f72-7486bada3902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:13.679583 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1075/2145] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:13:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:13:13.689338 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e709d2e7-b2a5-4dc8-89ef-448542d8f69f admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:13.691040 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-e709d2e7-b2a5-4dc8-89ef-448542d8f69f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:13.754746 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e709d2e7-b2a5-4dc8-89ef-448542d8f69f admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:13.760141 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cff5024-bec9-40b6-b7f5-b52d630e699d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:13.761565 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff5024-bec9-40b6-b7f5-b52d630e699d service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:13.761932 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff5024-bec9-40b6-b7f5-b52d630e699d service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:13.762255 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff5024-bec9-40b6-b7f5-b52d630e699d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:13.772934 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cff5024-bec9-40b6-b7f5-b52d630e699d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:13.774400 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cff5024-bec9-40b6-b7f5-b52d630e699d service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:13.784225 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1071/2146] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:13:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 29 02:13:14.059612 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf9b172-e314-4d95-9f72-7486bada3902 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:14.061094 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-ebf9b172-e314-4d95-9f72-7486bada3902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:14.083735 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf9b172-e314-4d95-9f72-7486bada3902 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:14.098484 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a56759-8001-4524-b48a-1197c81d7159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:14.099258 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a56759-8001-4524-b48a-1197c81d7159 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:14.099713 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a56759-8001-4524-b48a-1197c81d7159 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:14.100455 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a56759-8001-4524-b48a-1197c81d7159 admin admin] PATH_INFO: `/v3/projects/5155c124503f43a0939cdf2cb312934d` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:14.101850 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a56759-8001-4524-b48a-1197c81d7159 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5155c124503f43a0939cdf2cb312934d)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:14.107006 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a56759-8001-4524-b48a-1197c81d7159 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:14.177552 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-58a56759-8001-4524-b48a-1197c81d7159 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5155c124503f43a0939cdf2cb312934d', 'request_id': 'req-58a56759-8001-4524-b48a-1197c81d7159'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:14.185854 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-58a56759-8001-4524-b48a-1197c81d7159 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5155c124503f43a0939cdf2cb312934d', 'request_id': 'req-58a56759-8001-4524-b48a-1197c81d7159'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:14.195924 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-58a56759-8001-4524-b48a-1197c81d7159 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5155c124503f43a0939cdf2cb312934d', 'request_id': 'req-58a56759-8001-4524-b48a-1197c81d7159'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:14.213934 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-58a56759-8001-4524-b48a-1197c81d7159 admin admin] The token cache is being invalidate because project 5155c124503f43a0939cdf2cb312934d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81648) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:13:14.214298 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-58a56759-8001-4524-b48a-1197c81d7159 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:14.215134 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-58a56759-8001-4524-b48a-1197c81d7159 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:14.217370 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1076/2147] 10.222.0.49 () {58 vars in 1233 bytes} [Thu Sep 29 02:13:14 2022] DELETE /identity/v3/projects/5155c124503f43a0939cdf2cb312934d => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:13:14.222731 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d5b127-f1e5-42d3-98d5-603145a77446 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:14.223024 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d5b127-f1e5-42d3-98d5-603145a77446 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:14.223931 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d5b127-f1e5-42d3-98d5-603145a77446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:14.249116 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-a3d5b127-f1e5-42d3-98d5-603145a77446 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:14.250293 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-a3d5b127-f1e5-42d3-98d5-603145a77446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:14.303845 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:14.317789 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1072/2148] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:13:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 29 02:13:14.330538 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db86fd1f-9b2b-460d-838f-d5c53dd0839c None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:14.330835 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db86fd1f-9b2b-460d-838f-d5c53dd0839c None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:14.331173 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db86fd1f-9b2b-460d-838f-d5c53dd0839c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:14.340490 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:14.358924 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-db86fd1f-9b2b-460d-838f-d5c53dd0839c None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:14.360323 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-db86fd1f-9b2b-460d-838f-d5c53dd0839c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:14.370617 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1077/2149] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:13:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:13:14.377068 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d5b127-f1e5-42d3-98d5-603145a77446 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:14.383245 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db86fd1f-9b2b-460d-838f-d5c53dd0839c None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:14.384630 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-db86fd1f-9b2b-460d-838f-d5c53dd0839c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:14.389069 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d5b127-f1e5-42d3-98d5-603145a77446 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:14.394025 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5d0789-3c8e-4e71-b7e6-a471d0a50f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:14.394628 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5d0789-3c8e-4e71-b7e6-a471d0a50f47 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:14.394900 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5d0789-3c8e-4e71-b7e6-a471d0a50f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:14.395165 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5d0789-3c8e-4e71-b7e6-a471d0a50f47 admin admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:14.396015 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5d0789-3c8e-4e71-b7e6-a471d0a50f47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:13:14.396301 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5d0789-3c8e-4e71-b7e6-a471d0a50f47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:14.396962 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db86fd1f-9b2b-460d-838f-d5c53dd0839c None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:14.398195 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5d0789-3c8e-4e71-b7e6-a471d0a50f47 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:14.402393 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973b562a-9335-4e0a-b0ab-51af4747d0bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:14.403056 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973b562a-9335-4e0a-b0ab-51af4747d0bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:14.403339 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973b562a-9335-4e0a-b0ab-51af4747d0bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:14.403613 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973b562a-9335-4e0a-b0ab-51af4747d0bb admin admin] PATH_INFO: `/v3/users/6dd0e9d26c3f4a0482f4f8fa9c1423bc` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:14.404757 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973b562a-9335-4e0a-b0ab-51af4747d0bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=6dd0e9d26c3f4a0482f4f8fa9c1423bc)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:14.407100 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973b562a-9335-4e0a-b0ab-51af4747d0bb admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:14.410301 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1073/2150] 10.222.0.49 () {58 vars in 1153 bytes} [Thu Sep 29 02:13:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:13:14.415252 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5d0789-3c8e-4e71-b7e6-a471d0a50f47 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:14.425521 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5d0789-3c8e-4e71-b7e6-a471d0a50f47 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:14.439419 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43554fe-a153-4349-8821-a1b7fc48ee36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:14.440226 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43554fe-a153-4349-8821-a1b7fc48ee36 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:14.440537 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43554fe-a153-4349-8821-a1b7fc48ee36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:14.441086 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43554fe-a153-4349-8821-a1b7fc48ee36 admin admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:14.441701 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43554fe-a153-4349-8821-a1b7fc48ee36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:14.444729 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43554fe-a153-4349-8821-a1b7fc48ee36 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:14.467284 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-973b562a-9335-4e0a-b0ab-51af4747d0bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6dd0e9d26c3f4a0482f4f8fa9c1423bc'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:14.467986 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-973b562a-9335-4e0a-b0ab-51af4747d0bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6dd0e9d26c3f4a0482f4f8fa9c1423bc'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:14.484263 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1074/2151] 10.222.0.49 () {60 vars in 1153 bytes} [Thu Sep 29 02:13:14 2022] POST /identity/v3/projects => generated 381 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 29 02:13:14.485508 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43554fe-a153-4349-8821-a1b7fc48ee36 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:14.486043 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-973b562a-9335-4e0a-b0ab-51af4747d0bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6dd0e9d26c3f4a0482f4f8fa9c1423bc'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:14.487158 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-a43554fe-a153-4349-8821-a1b7fc48ee36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:14.498942 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-973b562a-9335-4e0a-b0ab-51af4747d0bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6dd0e9d26c3f4a0482f4f8fa9c1423bc'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:14.500485 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-973b562a-9335-4e0a-b0ab-51af4747d0bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6dd0e9d26c3f4a0482f4f8fa9c1423bc'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:14.516468 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1078/2152] 10.222.0.49 () {58 vars in 1224 bytes} [Thu Sep 29 02:13:14 2022] DELETE /identity/v3/users/6dd0e9d26c3f4a0482f4f8fa9c1423bc => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:13:14.521336 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b349c616-fad5-4ef1-b229-07577c30d48a None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:14.521886 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b349c616-fad5-4ef1-b229-07577c30d48a None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:14.522157 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b349c616-fad5-4ef1-b229-07577c30d48a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:14.543861 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-b349c616-fad5-4ef1-b229-07577c30d48a None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:14.545142 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-b349c616-fad5-4ef1-b229-07577c30d48a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:14.566796 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43554fe-a153-4349-8821-a1b7fc48ee36 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:14.618916 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1079/2153] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:13:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 29 02:13:14.630442 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b349c616-fad5-4ef1-b229-07577c30d48a None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:14.632386 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-b349c616-fad5-4ef1-b229-07577c30d48a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:14.655208 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5cb06e-8c4f-4209-9db4-631c1d6c3b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:14.656008 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5cb06e-8c4f-4209-9db4-631c1d6c3b04 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:14.656362 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5cb06e-8c4f-4209-9db4-631c1d6c3b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:14.656794 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5cb06e-8c4f-4209-9db4-631c1d6c3b04 admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:14.657533 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5cb06e-8c4f-4209-9db4-631c1d6c3b04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:14.659771 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5cb06e-8c4f-4209-9db4-631c1d6c3b04 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:14.685357 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1075/2154] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 02:13:14 2022] POST /identity/v3/users => generated 291 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:13:14.686553 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5cb06e-8c4f-4209-9db4-631c1d6c3b04 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:14.697671 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5cb06e-8c4f-4209-9db4-631c1d6c3b04 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:14.702208 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b349c616-fad5-4ef1-b229-07577c30d48a None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:14.702516 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09b07ae-0fdc-4778-a8ad-ed5798067ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:14.703110 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b07ae-0fdc-4778-a8ad-ed5798067ab8 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:14.703392 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b07ae-0fdc-4778-a8ad-ed5798067ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:14.703664 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b07ae-0fdc-4778-a8ad-ed5798067ab8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:14.704308 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09b07ae-0fdc-4778-a8ad-ed5798067ab8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:14.705860 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfc900a-d533-4f5b-a064-eb5c4181b793 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:14.706000 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09b07ae-0fdc-4778-a8ad-ed5798067ab8 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:14.706460 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc900a-d533-4f5b-a064-eb5c4181b793 service neutron] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:14.706760 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc900a-d533-4f5b-a064-eb5c4181b793 service neutron] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:14.707131 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc900a-d533-4f5b-a064-eb5c4181b793 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:14.719321 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1076/2155] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:13:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 29 02:13:14.719475 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfc900a-d533-4f5b-a064-eb5c4181b793 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:14.719475 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfc900a-d533-4f5b-a064-eb5c4181b793 service neutron] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:14.720397 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09b07ae-0fdc-4778-a8ad-ed5798067ab8 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:14.729177 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1080/2156] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:13:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:13:14.730824 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09b07ae-0fdc-4778-a8ad-ed5798067ab8 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:14.735566 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4061cd85-816e-49e1-8f66-7f72d3b5fb68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:14.736162 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4061cd85-816e-49e1-8f66-7f72d3b5fb68 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:14.736441 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4061cd85-816e-49e1-8f66-7f72d3b5fb68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:14.736732 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4061cd85-816e-49e1-8f66-7f72d3b5fb68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:14.737399 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4061cd85-816e-49e1-8f66-7f72d3b5fb68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:14.738976 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4061cd85-816e-49e1-8f66-7f72d3b5fb68 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:14.751274 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1077/2157] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:13:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:13:14.755748 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfc900a-d533-4f5b-a064-eb5c4181b793 service neutron] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:14.765529 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfc900a-d533-4f5b-a064-eb5c4181b793 service neutron] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:14.770995 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47db14df-ffad-4ffe-a034-a45cf2f1f2dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:14.771957 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47db14df-ffad-4ffe-a034-a45cf2f1f2dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:14.772243 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47db14df-ffad-4ffe-a034-a45cf2f1f2dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:14.772514 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47db14df-ffad-4ffe-a034-a45cf2f1f2dd admin admin] PATH_INFO: `/v3/projects/1277408e9cc544d4b9f81ea0bf0a5d57/users/8b990021530c420a8b25f841ff531815/roles/f157f905c9c94ccfbfb46e52d443e8f2` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:14.784081 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:14.788709 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47db14df-ffad-4ffe-a034-a45cf2f1f2dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=1277408e9cc544d4b9f81ea0bf0a5d57, user_id=8b990021530c420a8b25f841ff531815, role_id=f157f905c9c94ccfbfb46e52d443e8f2)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:14.791922 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47db14df-ffad-4ffe-a034-a45cf2f1f2dd admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:14.813009 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1081/2158] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:13:14 2022] PUT /identity/v3/projects/1277408e9cc544d4b9f81ea0bf0a5d57/users/8b990021530c420a8b25f841ff531815/roles/f157f905c9c94ccfbfb46e52d443e8f2 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:13:14.825648 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6853f574-a0d0-4ccd-bab6-25061d18085f None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:14.825963 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6853f574-a0d0-4ccd-bab6-25061d18085f None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:14.826217 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6853f574-a0d0-4ccd-bab6-25061d18085f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:14.858494 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-6853f574-a0d0-4ccd-bab6-25061d18085f None None] MFA Rules not processed for user `8b990021530c420a8b25f841ff531815`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:14.859191 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-6853f574-a0d0-4ccd-bab6-25061d18085f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:14.893137 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:14.952531 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1078/2159] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:13:14 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:13:14.956925 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47db14df-ffad-4ffe-a034-a45cf2f1f2dd admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:15.028185 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47db14df-ffad-4ffe-a034-a45cf2f1f2dd admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:15.033739 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40f1a37-b54c-43e2-a1a0-1f06b8255276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:15.034568 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f1a37-b54c-43e2-a1a0-1f06b8255276 admin admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:15.034921 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f1a37-b54c-43e2-a1a0-1f06b8255276 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:15.035341 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f1a37-b54c-43e2-a1a0-1f06b8255276 admin admin] PATH_INFO: `/v3/projects` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:15.036673 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40f1a37-b54c-43e2-a1a0-1f06b8255276 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:15.038801 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40f1a37-b54c-43e2-a1a0-1f06b8255276 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:15.074939 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1082/2160] 10.222.0.49 () {60 vars in 1153 bytes} [Thu Sep 29 02:13:14 2022] POST /identity/v3/projects => generated 381 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 29 02:13:15.079210 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6853f574-a0d0-4ccd-bab6-25061d18085f None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:15.094063 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6853f574-a0d0-4ccd-bab6-25061d18085f None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:15.173195 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb87034-8f9a-4e4a-9457-f150a90af461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:15.173195 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb87034-8f9a-4e4a-9457-f150a90af461 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:15.173439 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb87034-8f9a-4e4a-9457-f150a90af461 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:15.173560 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb87034-8f9a-4e4a-9457-f150a90af461 admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:15.174208 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb87034-8f9a-4e4a-9457-f150a90af461 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:15.174435 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40f1a37-b54c-43e2-a1a0-1f06b8255276 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:15.176158 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb87034-8f9a-4e4a-9457-f150a90af461 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:15.177330 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-d40f1a37-b54c-43e2-a1a0-1f06b8255276 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:15.211731 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1079/2161] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 02:13:15 2022] POST /identity/v3/users => generated 297 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 29 02:13:15.213925 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb87034-8f9a-4e4a-9457-f150a90af461 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:15.214687 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40f1a37-b54c-43e2-a1a0-1f06b8255276 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:15.227213 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33a0b81-b170-43fd-958b-eb0bc2c2e356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:15.227776 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33a0b81-b170-43fd-958b-eb0bc2c2e356 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:15.228060 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33a0b81-b170-43fd-958b-eb0bc2c2e356 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:15.228465 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33a0b81-b170-43fd-958b-eb0bc2c2e356 admin admin] PATH_INFO: `/v3/projects/f2831aaa96c6429aa5172bff23dae70a` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:15.229584 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33a0b81-b170-43fd-958b-eb0bc2c2e356 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2831aaa96c6429aa5172bff23dae70a)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:15.231499 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33a0b81-b170-43fd-958b-eb0bc2c2e356 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:15.273522 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb87034-8f9a-4e4a-9457-f150a90af461 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:15.280158 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e709620-2c12-4eb4-8d42-9900e07693a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:15.280809 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e709620-2c12-4eb4-8d42-9900e07693a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:15.281068 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e709620-2c12-4eb4-8d42-9900e07693a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:15.281920 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e709620-2c12-4eb4-8d42-9900e07693a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:15.282848 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e709620-2c12-4eb4-8d42-9900e07693a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:15.284640 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e709620-2c12-4eb4-8d42-9900e07693a3 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:15.300972 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1080/2162] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:13:15 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 29 02:13:15.305729 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e709620-2c12-4eb4-8d42-9900e07693a3 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:15.319949 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e709620-2c12-4eb4-8d42-9900e07693a3 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:15.349809 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-d33a0b81-b170-43fd-958b-eb0bc2c2e356 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2831aaa96c6429aa5172bff23dae70a', 'request_id': 'req-d33a0b81-b170-43fd-958b-eb0bc2c2e356'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:15.367858 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-d33a0b81-b170-43fd-958b-eb0bc2c2e356 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2831aaa96c6429aa5172bff23dae70a', 'request_id': 'req-d33a0b81-b170-43fd-958b-eb0bc2c2e356'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:15.387096 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-d33a0b81-b170-43fd-958b-eb0bc2c2e356 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2831aaa96c6429aa5172bff23dae70a', 'request_id': 'req-d33a0b81-b170-43fd-958b-eb0bc2c2e356'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:15.402095 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f001d3-c94e-43ac-842f-f4e4accd6efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:15.403456 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f001d3-c94e-43ac-842f-f4e4accd6efd admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:15.404647 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f001d3-c94e-43ac-842f-f4e4accd6efd admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:15.404945 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f001d3-c94e-43ac-842f-f4e4accd6efd admin admin] PATH_INFO: `/v3/projects/40adacefd6714ea2936223ac9646971b/users/7d07e19dff024c3fa9217faa97764eb4/roles/fe9bbc67742f4f5893f39b18eb31d59a` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:15.414688 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-d33a0b81-b170-43fd-958b-eb0bc2c2e356 admin admin] The token cache is being invalidate because project f2831aaa96c6429aa5172bff23dae70a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81648) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:13:15.415218 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-d33a0b81-b170-43fd-958b-eb0bc2c2e356 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:15.416768 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-d33a0b81-b170-43fd-958b-eb0bc2c2e356 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:15.418763 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1083/2163] 10.222.0.49 () {58 vars in 1233 bytes} [Thu Sep 29 02:13:15 2022] DELETE /identity/v3/projects/f2831aaa96c6429aa5172bff23dae70a => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:13:15.422982 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33a0b81-b170-43fd-958b-eb0bc2c2e356 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:15.426080 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-d33a0b81-b170-43fd-958b-eb0bc2c2e356 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:15.446168 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f001d3-c94e-43ac-842f-f4e4accd6efd admin admin] RBAC: Authorizing `identity:create_grant(project_id=40adacefd6714ea2936223ac9646971b, user_id=7d07e19dff024c3fa9217faa97764eb4, role_id=fe9bbc67742f4f5893f39b18eb31d59a)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:15.448150 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33a0b81-b170-43fd-958b-eb0bc2c2e356 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:15.451155 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f001d3-c94e-43ac-842f-f4e4accd6efd admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:15.454051 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2174034-547c-47ce-8ee7-c3bd46385b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:15.454843 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2174034-547c-47ce-8ee7-c3bd46385b6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:15.455340 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2174034-547c-47ce-8ee7-c3bd46385b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:15.455751 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2174034-547c-47ce-8ee7-c3bd46385b6b admin admin] PATH_INFO: `/v3/users/fbe50fc8593e4579b9bf7e2e0d964fa7` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:15.457049 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2174034-547c-47ce-8ee7-c3bd46385b6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbe50fc8593e4579b9bf7e2e0d964fa7)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:15.460293 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2174034-547c-47ce-8ee7-c3bd46385b6b admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:15.476606 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1081/2164] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:13:15 2022] PUT /identity/v3/projects/40adacefd6714ea2936223ac9646971b/users/7d07e19dff024c3fa9217faa97764eb4/roles/fe9bbc67742f4f5893f39b18eb31d59a => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:13:15.480727 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f001d3-c94e-43ac-842f-f4e4accd6efd admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:15.482774 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-22f001d3-c94e-43ac-842f-f4e4accd6efd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:15.524589 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:15.559113 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-a2174034-547c-47ce-8ee7-c3bd46385b6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbe50fc8593e4579b9bf7e2e0d964fa7'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:15.561933 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-a2174034-547c-47ce-8ee7-c3bd46385b6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbe50fc8593e4579b9bf7e2e0d964fa7'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:15.570715 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=83,keystone:INSERT=3,keystone:DELETE=14 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:15.582380 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-a2174034-547c-47ce-8ee7-c3bd46385b6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbe50fc8593e4579b9bf7e2e0d964fa7'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:15.587581 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f001d3-c94e-43ac-842f-f4e4accd6efd admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:15.592976 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-a2174034-547c-47ce-8ee7-c3bd46385b6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbe50fc8593e4579b9bf7e2e0d964fa7'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:15.593133 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c321802-f8b1-4119-8aa1-9d77ea26e888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:15.593928 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c321802-f8b1-4119-8aa1-9d77ea26e888 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:15.594058 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-a2174034-547c-47ce-8ee7-c3bd46385b6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbe50fc8593e4579b9bf7e2e0d964fa7'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:15.594245 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c321802-f8b1-4119-8aa1-9d77ea26e888 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:15.594522 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c321802-f8b1-4119-8aa1-9d77ea26e888 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:15.595177 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c321802-f8b1-4119-8aa1-9d77ea26e888 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:15.597173 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c321802-f8b1-4119-8aa1-9d77ea26e888 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:15.609351 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1082/2165] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:13:15 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:13:15.614660 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c321802-f8b1-4119-8aa1-9d77ea26e888 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:15.616798 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1084/2166] 10.222.0.49 () {58 vars in 1224 bytes} [Thu Sep 29 02:13:15 2022] DELETE /identity/v3/users/fbe50fc8593e4579b9bf7e2e0d964fa7 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:13:15.620718 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-4c321802-f8b1-4119-8aa1-9d77ea26e888 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:15.632571 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c321802-f8b1-4119-8aa1-9d77ea26e888 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:15.764693 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f833213-f6dc-4534-93f2-5bb7d01129c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:15.765357 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f833213-f6dc-4534-93f2-5bb7d01129c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:15.765632 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f833213-f6dc-4534-93f2-5bb7d01129c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:15.765919 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f833213-f6dc-4534-93f2-5bb7d01129c3 admin admin] PATH_INFO: `/v3/projects/40adacefd6714ea2936223ac9646971b/users/7d07e19dff024c3fa9217faa97764eb4/roles/fe9bbc67742f4f5893f39b18eb31d59a` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:15.771153 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f833213-f6dc-4534-93f2-5bb7d01129c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40adacefd6714ea2936223ac9646971b, user_id=7d07e19dff024c3fa9217faa97764eb4, role_id=fe9bbc67742f4f5893f39b18eb31d59a)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:15.778983 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f833213-f6dc-4534-93f2-5bb7d01129c3 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:15.812385 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1083/2167] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:13:15 2022] PUT /identity/v3/projects/40adacefd6714ea2936223ac9646971b/users/7d07e19dff024c3fa9217faa97764eb4/roles/fe9bbc67742f4f5893f39b18eb31d59a => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:13:15.824088 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e56db-9890-48bc-b20c-3162ea7a9e7b None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:15.824379 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e56db-9890-48bc-b20c-3162ea7a9e7b None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:15.824660 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e56db-9890-48bc-b20c-3162ea7a9e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:15.922942 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-c50e56db-9890-48bc-b20c-3162ea7a9e7b None None] MFA Rules not processed for user `7d07e19dff024c3fa9217faa97764eb4`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:15.925144 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-c50e56db-9890-48bc-b20c-3162ea7a9e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:16.024833 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1085/2168] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:13:15 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:13:16.039963 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f833213-f6dc-4534-93f2-5bb7d01129c3 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:16.042371 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-2f833213-f6dc-4534-93f2-5bb7d01129c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:16.097575 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50e56db-9890-48bc-b20c-3162ea7a9e7b None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:16.099622 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-c50e56db-9890-48bc-b20c-3162ea7a9e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:16.131472 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f833213-f6dc-4534-93f2-5bb7d01129c3 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:16.135979 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c952cf6b-e0a4-4ec0-b03f-6ee559b0ac5f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75135b856134ba4b9ccac337886f682', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:16.137015 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c952cf6b-e0a4-4ec0-b03f-6ee559b0ac5f service cinder] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:16.137455 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c952cf6b-e0a4-4ec0-b03f-6ee559b0ac5f service cinder] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:16.137917 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c952cf6b-e0a4-4ec0-b03f-6ee559b0ac5f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:16.151557 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c952cf6b-e0a4-4ec0-b03f-6ee559b0ac5f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:16.153101 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c952cf6b-e0a4-4ec0-b03f-6ee559b0ac5f service cinder] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:16.164778 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1084/2169] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:13:16 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:13:16.184690 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50e56db-9890-48bc-b20c-3162ea7a9e7b None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:16.189736 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def10a32-03ba-4b27-afe0-dd881be6ffc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:16.190654 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def10a32-03ba-4b27-afe0-dd881be6ffc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:16.190938 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def10a32-03ba-4b27-afe0-dd881be6ffc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:16.191316 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def10a32-03ba-4b27-afe0-dd881be6ffc2 admin admin] PATH_INFO: `/v3/projects/87fb6a44bfc64debb56cb94b1e901442` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:16.193072 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def10a32-03ba-4b27-afe0-dd881be6ffc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87fb6a44bfc64debb56cb94b1e901442)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:16.195089 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def10a32-03ba-4b27-afe0-dd881be6ffc2 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:16.252604 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-def10a32-03ba-4b27-afe0-dd881be6ffc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87fb6a44bfc64debb56cb94b1e901442', 'request_id': 'req-def10a32-03ba-4b27-afe0-dd881be6ffc2'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:16.263687 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-def10a32-03ba-4b27-afe0-dd881be6ffc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87fb6a44bfc64debb56cb94b1e901442', 'request_id': 'req-def10a32-03ba-4b27-afe0-dd881be6ffc2'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:16.267043 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:16.274005 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-def10a32-03ba-4b27-afe0-dd881be6ffc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87fb6a44bfc64debb56cb94b1e901442', 'request_id': 'req-def10a32-03ba-4b27-afe0-dd881be6ffc2'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:16.296210 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-def10a32-03ba-4b27-afe0-dd881be6ffc2 admin admin] The token cache is being invalidate because project 87fb6a44bfc64debb56cb94b1e901442 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81648) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:13:16.296756 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-def10a32-03ba-4b27-afe0-dd881be6ffc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:16.297472 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-def10a32-03ba-4b27-afe0-dd881be6ffc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:16.302531 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1086/2170] 10.222.0.49 () {58 vars in 1233 bytes} [Thu Sep 29 02:13:16 2022] DELETE /identity/v3/projects/87fb6a44bfc64debb56cb94b1e901442 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:13:16.304257 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c952cf6b-e0a4-4ec0-b03f-6ee559b0ac5f service cinder] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:16.317163 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c952cf6b-e0a4-4ec0-b03f-6ee559b0ac5f service cinder] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:16.401301 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f8ccce-ab55-4040-9e77-eef20aba4890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:16.402366 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f8ccce-ab55-4040-9e77-eef20aba4890 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:16.402701 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f8ccce-ab55-4040-9e77-eef20aba4890 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:16.403054 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f8ccce-ab55-4040-9e77-eef20aba4890 admin admin] PATH_INFO: `/v3/users/d601fcadb31f4684af60bfb9eac44df5` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:16.404467 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f8ccce-ab55-4040-9e77-eef20aba4890 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d601fcadb31f4684af60bfb9eac44df5)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:16.406959 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f8ccce-ab55-4040-9e77-eef20aba4890 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:16.413415 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:16.479727 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-60f8ccce-ab55-4040-9e77-eef20aba4890 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd601fcadb31f4684af60bfb9eac44df5'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:16.480546 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-60f8ccce-ab55-4040-9e77-eef20aba4890 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd601fcadb31f4684af60bfb9eac44df5'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:16.497948 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-60f8ccce-ab55-4040-9e77-eef20aba4890 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd601fcadb31f4684af60bfb9eac44df5'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:16.507254 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-60f8ccce-ab55-4040-9e77-eef20aba4890 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd601fcadb31f4684af60bfb9eac44df5'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:16.508073 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-60f8ccce-ab55-4040-9e77-eef20aba4890 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd601fcadb31f4684af60bfb9eac44df5'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:16.541090 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def10a32-03ba-4b27-afe0-dd881be6ffc2 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:16.542644 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-def10a32-03ba-4b27-afe0-dd881be6ffc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:16.548192 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1085/2171] 10.222.0.49 () {58 vars in 1224 bytes} [Thu Sep 29 02:13:16 2022] DELETE /identity/v3/users/d601fcadb31f4684af60bfb9eac44df5 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:13:16.640224 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def10a32-03ba-4b27-afe0-dd881be6ffc2 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:16.747085 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42430ddd-486e-4d69-8cb9-9672a1db89c4 tempest-VolumeQuotaClassesTest-1285366440 tempest-VolumeQuotaClassesTest-1285366440-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d07e19dff024c3fa9217faa97764eb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40adacefd6714ea2936223ac9646971b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:16.747719 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42430ddd-486e-4d69-8cb9-9672a1db89c4 tempest-VolumeQuotaClassesTest-1285366440 tempest-VolumeQuotaClassesTest-1285366440-project-admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:16.748174 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42430ddd-486e-4d69-8cb9-9672a1db89c4 tempest-VolumeQuotaClassesTest-1285366440 tempest-VolumeQuotaClassesTest-1285366440-project-admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:16.748564 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42430ddd-486e-4d69-8cb9-9672a1db89c4 tempest-VolumeQuotaClassesTest-1285366440 tempest-VolumeQuotaClassesTest-1285366440-project-admin] PATH_INFO: `/v3/domains` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:16.749304 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42430ddd-486e-4d69-8cb9-9672a1db89c4 tempest-VolumeQuotaClassesTest-1285366440 tempest-VolumeQuotaClassesTest-1285366440-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:13:16.749537 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42430ddd-486e-4d69-8cb9-9672a1db89c4 tempest-VolumeQuotaClassesTest-1285366440 tempest-VolumeQuotaClassesTest-1285366440-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:16.751096 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42430ddd-486e-4d69-8cb9-9672a1db89c4 tempest-VolumeQuotaClassesTest-1285366440 tempest-VolumeQuotaClassesTest-1285366440-project-admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:16.767051 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1087/2172] 10.222.0.49 () {58 vars in 1153 bytes} [Thu Sep 29 02:13:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:13:16.771287 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f8ccce-ab55-4040-9e77-eef20aba4890 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:16.773025 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-60f8ccce-ab55-4040-9e77-eef20aba4890 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:16.786388 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f8ccce-ab55-4040-9e77-eef20aba4890 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:16.791068 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba109c3-2733-43da-93a1-b7b075c15dce tempest-VolumeQuotaClassesTest-1285366440 tempest-VolumeQuotaClassesTest-1285366440-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d07e19dff024c3fa9217faa97764eb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40adacefd6714ea2936223ac9646971b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:16.791997 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba109c3-2733-43da-93a1-b7b075c15dce tempest-VolumeQuotaClassesTest-1285366440 tempest-VolumeQuotaClassesTest-1285366440-project-admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:16.792269 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba109c3-2733-43da-93a1-b7b075c15dce tempest-VolumeQuotaClassesTest-1285366440 tempest-VolumeQuotaClassesTest-1285366440-project-admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:16.792542 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba109c3-2733-43da-93a1-b7b075c15dce tempest-VolumeQuotaClassesTest-1285366440 tempest-VolumeQuotaClassesTest-1285366440-project-admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:16.793179 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba109c3-2733-43da-93a1-b7b075c15dce tempest-VolumeQuotaClassesTest-1285366440 tempest-VolumeQuotaClassesTest-1285366440-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:16.795569 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba109c3-2733-43da-93a1-b7b075c15dce tempest-VolumeQuotaClassesTest-1285366440 tempest-VolumeQuotaClassesTest-1285366440-project-admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:16.827036 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1086/2173] 10.222.0.49 () {60 vars in 1153 bytes} [Thu Sep 29 02:13:16 2022] POST /identity/v3/projects => generated 354 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 29 02:13:16.830893 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42430ddd-486e-4d69-8cb9-9672a1db89c4 tempest-VolumeQuotaClassesTest-1285366440 tempest-VolumeQuotaClassesTest-1285366440-project-admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:16.842935 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42430ddd-486e-4d69-8cb9-9672a1db89c4 tempest-VolumeQuotaClassesTest-1285366440 tempest-VolumeQuotaClassesTest-1285366440-project-admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:16.888830 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba109c3-2733-43da-93a1-b7b075c15dce tempest-VolumeQuotaClassesTest-1285366440 tempest-VolumeQuotaClassesTest-1285366440-project-admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:16.890630 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-9ba109c3-2733-43da-93a1-b7b075c15dce tempest-VolumeQuotaClassesTest-1285366440 tempest-VolumeQuotaClassesTest-1285366440-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:16.935145 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a4331e-9806-4cc5-8f56-6670bf9069cc tempest-VolumeQuotaClassesTest-1285366440 tempest-VolumeQuotaClassesTest-1285366440-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d07e19dff024c3fa9217faa97764eb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40adacefd6714ea2936223ac9646971b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:16.935982 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a4331e-9806-4cc5-8f56-6670bf9069cc tempest-VolumeQuotaClassesTest-1285366440 tempest-VolumeQuotaClassesTest-1285366440-project-admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:16.936342 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a4331e-9806-4cc5-8f56-6670bf9069cc tempest-VolumeQuotaClassesTest-1285366440 tempest-VolumeQuotaClassesTest-1285366440-project-admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:16.936706 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a4331e-9806-4cc5-8f56-6670bf9069cc tempest-VolumeQuotaClassesTest-1285366440 tempest-VolumeQuotaClassesTest-1285366440-project-admin] PATH_INFO: `/v3/domains` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:16.937448 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a4331e-9806-4cc5-8f56-6670bf9069cc tempest-VolumeQuotaClassesTest-1285366440 tempest-VolumeQuotaClassesTest-1285366440-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:13:16.937804 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a4331e-9806-4cc5-8f56-6670bf9069cc tempest-VolumeQuotaClassesTest-1285366440 tempest-VolumeQuotaClassesTest-1285366440-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:16.940551 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a4331e-9806-4cc5-8f56-6670bf9069cc tempest-VolumeQuotaClassesTest-1285366440 tempest-VolumeQuotaClassesTest-1285366440-project-admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:16.962845 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1088/2174] 10.222.0.49 () {58 vars in 1153 bytes} [Thu Sep 29 02:13:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 02:13:17.006027 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a4331e-9806-4cc5-8f56-6670bf9069cc tempest-VolumeQuotaClassesTest-1285366440 tempest-VolumeQuotaClassesTest-1285366440-project-admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:17.008408 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba109c3-2733-43da-93a1-b7b075c15dce tempest-VolumeQuotaClassesTest-1285366440 tempest-VolumeQuotaClassesTest-1285366440-project-admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:17.014031 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa696da-174f-4d94-a095-21507d85a985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:17.015047 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa696da-174f-4d94-a095-21507d85a985 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:17.015488 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa696da-174f-4d94-a095-21507d85a985 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:17.015733 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa696da-174f-4d94-a095-21507d85a985 admin admin] PATH_INFO: `/v3/projects/e9d9e378bb3e4a67acdec5b907934cb1` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:17.017512 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa696da-174f-4d94-a095-21507d85a985 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9d9e378bb3e4a67acdec5b907934cb1)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:17.021810 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa696da-174f-4d94-a095-21507d85a985 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:17.023831 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a4331e-9806-4cc5-8f56-6670bf9069cc tempest-VolumeQuotaClassesTest-1285366440 tempest-VolumeQuotaClassesTest-1285366440-project-admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:17.030295 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4323f6-6295-44d8-8470-4c4fe1c721d1 tempest-VolumeQuotaClassesTest-1285366440 tempest-VolumeQuotaClassesTest-1285366440-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d07e19dff024c3fa9217faa97764eb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40adacefd6714ea2936223ac9646971b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:17.031989 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4323f6-6295-44d8-8470-4c4fe1c721d1 tempest-VolumeQuotaClassesTest-1285366440 tempest-VolumeQuotaClassesTest-1285366440-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:17.032387 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4323f6-6295-44d8-8470-4c4fe1c721d1 tempest-VolumeQuotaClassesTest-1285366440 tempest-VolumeQuotaClassesTest-1285366440-project-admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:17.032666 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4323f6-6295-44d8-8470-4c4fe1c721d1 tempest-VolumeQuotaClassesTest-1285366440 tempest-VolumeQuotaClassesTest-1285366440-project-admin] PATH_INFO: `/v3/projects/3115f593ea5e405b8ea7f571fe11bc28` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:17.034069 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4323f6-6295-44d8-8470-4c4fe1c721d1 tempest-VolumeQuotaClassesTest-1285366440 tempest-VolumeQuotaClassesTest-1285366440-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3115f593ea5e405b8ea7f571fe11bc28)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:17.036382 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4323f6-6295-44d8-8470-4c4fe1c721d1 tempest-VolumeQuotaClassesTest-1285366440 tempest-VolumeQuotaClassesTest-1285366440-project-admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:17.066579 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:17.089607 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-8fa696da-174f-4d94-a095-21507d85a985 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9d9e378bb3e4a67acdec5b907934cb1', 'request_id': 'req-8fa696da-174f-4d94-a095-21507d85a985'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:17.100942 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-8fa696da-174f-4d94-a095-21507d85a985 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9d9e378bb3e4a67acdec5b907934cb1', 'request_id': 'req-8fa696da-174f-4d94-a095-21507d85a985'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:17.112117 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-8fa696da-174f-4d94-a095-21507d85a985 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9d9e378bb3e4a67acdec5b907934cb1', 'request_id': 'req-8fa696da-174f-4d94-a095-21507d85a985'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:17.114576 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-7d4323f6-6295-44d8-8470-4c4fe1c721d1 tempest-VolumeQuotaClassesTest-1285366440 tempest-VolumeQuotaClassesTest-1285366440-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3115f593ea5e405b8ea7f571fe11bc28', 'request_id': 'req-7d4323f6-6295-44d8-8470-4c4fe1c721d1'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:17.116900 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=81,keystone:DELETE=16,keystone:INSERT=3 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:17.128085 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-7d4323f6-6295-44d8-8470-4c4fe1c721d1 tempest-VolumeQuotaClassesTest-1285366440 tempest-VolumeQuotaClassesTest-1285366440-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3115f593ea5e405b8ea7f571fe11bc28', 'request_id': 'req-7d4323f6-6295-44d8-8470-4c4fe1c721d1'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:17.134256 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-8fa696da-174f-4d94-a095-21507d85a985 admin admin] The token cache is being invalidate because project e9d9e378bb3e4a67acdec5b907934cb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81649) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:13:17.134946 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-8fa696da-174f-4d94-a095-21507d85a985 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:17.135743 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-8fa696da-174f-4d94-a095-21507d85a985 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:17.141390 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1087/2175] 10.222.0.49 () {58 vars in 1233 bytes} [Thu Sep 29 02:13:16 2022] DELETE /identity/v3/projects/e9d9e378bb3e4a67acdec5b907934cb1 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:13:17.142918 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6065a919-3d83-43a5-bb4e-3131993af0b6 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:17.143057 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-7d4323f6-6295-44d8-8470-4c4fe1c721d1 tempest-VolumeQuotaClassesTest-1285366440 tempest-VolumeQuotaClassesTest-1285366440-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3115f593ea5e405b8ea7f571fe11bc28', 'request_id': 'req-7d4323f6-6295-44d8-8470-4c4fe1c721d1'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:17.143246 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6065a919-3d83-43a5-bb4e-3131993af0b6 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:17.143470 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6065a919-3d83-43a5-bb4e-3131993af0b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:17.161753 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-7d4323f6-6295-44d8-8470-4c4fe1c721d1 tempest-VolumeQuotaClassesTest-1285366440 tempest-VolumeQuotaClassesTest-1285366440-project-admin] The token cache is being invalidate because project 3115f593ea5e405b8ea7f571fe11bc28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81648) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:13:17.162365 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-7d4323f6-6295-44d8-8470-4c4fe1c721d1 tempest-VolumeQuotaClassesTest-1285366440 tempest-VolumeQuotaClassesTest-1285366440-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:17.163217 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-7d4323f6-6295-44d8-8470-4c4fe1c721d1 tempest-VolumeQuotaClassesTest-1285366440 tempest-VolumeQuotaClassesTest-1285366440-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:17.164902 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1089/2176] 10.222.0.49 () {58 vars in 1233 bytes} [Thu Sep 29 02:13:17 2022] DELETE /identity/v3/projects/3115f593ea5e405b8ea7f571fe11bc28 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:13:17.194071 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-6065a919-3d83-43a5-bb4e-3131993af0b6 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:17.194071 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-6065a919-3d83-43a5-bb4e-3131993af0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:17.199725 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9962d455-c68c-44aa-a001-6efbcbfba17c None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:17.199984 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9962d455-c68c-44aa-a001-6efbcbfba17c None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:17.200261 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9962d455-c68c-44aa-a001-6efbcbfba17c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:17.225847 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-9962d455-c68c-44aa-a001-6efbcbfba17c None None] MFA Rules not processed for user `0f8f13f302de4701a7f4e0562bca08cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:17.227131 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-9962d455-c68c-44aa-a001-6efbcbfba17c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:17.266352 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1088/2177] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:13:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:13:17.275109 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0424b0-52da-4d9a-b1e4-0cbf6c0a17a9 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:17.275354 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0424b0-52da-4d9a-b1e4-0cbf6c0a17a9 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:17.276046 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0424b0-52da-4d9a-b1e4-0cbf6c0a17a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:17.302543 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1090/2178] 10.222.0.49 () {58 vars in 1009 bytes} [Thu Sep 29 02:13:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:13:17.308537 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-ee0424b0-52da-4d9a-b1e4-0cbf6c0a17a9 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:17.309898 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-ee0424b0-52da-4d9a-b1e4-0cbf6c0a17a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:17.318604 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1089/2179] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:13:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 29 02:13:17.329161 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9962d455-c68c-44aa-a001-6efbcbfba17c None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:17.343990 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9962d455-c68c-44aa-a001-6efbcbfba17c None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:17.350120 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be11dfd5-d161-4a39-b784-bdfdabaa325c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:17.350737 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be11dfd5-d161-4a39-b784-bdfdabaa325c admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:17.351469 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be11dfd5-d161-4a39-b784-bdfdabaa325c admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:17.351469 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be11dfd5-d161-4a39-b784-bdfdabaa325c admin admin] PATH_INFO: `/v3/domains` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:17.352027 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be11dfd5-d161-4a39-b784-bdfdabaa325c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:13:17.352332 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be11dfd5-d161-4a39-b784-bdfdabaa325c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:17.354090 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be11dfd5-d161-4a39-b784-bdfdabaa325c admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:17.359710 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0424b0-52da-4d9a-b1e4-0cbf6c0a17a9 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:17.361786 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-ee0424b0-52da-4d9a-b1e4-0cbf6c0a17a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:17.368888 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1091/2180] 10.222.0.49 () {58 vars in 1153 bytes} [Thu Sep 29 02:13:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:13:17.373217 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be11dfd5-d161-4a39-b784-bdfdabaa325c admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:17.385382 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be11dfd5-d161-4a39-b784-bdfdabaa325c admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:17.390872 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8d8aec-b502-47f9-9be8-4540c9824c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:17.391482 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d8aec-b502-47f9-9be8-4540c9824c6c admin admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:17.391763 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d8aec-b502-47f9-9be8-4540c9824c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:17.392034 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d8aec-b502-47f9-9be8-4540c9824c6c admin admin] PATH_INFO: `/v3/projects` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:17.392694 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8d8aec-b502-47f9-9be8-4540c9824c6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:17.394688 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8d8aec-b502-47f9-9be8-4540c9824c6c admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:17.426414 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1092/2181] 10.222.0.49 () {60 vars in 1153 bytes} [Thu Sep 29 02:13:17 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 29 02:13:17.430379 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8d8aec-b502-47f9-9be8-4540c9824c6c admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:17.432109 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-ad8d8aec-b502-47f9-9be8-4540c9824c6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:17.445707 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0424b0-52da-4d9a-b1e4-0cbf6c0a17a9 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:17.503616 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8d8aec-b502-47f9-9be8-4540c9824c6c admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:17.508000 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d47677-7364-4e5f-abd1-353a9c8fc38a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c88bc0f32600416ca7c6a59f4196e497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:17.508614 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d47677-7364-4e5f-abd1-353a9c8fc38a service swift] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:17.508776 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d862d076-0bdf-4e53-957e-23f7874717d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:17.508887 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d47677-7364-4e5f-abd1-353a9c8fc38a service swift] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:17.509145 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d47677-7364-4e5f-abd1-353a9c8fc38a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:17.509430 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d862d076-0bdf-4e53-957e-23f7874717d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:17.509714 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d862d076-0bdf-4e53-957e-23f7874717d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:17.509982 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d862d076-0bdf-4e53-957e-23f7874717d4 admin admin] PATH_INFO: `/v3/users/8b990021530c420a8b25f841ff531815` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:17.511135 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d862d076-0bdf-4e53-957e-23f7874717d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b990021530c420a8b25f841ff531815)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:17.513057 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d862d076-0bdf-4e53-957e-23f7874717d4 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:17.527728 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:17.541279 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:17.566833 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-d862d076-0bdf-4e53-957e-23f7874717d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b990021530c420a8b25f841ff531815'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:17.568221 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-d862d076-0bdf-4e53-957e-23f7874717d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b990021530c420a8b25f841ff531815'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:17.575224 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d47677-7364-4e5f-abd1-353a9c8fc38a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:17.576888 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d47677-7364-4e5f-abd1-353a9c8fc38a service swift] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:17.582346 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-d862d076-0bdf-4e53-957e-23f7874717d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b990021530c420a8b25f841ff531815'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:17.585665 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1090/2182] 10.222.0.49 () {60 vars in 1384 bytes} [Thu Sep 29 02:13:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 29 02:13:17.586442 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d47677-7364-4e5f-abd1-353a9c8fc38a service swift] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:17.595731 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-d862d076-0bdf-4e53-957e-23f7874717d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b990021530c420a8b25f841ff531815'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:17.596614 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-d862d076-0bdf-4e53-957e-23f7874717d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b990021530c420a8b25f841ff531815'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:17.599524 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d47677-7364-4e5f-abd1-353a9c8fc38a service swift] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:17.604980 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdf93fe-a001-4909-8485-029cf7fedb46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:17.605616 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf93fe-a001-4909-8485-029cf7fedb46 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:17.605986 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf93fe-a001-4909-8485-029cf7fedb46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:17.606419 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf93fe-a001-4909-8485-029cf7fedb46 admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:17.606887 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdf93fe-a001-4909-8485-029cf7fedb46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:17.608818 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdf93fe-a001-4909-8485-029cf7fedb46 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:17.623910 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1093/2183] 10.222.0.49 () {58 vars in 1224 bytes} [Thu Sep 29 02:13:17 2022] DELETE /identity/v3/users/8b990021530c420a8b25f841ff531815 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:13:17.630226 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23cab22-453b-4756-be2f-73d33490c4ac None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:17.630642 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23cab22-453b-4756-be2f-73d33490c4ac None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:17.631017 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23cab22-453b-4756-be2f-73d33490c4ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:17.635258 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1091/2184] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 02:13:17 2022] POST /identity/v3/users => generated 287 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:13:17.639672 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdf93fe-a001-4909-8485-029cf7fedb46 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:17.643123 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-8cdf93fe-a001-4909-8485-029cf7fedb46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:17.654746 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-d23cab22-453b-4756-be2f-73d33490c4ac None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:17.655954 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-d23cab22-453b-4756-be2f-73d33490c4ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:17.658844 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdf93fe-a001-4909-8485-029cf7fedb46 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:17.737797 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a821c4-556a-496a-b687-09c163402747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:17.739499 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a821c4-556a-496a-b687-09c163402747 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:17.739838 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a821c4-556a-496a-b687-09c163402747 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:17.740229 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a821c4-556a-496a-b687-09c163402747 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:17.741016 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a821c4-556a-496a-b687-09c163402747 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:17.742384 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1094/2185] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:13:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 29 02:13:17.743422 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a821c4-556a-496a-b687-09c163402747 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:17.756266 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23cab22-453b-4756-be2f-73d33490c4ac None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:17.757774 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-d23cab22-453b-4756-be2f-73d33490c4ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:17.767637 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1092/2186] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:13:17 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:13:17.773762 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a821c4-556a-496a-b687-09c163402747 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:17.787610 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a821c4-556a-496a-b687-09c163402747 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:17.792853 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104b12e0-5d9b-4302-9d4d-c8d39a64e379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:17.793496 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104b12e0-5d9b-4302-9d4d-c8d39a64e379 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:17.793781 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104b12e0-5d9b-4302-9d4d-c8d39a64e379 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:17.794216 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104b12e0-5d9b-4302-9d4d-c8d39a64e379 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:17.794885 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104b12e0-5d9b-4302-9d4d-c8d39a64e379 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:17.798803 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104b12e0-5d9b-4302-9d4d-c8d39a64e379 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:17.813785 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1093/2187] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:13:17 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 29 02:13:17.819415 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104b12e0-5d9b-4302-9d4d-c8d39a64e379 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:17.833733 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104b12e0-5d9b-4302-9d4d-c8d39a64e379 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:17.857159 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016ff838-f09b-4307-92d5-08a8b0f90c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:17.857159 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016ff838-f09b-4307-92d5-08a8b0f90c81 admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:17.857159 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016ff838-f09b-4307-92d5-08a8b0f90c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:17.857159 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016ff838-f09b-4307-92d5-08a8b0f90c81 admin admin] PATH_INFO: `/v3/projects/d06e11b31c404d7eaf1701be9001c76d/users/5e482260d1d840b4821122a7896c0a2b/roles/f157f905c9c94ccfbfb46e52d443e8f2` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:17.874334 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23cab22-453b-4756-be2f-73d33490c4ac None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:17.882084 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f16e34-3267-454f-982b-fbae047f1be8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:17.882595 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f16e34-3267-454f-982b-fbae047f1be8 service neutron] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:17.883578 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016ff838-f09b-4307-92d5-08a8b0f90c81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d06e11b31c404d7eaf1701be9001c76d, user_id=5e482260d1d840b4821122a7896c0a2b, role_id=f157f905c9c94ccfbfb46e52d443e8f2)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:17.885660 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f16e34-3267-454f-982b-fbae047f1be8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:17.886171 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f16e34-3267-454f-982b-fbae047f1be8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:17.887218 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016ff838-f09b-4307-92d5-08a8b0f90c81 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:17.900888 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f16e34-3267-454f-982b-fbae047f1be8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:17.902525 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f16e34-3267-454f-982b-fbae047f1be8 service neutron] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:17.906331 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1094/2188] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:13:17 2022] PUT /identity/v3/projects/d06e11b31c404d7eaf1701be9001c76d/users/5e482260d1d840b4821122a7896c0a2b/roles/f157f905c9c94ccfbfb46e52d443e8f2 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:13:17.917491 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396ae9a7-8084-43bc-9885-d462ea1fad19 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:17.917847 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396ae9a7-8084-43bc-9885-d462ea1fad19 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:17.918143 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396ae9a7-8084-43bc-9885-d462ea1fad19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:17.921056 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1095/2189] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:13:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 29 02:13:17.941672 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-396ae9a7-8084-43bc-9885-d462ea1fad19 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:17.942998 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-396ae9a7-8084-43bc-9885-d462ea1fad19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:18.034923 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1095/2190] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:13:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:13:18.046613 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f16e34-3267-454f-982b-fbae047f1be8 service neutron] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:18.049740 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-f1f16e34-3267-454f-982b-fbae047f1be8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:18.062444 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f16e34-3267-454f-982b-fbae047f1be8 service neutron] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:18.111151 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:18.136721 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36a8c05-9833-4a63-855b-486d4fa7d941 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:18.137331 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a8c05-9833-4a63-855b-486d4fa7d941 service neutron] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:18.137628 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a8c05-9833-4a63-855b-486d4fa7d941 service neutron] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:18.137913 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a8c05-9833-4a63-855b-486d4fa7d941 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:18.149128 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36a8c05-9833-4a63-855b-486d4fa7d941 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:18.150606 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36a8c05-9833-4a63-855b-486d4fa7d941 service neutron] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:18.161453 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1096/2191] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:13:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:13:18.292551 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396ae9a7-8084-43bc-9885-d462ea1fad19 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:18.295138 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-396ae9a7-8084-43bc-9885-d462ea1fad19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:18.318199 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396ae9a7-8084-43bc-9885-d462ea1fad19 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:18.325301 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2248b6ae-7cf0-4728-8daa-40624a4c7f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:18.326354 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2248b6ae-7cf0-4728-8daa-40624a4c7f11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:18.326816 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2248b6ae-7cf0-4728-8daa-40624a4c7f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:18.327335 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2248b6ae-7cf0-4728-8daa-40624a4c7f11 admin admin] PATH_INFO: `/v3/projects/1277408e9cc544d4b9f81ea0bf0a5d57` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:18.328748 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2248b6ae-7cf0-4728-8daa-40624a4c7f11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1277408e9cc544d4b9f81ea0bf0a5d57)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:18.333393 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2248b6ae-7cf0-4728-8daa-40624a4c7f11 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:18.372221 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:18.424466 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd4a7c-32e4-4b83-8e16-1ecb13433779 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:18.424824 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd4a7c-32e4-4b83-8e16-1ecb13433779 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:18.425217 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd4a7c-32e4-4b83-8e16-1ecb13433779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:18.452652 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-16bd4a7c-32e4-4b83-8e16-1ecb13433779 None None] MFA Rules not processed for user `0f8f13f302de4701a7f4e0562bca08cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:18.454138 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-16bd4a7c-32e4-4b83-8e16-1ecb13433779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:18.470641 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-2248b6ae-7cf0-4728-8daa-40624a4c7f11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1277408e9cc544d4b9f81ea0bf0a5d57', 'request_id': 'req-2248b6ae-7cf0-4728-8daa-40624a4c7f11'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:18.491604 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-2248b6ae-7cf0-4728-8daa-40624a4c7f11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1277408e9cc544d4b9f81ea0bf0a5d57', 'request_id': 'req-2248b6ae-7cf0-4728-8daa-40624a4c7f11'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:18.502480 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-2248b6ae-7cf0-4728-8daa-40624a4c7f11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1277408e9cc544d4b9f81ea0bf0a5d57', 'request_id': 'req-2248b6ae-7cf0-4728-8daa-40624a4c7f11'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:18.519173 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-2248b6ae-7cf0-4728-8daa-40624a4c7f11 admin admin] The token cache is being invalidate because project 1277408e9cc544d4b9f81ea0bf0a5d57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81649) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:13:18.519825 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-2248b6ae-7cf0-4728-8daa-40624a4c7f11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:18.522183 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-2248b6ae-7cf0-4728-8daa-40624a4c7f11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:18.524126 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1096/2192] 10.222.0.49 () {58 vars in 1233 bytes} [Thu Sep 29 02:13:18 2022] DELETE /identity/v3/projects/1277408e9cc544d4b9f81ea0bf0a5d57 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:13:18.528698 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2248b6ae-7cf0-4728-8daa-40624a4c7f11 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:18.530250 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-2248b6ae-7cf0-4728-8daa-40624a4c7f11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:18.554741 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1097/2193] 10.222.0.49 () {58 vars in 967 bytes} [Thu Sep 29 02:13:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:13:18.576419 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bd4a7c-32e4-4b83-8e16-1ecb13433779 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:18.579507 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-16bd4a7c-32e4-4b83-8e16-1ecb13433779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:18.651975 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2248b6ae-7cf0-4728-8daa-40624a4c7f11 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:18.663687 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fa82e0-0e54-4b57-bdb1-1ad29273cba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:18.664653 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa82e0-0e54-4b57-bdb1-1ad29273cba2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:18.664998 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa82e0-0e54-4b57-bdb1-1ad29273cba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:18.665471 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa82e0-0e54-4b57-bdb1-1ad29273cba2 admin admin] PATH_INFO: `/v3/users/7d07e19dff024c3fa9217faa97764eb4` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:18.666938 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fa82e0-0e54-4b57-bdb1-1ad29273cba2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d07e19dff024c3fa9217faa97764eb4)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:18.669257 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fa82e0-0e54-4b57-bdb1-1ad29273cba2 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:18.678623 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bd4a7c-32e4-4b83-8e16-1ecb13433779 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:18.684254 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2c7edc-2794-422f-9021-158b3b55607d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c88bc0f32600416ca7c6a59f4196e497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:18.684968 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c7edc-2794-422f-9021-158b3b55607d service swift] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:18.685335 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c7edc-2794-422f-9021-158b3b55607d service swift] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:18.685694 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c7edc-2794-422f-9021-158b3b55607d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:18.712779 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2c7edc-2794-422f-9021-158b3b55607d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:18.715133 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2c7edc-2794-422f-9021-158b3b55607d service swift] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:18.728052 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1098/2194] 10.222.0.49 () {60 vars in 1384 bytes} [Thu Sep 29 02:13:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 29 02:13:18.737982 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-f5fa82e0-0e54-4b57-bdb1-1ad29273cba2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d07e19dff024c3fa9217faa97764eb4'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:18.738674 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-f5fa82e0-0e54-4b57-bdb1-1ad29273cba2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d07e19dff024c3fa9217faa97764eb4'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:18.756009 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-f5fa82e0-0e54-4b57-bdb1-1ad29273cba2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d07e19dff024c3fa9217faa97764eb4'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:18.766542 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-f5fa82e0-0e54-4b57-bdb1-1ad29273cba2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d07e19dff024c3fa9217faa97764eb4'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:18.766989 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-f5fa82e0-0e54-4b57-bdb1-1ad29273cba2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d07e19dff024c3fa9217faa97764eb4'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:18.787322 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1097/2195] 10.222.0.49 () {58 vars in 1224 bytes} [Thu Sep 29 02:13:18 2022] DELETE /identity/v3/users/7d07e19dff024c3fa9217faa97764eb4 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:13:19.014815 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa1083-880b-4282-8dfc-75bf4ad1f514 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:19.015172 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa1083-880b-4282-8dfc-75bf4ad1f514 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:19.015571 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa1083-880b-4282-8dfc-75bf4ad1f514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:19.049520 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-d7aa1083-880b-4282-8dfc-75bf4ad1f514 None None] MFA Rules not processed for user `0f8f13f302de4701a7f4e0562bca08cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:19.050745 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-d7aa1083-880b-4282-8dfc-75bf4ad1f514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:19.119721 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1099/2196] 10.222.0.49 () {58 vars in 1009 bytes} [Thu Sep 29 02:13:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:13:19.132717 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fa82e0-0e54-4b57-bdb1-1ad29273cba2 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:19.134486 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-f5fa82e0-0e54-4b57-bdb1-1ad29273cba2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:19.158768 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:19.241252 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fa82e0-0e54-4b57-bdb1-1ad29273cba2 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:19.250050 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dbe177-e329-4902-b46a-33a41ac83683 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c88bc0f32600416ca7c6a59f4196e497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:19.250708 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dbe177-e329-4902-b46a-33a41ac83683 service swift] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:19.250991 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dbe177-e329-4902-b46a-33a41ac83683 service swift] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:19.251267 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dbe177-e329-4902-b46a-33a41ac83683 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:19.262657 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dbe177-e329-4902-b46a-33a41ac83683 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:19.264683 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dbe177-e329-4902-b46a-33a41ac83683 service swift] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:19.278855 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1098/2197] 10.222.0.49 () {60 vars in 1384 bytes} [Thu Sep 29 02:13:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 29 02:13:19.294647 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1386f433-9ade-4e4f-9932-41c68d84072d None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:19.295276 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1386f433-9ade-4e4f-9932-41c68d84072d None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:19.295734 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1386f433-9ade-4e4f-9932-41c68d84072d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:19.347762 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-1386f433-9ade-4e4f-9932-41c68d84072d None None] MFA Rules not processed for user `5e482260d1d840b4821122a7896c0a2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:19.349062 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-1386f433-9ade-4e4f-9932-41c68d84072d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:19.357551 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:19.358982 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dbe177-e329-4902-b46a-33a41ac83683 service swift] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:19.360324 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-d4dbe177-e329-4902-b46a-33a41ac83683 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:19.471307 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1100/2198] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:13:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:13:19.478295 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dbe177-e329-4902-b46a-33a41ac83683 service swift] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:19.483407 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd837a6-4a79-4057-b4bc-ba519d1974a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:19.484138 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd837a6-4a79-4057-b4bc-ba519d1974a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:19.484387 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1386f433-9ade-4e4f-9932-41c68d84072d None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:19.484493 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd837a6-4a79-4057-b4bc-ba519d1974a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:19.484900 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd837a6-4a79-4057-b4bc-ba519d1974a4 admin admin] PATH_INFO: `/v3/projects/40adacefd6714ea2936223ac9646971b` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:19.485814 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-1386f433-9ade-4e4f-9932-41c68d84072d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:19.486112 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd837a6-4a79-4057-b4bc-ba519d1974a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40adacefd6714ea2936223ac9646971b)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:19.488118 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd837a6-4a79-4057-b4bc-ba519d1974a4 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:19.544318 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-5fd837a6-4a79-4057-b4bc-ba519d1974a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40adacefd6714ea2936223ac9646971b', 'request_id': 'req-5fd837a6-4a79-4057-b4bc-ba519d1974a4'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:19.551182 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-5fd837a6-4a79-4057-b4bc-ba519d1974a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40adacefd6714ea2936223ac9646971b', 'request_id': 'req-5fd837a6-4a79-4057-b4bc-ba519d1974a4'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:19.564588 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-5fd837a6-4a79-4057-b4bc-ba519d1974a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40adacefd6714ea2936223ac9646971b', 'request_id': 'req-5fd837a6-4a79-4057-b4bc-ba519d1974a4'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:19.576618 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1386f433-9ade-4e4f-9932-41c68d84072d None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:19.581101 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-5fd837a6-4a79-4057-b4bc-ba519d1974a4 admin admin] The token cache is being invalidate because project 40adacefd6714ea2936223ac9646971b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81649) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:13:19.581647 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-5fd837a6-4a79-4057-b4bc-ba519d1974a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:19.582714 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-5fd837a6-4a79-4057-b4bc-ba519d1974a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:19.585196 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1099/2199] 10.222.0.49 () {58 vars in 1233 bytes} [Thu Sep 29 02:13:19 2022] DELETE /identity/v3/projects/40adacefd6714ea2936223ac9646971b => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:13:19.591269 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e432de8f-7460-4896-8a65-f9419f7e7fcf None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:19.591637 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e432de8f-7460-4896-8a65-f9419f7e7fcf None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:19.591919 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e432de8f-7460-4896-8a65-f9419f7e7fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:19.620588 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-e432de8f-7460-4896-8a65-f9419f7e7fcf None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:19.621841 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-e432de8f-7460-4896-8a65-f9419f7e7fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:19.647646 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f8528-45fc-44e7-a1e8-320ec78f7596 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75135b856134ba4b9ccac337886f682', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:19.648531 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f8528-45fc-44e7-a1e8-320ec78f7596 service cinder] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:19.648821 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f8528-45fc-44e7-a1e8-320ec78f7596 service cinder] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:19.649147 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f8528-45fc-44e7-a1e8-320ec78f7596 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:19.651835 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-c17f8528-45fc-44e7-a1e8-320ec78f7596 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:19.668192 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:19.708292 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1100/2200] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:13:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:13:19.719651 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3fc76e-14b3-4274-8eba-5aadb103e18e None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:19.719801 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3fc76e-14b3-4274-8eba-5aadb103e18e None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:19.720180 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3fc76e-14b3-4274-8eba-5aadb103e18e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:19.731053 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17f8528-45fc-44e7-a1e8-320ec78f7596 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:19.733261 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17f8528-45fc-44e7-a1e8-320ec78f7596 service cinder] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:19.743534 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-0e3fc76e-14b3-4274-8eba-5aadb103e18e None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:19.745412 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-0e3fc76e-14b3-4274-8eba-5aadb103e18e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:19.746008 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1101/2201] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:13:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 29 02:13:19.755620 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1101/2202] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:13:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:13:19.760175 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd2b00a-869b-4cc7-bf57-882024a6a3e4 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:19.760427 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3fc76e-14b3-4274-8eba-5aadb103e18e None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:19.760530 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd2b00a-869b-4cc7-bf57-882024a6a3e4 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:19.760722 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd2b00a-869b-4cc7-bf57-882024a6a3e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:19.774249 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3fc76e-14b3-4274-8eba-5aadb103e18e None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:19.775953 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74380ffc-51fc-487a-8474-50a98be0bdb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:19.776695 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74380ffc-51fc-487a-8474-50a98be0bdb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:19.776871 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74380ffc-51fc-487a-8474-50a98be0bdb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:19.777138 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74380ffc-51fc-487a-8474-50a98be0bdb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:19.777822 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74380ffc-51fc-487a-8474-50a98be0bdb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:13:19.778135 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74380ffc-51fc-487a-8474-50a98be0bdb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:19.779723 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74380ffc-51fc-487a-8474-50a98be0bdb6 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:19.794836 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1102/2203] 10.222.0.49 () {58 vars in 1153 bytes} [Thu Sep 29 02:13:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:13:19.795809 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-3fd2b00a-869b-4cc7-bf57-882024a6a3e4 None None] MFA Rules not processed for user `0f8f13f302de4701a7f4e0562bca08cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:19.797077 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-3fd2b00a-869b-4cc7-bf57-882024a6a3e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:19.799610 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74380ffc-51fc-487a-8474-50a98be0bdb6 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:19.812480 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:19.816027 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74380ffc-51fc-487a-8474-50a98be0bdb6 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:19.823366 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a74c4be-0c3d-454f-95dd-425369df1b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:19.824708 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a74c4be-0c3d-454f-95dd-425369df1b80 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:19.825066 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a74c4be-0c3d-454f-95dd-425369df1b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:19.825439 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a74c4be-0c3d-454f-95dd-425369df1b80 admin admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:19.826150 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a74c4be-0c3d-454f-95dd-425369df1b80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:19.828306 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a74c4be-0c3d-454f-95dd-425369df1b80 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:19.865576 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1103/2204] 10.222.0.49 () {60 vars in 1153 bytes} [Thu Sep 29 02:13:19 2022] POST /identity/v3/projects => generated 377 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 29 02:13:19.871328 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a74c4be-0c3d-454f-95dd-425369df1b80 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:19.888214 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1102/2205] 10.222.0.49 () {58 vars in 967 bytes} [Thu Sep 29 02:13:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:13:19.897301 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd2b00a-869b-4cc7-bf57-882024a6a3e4 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:19.902783 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-3fd2b00a-869b-4cc7-bf57-882024a6a3e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:19.963500 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a74c4be-0c3d-454f-95dd-425369df1b80 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:19.969837 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4bdbd5-42a7-490e-adc8-8c594da87ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:19.970666 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4bdbd5-42a7-490e-adc8-8c594da87ca3 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:19.971021 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4bdbd5-42a7-490e-adc8-8c594da87ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:19.971364 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4bdbd5-42a7-490e-adc8-8c594da87ca3 admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:19.972143 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4bdbd5-42a7-490e-adc8-8c594da87ca3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:19.974512 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4bdbd5-42a7-490e-adc8-8c594da87ca3 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:20.005691 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1104/2206] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 02:13:19 2022] POST /identity/v3/users => generated 289 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 29 02:13:20.009563 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4bdbd5-42a7-490e-adc8-8c594da87ca3 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:20.021995 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4bdbd5-42a7-490e-adc8-8c594da87ca3 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:20.023555 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd2b00a-869b-4cc7-bf57-882024a6a3e4 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:20.037142 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdf21c7-eb5b-4157-8e0d-ffafc4b6a98b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:20.037142 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdf21c7-eb5b-4157-8e0d-ffafc4b6a98b admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:20.037142 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdf21c7-eb5b-4157-8e0d-ffafc4b6a98b admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:20.037505 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdf21c7-eb5b-4157-8e0d-ffafc4b6a98b admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:20.038120 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdf21c7-eb5b-4157-8e0d-ffafc4b6a98b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:20.039831 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdf21c7-eb5b-4157-8e0d-ffafc4b6a98b admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:20.054588 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1105/2207] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:13:20 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:13:20.058575 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdf21c7-eb5b-4157-8e0d-ffafc4b6a98b admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:20.070745 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdf21c7-eb5b-4157-8e0d-ffafc4b6a98b admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:20.075788 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5976021-8e58-425d-99c7-7c45d1d643eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:20.076420 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5976021-8e58-425d-99c7-7c45d1d643eb admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:20.076743 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5976021-8e58-425d-99c7-7c45d1d643eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:20.076980 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5976021-8e58-425d-99c7-7c45d1d643eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:20.077667 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5976021-8e58-425d-99c7-7c45d1d643eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:20.079345 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5976021-8e58-425d-99c7-7c45d1d643eb admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:20.125539 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b132f13b-e867-45c5-b7b7-28d084612b3e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c88bc0f32600416ca7c6a59f4196e497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:20.127718 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132f13b-e867-45c5-b7b7-28d084612b3e service swift] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:20.128245 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132f13b-e867-45c5-b7b7-28d084612b3e service swift] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:20.129174 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132f13b-e867-45c5-b7b7-28d084612b3e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:20.131592 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1106/2208] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:13:20 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 29 02:13:20.135918 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5976021-8e58-425d-99c7-7c45d1d643eb admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:20.156576 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5976021-8e58-425d-99c7-7c45d1d643eb admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:20.172361 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cf90dc-14fa-4be7-9d74-90057c29a7ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:20.172969 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cf90dc-14fa-4be7-9d74-90057c29a7ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:20.173609 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cf90dc-14fa-4be7-9d74-90057c29a7ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:20.173609 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cf90dc-14fa-4be7-9d74-90057c29a7ca admin admin] PATH_INFO: `/v3/projects/07f32a4e24954c0883538ea158d799aa/users/191b9a1d363b493a9577f018fbe81238/roles/f157f905c9c94ccfbfb46e52d443e8f2` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:20.196786 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cf90dc-14fa-4be7-9d74-90057c29a7ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=07f32a4e24954c0883538ea158d799aa, user_id=191b9a1d363b493a9577f018fbe81238, role_id=f157f905c9c94ccfbfb46e52d443e8f2)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:20.199711 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cf90dc-14fa-4be7-9d74-90057c29a7ca admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:20.216532 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1107/2209] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:13:20 2022] PUT /identity/v3/projects/07f32a4e24954c0883538ea158d799aa/users/191b9a1d363b493a9577f018fbe81238/roles/f157f905c9c94ccfbfb46e52d443e8f2 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:13:20.227953 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d3621-5195-4984-859a-016adfde9ed0 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:20.228209 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d3621-5195-4984-859a-016adfde9ed0 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:20.228486 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d3621-5195-4984-859a-016adfde9ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:20.229450 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b132f13b-e867-45c5-b7b7-28d084612b3e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:20.231503 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b132f13b-e867-45c5-b7b7-28d084612b3e service swift] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:20.243522 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1103/2210] 10.222.0.49 () {60 vars in 1384 bytes} [Thu Sep 29 02:13:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 29 02:13:20.269509 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-bf1d3621-5195-4984-859a-016adfde9ed0 None None] MFA Rules not processed for user `191b9a1d363b493a9577f018fbe81238`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:20.270886 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-bf1d3621-5195-4984-859a-016adfde9ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:20.305559 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:20.378170 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1108/2211] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:13:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:13:20.383730 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b132f13b-e867-45c5-b7b7-28d084612b3e service swift] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:20.399807 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b132f13b-e867-45c5-b7b7-28d084612b3e service swift] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:20.405661 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:20.492278 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99013f4-8788-41af-8263-b750b8389747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:20.493390 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99013f4-8788-41af-8263-b750b8389747 admin admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:20.493390 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99013f4-8788-41af-8263-b750b8389747 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:20.493728 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99013f4-8788-41af-8263-b750b8389747 admin admin] PATH_INFO: `/v3/projects` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:20.494485 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99013f4-8788-41af-8263-b750b8389747 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:20.497831 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99013f4-8788-41af-8263-b750b8389747 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:20.556572 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1104/2212] 10.222.0.49 () {60 vars in 1153 bytes} [Thu Sep 29 02:13:20 2022] POST /identity/v3/projects => generated 379 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:13:20.558025 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1d3621-5195-4984-859a-016adfde9ed0 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:20.575146 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1d3621-5195-4984-859a-016adfde9ed0 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:20.633839 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d80fa1-6682-41df-a873-2b616ea52217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:20.634448 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d80fa1-6682-41df-a873-2b616ea52217 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:20.634718 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d80fa1-6682-41df-a873-2b616ea52217 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:20.634982 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d80fa1-6682-41df-a873-2b616ea52217 admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:20.635640 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d80fa1-6682-41df-a873-2b616ea52217 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:20.642077 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d80fa1-6682-41df-a873-2b616ea52217 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:20.664342 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1109/2213] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 02:13:20 2022] POST /identity/v3/users => generated 290 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:13:20.665405 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99013f4-8788-41af-8263-b750b8389747 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:20.677038 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99013f4-8788-41af-8263-b750b8389747 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:20.682312 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf6565c-0434-4000-bf13-c89143406096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:20.683155 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6565c-0434-4000-bf13-c89143406096 admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:20.683433 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6565c-0434-4000-bf13-c89143406096 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:20.683704 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6565c-0434-4000-bf13-c89143406096 admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:20.684348 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf6565c-0434-4000-bf13-c89143406096 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:20.686085 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf6565c-0434-4000-bf13-c89143406096 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:20.697339 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1105/2214] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:13:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:13:20.701599 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d80fa1-6682-41df-a873-2b616ea52217 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:20.712737 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d80fa1-6682-41df-a873-2b616ea52217 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:20.718123 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b065ada-4f7c-454e-9f77-e593b47772cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:20.718721 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b065ada-4f7c-454e-9f77-e593b47772cc admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:20.719002 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b065ada-4f7c-454e-9f77-e593b47772cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:20.719272 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b065ada-4f7c-454e-9f77-e593b47772cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:20.719938 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b065ada-4f7c-454e-9f77-e593b47772cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:20.721588 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b065ada-4f7c-454e-9f77-e593b47772cc admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:20.734867 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1110/2215] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:13:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:13:20.736278 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf6565c-0434-4000-bf13-c89143406096 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:20.747943 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf6565c-0434-4000-bf13-c89143406096 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:20.752575 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8b2e82-2c41-49e4-9f3b-78619a84f4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:20.753216 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b2e82-2c41-49e4-9f3b-78619a84f4ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:20.753519 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b2e82-2c41-49e4-9f3b-78619a84f4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:20.753790 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b2e82-2c41-49e4-9f3b-78619a84f4ec admin admin] PATH_INFO: `/v3/projects/8bb8cd2513e641c2aaffdc19d60f8ba2/users/b60f2e80617c400bb911faaa69a68df3/roles/f157f905c9c94ccfbfb46e52d443e8f2` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:20.769741 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8b2e82-2c41-49e4-9f3b-78619a84f4ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bb8cd2513e641c2aaffdc19d60f8ba2, user_id=b60f2e80617c400bb911faaa69a68df3, role_id=f157f905c9c94ccfbfb46e52d443e8f2)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:20.773183 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8b2e82-2c41-49e4-9f3b-78619a84f4ec admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:20.789161 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1106/2216] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:13:20 2022] PUT /identity/v3/projects/8bb8cd2513e641c2aaffdc19d60f8ba2/users/b60f2e80617c400bb911faaa69a68df3/roles/f157f905c9c94ccfbfb46e52d443e8f2 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:13:20.799995 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ce1c6-0515-44e5-9a97-400fb54e1228 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:20.800382 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ce1c6-0515-44e5-9a97-400fb54e1228 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:20.800785 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ce1c6-0515-44e5-9a97-400fb54e1228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:20.835148 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-5f0ce1c6-0515-44e5-9a97-400fb54e1228 None None] MFA Rules not processed for user `b60f2e80617c400bb911faaa69a68df3`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:20.836374 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-5f0ce1c6-0515-44e5-9a97-400fb54e1228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:20.912432 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1111/2217] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:13:20 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:13:20.917070 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8b2e82-2c41-49e4-9f3b-78619a84f4ec admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:20.982241 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8b2e82-2c41-49e4-9f3b-78619a84f4ec admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:20.987098 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfab09f0-789e-4d51-af65-f962534072ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:20.987917 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab09f0-789e-4d51-af65-f962534072ad admin admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:20.988027 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab09f0-789e-4d51-af65-f962534072ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:20.988319 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab09f0-789e-4d51-af65-f962534072ad admin admin] PATH_INFO: `/v3/projects` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:20.989975 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfab09f0-789e-4d51-af65-f962534072ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:20.991886 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfab09f0-789e-4d51-af65-f962534072ad admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:21.020944 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1107/2218] 10.222.0.49 () {60 vars in 1153 bytes} [Thu Sep 29 02:13:20 2022] POST /identity/v3/projects => generated 377 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:13:21.025335 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0ce1c6-0515-44e5-9a97-400fb54e1228 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:21.036654 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0ce1c6-0515-44e5-9a97-400fb54e1228 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:21.071390 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:21.098469 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334567ad-0dc7-499f-88ce-9a4fbf27fcee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:21.099463 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334567ad-0dc7-499f-88ce-9a4fbf27fcee admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:21.099894 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334567ad-0dc7-499f-88ce-9a4fbf27fcee admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:21.100189 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334567ad-0dc7-499f-88ce-9a4fbf27fcee admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:21.100832 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334567ad-0dc7-499f-88ce-9a4fbf27fcee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:21.102880 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334567ad-0dc7-499f-88ce-9a4fbf27fcee admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:21.125507 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1112/2219] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 02:13:21 2022] POST /identity/v3/users => generated 295 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:13:21.129547 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfab09f0-789e-4d51-af65-f962534072ad admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:21.140268 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfab09f0-789e-4d51-af65-f962534072ad admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:21.149417 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5d2049-6d38-4d84-b097-880fcc439c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:21.149716 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5d2049-6d38-4d84-b097-880fcc439c1c admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:21.150065 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5d2049-6d38-4d84-b097-880fcc439c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:21.150638 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5d2049-6d38-4d84-b097-880fcc439c1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:21.151303 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5d2049-6d38-4d84-b097-880fcc439c1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:21.153189 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5d2049-6d38-4d84-b097-880fcc439c1c admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:21.166997 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1108/2220] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:13:21 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 29 02:13:21.175472 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334567ad-0dc7-499f-88ce-9a4fbf27fcee admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:21.188051 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334567ad-0dc7-499f-88ce-9a4fbf27fcee admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:21.193844 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78e8b81-d645-4e8f-93c1-da6055734ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:21.194654 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78e8b81-d645-4e8f-93c1-da6055734ed0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:21.194941 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78e8b81-d645-4e8f-93c1-da6055734ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:21.195199 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78e8b81-d645-4e8f-93c1-da6055734ed0 admin admin] PATH_INFO: `/v3/projects/9bd155d2f2ae4730a1be7b0d64f3a9b8/users/a719c5340d28409995122f48a21ebdfc/roles/fe9bbc67742f4f5893f39b18eb31d59a` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:21.217712 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78e8b81-d645-4e8f-93c1-da6055734ed0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bd155d2f2ae4730a1be7b0d64f3a9b8, user_id=a719c5340d28409995122f48a21ebdfc, role_id=fe9bbc67742f4f5893f39b18eb31d59a)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:21.220628 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78e8b81-d645-4e8f-93c1-da6055734ed0 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:21.244502 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1113/2221] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:13:21 2022] PUT /identity/v3/projects/9bd155d2f2ae4730a1be7b0d64f3a9b8/users/a719c5340d28409995122f48a21ebdfc/roles/fe9bbc67742f4f5893f39b18eb31d59a => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:13:21.245957 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5d2049-6d38-4d84-b097-880fcc439c1c admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:21.258943 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5d2049-6d38-4d84-b097-880fcc439c1c admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:21.282101 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e45dd09-b039-471e-a99d-35fff1110bb2 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:21.282406 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e45dd09-b039-471e-a99d-35fff1110bb2 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:21.282695 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e45dd09-b039-471e-a99d-35fff1110bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:21.309122 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-8e45dd09-b039-471e-a99d-35fff1110bb2 None None] MFA Rules not processed for user `5e482260d1d840b4821122a7896c0a2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:21.310722 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-8e45dd09-b039-471e-a99d-35fff1110bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:21.316411 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:21.356417 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215619c9-29f7-4fe0-9a0e-3e063f3c208c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:21.357212 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215619c9-29f7-4fe0-9a0e-3e063f3c208c admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:21.357804 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215619c9-29f7-4fe0-9a0e-3e063f3c208c admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:21.358207 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215619c9-29f7-4fe0-9a0e-3e063f3c208c admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:21.359166 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215619c9-29f7-4fe0-9a0e-3e063f3c208c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:21.360981 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215619c9-29f7-4fe0-9a0e-3e063f3c208c admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:21.373070 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1109/2222] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:13:21 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:13:21.377077 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215619c9-29f7-4fe0-9a0e-3e063f3c208c admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:21.388642 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1114/2223] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:13:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 29 02:13:21.394403 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215619c9-29f7-4fe0-9a0e-3e063f3c208c admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:21.401782 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dce8823-3a65-4e7f-bfbe-97049329cd45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:21.402449 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce8823-3a65-4e7f-bfbe-97049329cd45 admin admin] REQUEST_METHOD: `PUT` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:21.402734 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce8823-3a65-4e7f-bfbe-97049329cd45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:21.403201 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce8823-3a65-4e7f-bfbe-97049329cd45 admin admin] PATH_INFO: `/v3/projects/9bd155d2f2ae4730a1be7b0d64f3a9b8/users/a719c5340d28409995122f48a21ebdfc/roles/fe9bbc67742f4f5893f39b18eb31d59a` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:21.408149 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dce8823-3a65-4e7f-bfbe-97049329cd45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bd155d2f2ae4730a1be7b0d64f3a9b8, user_id=a719c5340d28409995122f48a21ebdfc, role_id=fe9bbc67742f4f5893f39b18eb31d59a)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:21.413485 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dce8823-3a65-4e7f-bfbe-97049329cd45 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:21.434582 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1110/2224] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:13:21 2022] PUT /identity/v3/projects/9bd155d2f2ae4730a1be7b0d64f3a9b8/users/a719c5340d28409995122f48a21ebdfc/roles/fe9bbc67742f4f5893f39b18eb31d59a => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:13:21.446526 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ffd7c0-2601-4ec2-9fd4-c769fe1221bc None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:21.446975 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ffd7c0-2601-4ec2-9fd4-c769fe1221bc None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:21.447274 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ffd7c0-2601-4ec2-9fd4-c769fe1221bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:21.486558 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-f2ffd7c0-2601-4ec2-9fd4-c769fe1221bc None None] MFA Rules not processed for user `a719c5340d28409995122f48a21ebdfc`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:21.487879 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-f2ffd7c0-2601-4ec2-9fd4-c769fe1221bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:21.599686 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1115/2225] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:13:21 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:13:21.613695 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dce8823-3a65-4e7f-bfbe-97049329cd45 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:21.616450 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-9dce8823-3a65-4e7f-bfbe-97049329cd45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:21.711848 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dce8823-3a65-4e7f-bfbe-97049329cd45 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:21.718294 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e188944-b4a6-40ca-99e9-45b12ce350ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75135b856134ba4b9ccac337886f682', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:21.719086 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e188944-b4a6-40ca-99e9-45b12ce350ee service cinder] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:21.719383 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e188944-b4a6-40ca-99e9-45b12ce350ee service cinder] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:21.719676 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e188944-b4a6-40ca-99e9-45b12ce350ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:21.731830 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e188944-b4a6-40ca-99e9-45b12ce350ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:21.733460 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e188944-b4a6-40ca-99e9-45b12ce350ee service cinder] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:21.748578 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1111/2226] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:13:21 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:13:21.809075 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ffd7c0-2601-4ec2-9fd4-c769fe1221bc None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:21.827248 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ffd7c0-2601-4ec2-9fd4-c769fe1221bc None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:21.838127 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de73b386-9068-424f-a82d-07809c5b15c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75135b856134ba4b9ccac337886f682', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:21.839110 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de73b386-9068-424f-a82d-07809c5b15c6 service cinder] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:21.840717 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de73b386-9068-424f-a82d-07809c5b15c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:21.841731 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de73b386-9068-424f-a82d-07809c5b15c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:21.888609 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:21.923597 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de73b386-9068-424f-a82d-07809c5b15c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:21.925565 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de73b386-9068-424f-a82d-07809c5b15c6 service cinder] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:21.936080 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1116/2227] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:13:21 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:13:22.603023 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e188944-b4a6-40ca-99e9-45b12ce350ee service cinder] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:22.604540 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-1e188944-b4a6-40ca-99e9-45b12ce350ee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:22.671163 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e188944-b4a6-40ca-99e9-45b12ce350ee service cinder] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:22.675788 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e361b4ca-f7f1-412c-bb73-97b236a374d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:22.677019 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e361b4ca-f7f1-412c-bb73-97b236a374d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:22.677324 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e361b4ca-f7f1-412c-bb73-97b236a374d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:22.677605 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e361b4ca-f7f1-412c-bb73-97b236a374d4 admin admin] PATH_INFO: `/v3/users/7e8180ddc8a04f15be71010fa83b7340` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:22.678802 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e361b4ca-f7f1-412c-bb73-97b236a374d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e8180ddc8a04f15be71010fa83b7340)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:22.680773 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e361b4ca-f7f1-412c-bb73-97b236a374d4 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:22.727783 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-e361b4ca-f7f1-412c-bb73-97b236a374d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e8180ddc8a04f15be71010fa83b7340'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:22.728430 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-e361b4ca-f7f1-412c-bb73-97b236a374d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e8180ddc8a04f15be71010fa83b7340'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:22.736083 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:22.741050 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-e361b4ca-f7f1-412c-bb73-97b236a374d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e8180ddc8a04f15be71010fa83b7340'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:22.748583 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-e361b4ca-f7f1-412c-bb73-97b236a374d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e8180ddc8a04f15be71010fa83b7340'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:22.749213 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-e361b4ca-f7f1-412c-bb73-97b236a374d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e8180ddc8a04f15be71010fa83b7340'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:22.761864 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1112/2228] 10.222.0.49 () {58 vars in 1224 bytes} [Thu Sep 29 02:13:22 2022] DELETE /identity/v3/users/7e8180ddc8a04f15be71010fa83b7340 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:13:22.766144 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d491ab4a-2b0f-435f-8f96-2b204f2d540b None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:22.766585 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d491ab4a-2b0f-435f-8f96-2b204f2d540b None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:22.766679 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d491ab4a-2b0f-435f-8f96-2b204f2d540b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:22.787284 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-d491ab4a-2b0f-435f-8f96-2b204f2d540b None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:22.788550 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-d491ab4a-2b0f-435f-8f96-2b204f2d540b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:22.848662 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1117/2229] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:13:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:13:22.858679 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e361b4ca-f7f1-412c-bb73-97b236a374d4 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:22.860198 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-e361b4ca-f7f1-412c-bb73-97b236a374d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:22.948779 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e361b4ca-f7f1-412c-bb73-97b236a374d4 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:22.952491 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c6a1e6-a521-49a0-828a-0b59879c1526 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:22.953177 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c6a1e6-a521-49a0-828a-0b59879c1526 service neutron] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:22.953591 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c6a1e6-a521-49a0-828a-0b59879c1526 service neutron] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:22.953864 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c6a1e6-a521-49a0-828a-0b59879c1526 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:22.964799 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c6a1e6-a521-49a0-828a-0b59879c1526 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:22.966278 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c6a1e6-a521-49a0-828a-0b59879c1526 service neutron] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:22.977946 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1113/2230] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:13:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:13:23.261835 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d491ab4a-2b0f-435f-8f96-2b204f2d540b None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:23.263263 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-d491ab4a-2b0f-435f-8f96-2b204f2d540b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:23.276486 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d491ab4a-2b0f-435f-8f96-2b204f2d540b None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:23.281771 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56b3c71-0c68-40af-95a1-620875cce219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:23.282395 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b3c71-0c68-40af-95a1-620875cce219 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:23.282674 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b3c71-0c68-40af-95a1-620875cce219 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:23.282945 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b3c71-0c68-40af-95a1-620875cce219 admin admin] PATH_INFO: `/v3/projects/83d6d83a248e44d19dacfd099f475c1b` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:23.284241 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56b3c71-0c68-40af-95a1-620875cce219 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83d6d83a248e44d19dacfd099f475c1b)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:23.286910 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56b3c71-0c68-40af-95a1-620875cce219 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:23.359612 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-b56b3c71-0c68-40af-95a1-620875cce219 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83d6d83a248e44d19dacfd099f475c1b', 'request_id': 'req-b56b3c71-0c68-40af-95a1-620875cce219'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:23.370229 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-b56b3c71-0c68-40af-95a1-620875cce219 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83d6d83a248e44d19dacfd099f475c1b', 'request_id': 'req-b56b3c71-0c68-40af-95a1-620875cce219'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:23.381266 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-b56b3c71-0c68-40af-95a1-620875cce219 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83d6d83a248e44d19dacfd099f475c1b', 'request_id': 'req-b56b3c71-0c68-40af-95a1-620875cce219'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:23.406053 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-b56b3c71-0c68-40af-95a1-620875cce219 admin admin] The token cache is being invalidate because project 83d6d83a248e44d19dacfd099f475c1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81649) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:13:23.406373 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-b56b3c71-0c68-40af-95a1-620875cce219 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:23.407233 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-b56b3c71-0c68-40af-95a1-620875cce219 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:23.409798 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1118/2231] 10.222.0.49 () {58 vars in 1233 bytes} [Thu Sep 29 02:13:23 2022] DELETE /identity/v3/projects/83d6d83a248e44d19dacfd099f475c1b => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:13:23.494710 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c6a1e6-a521-49a0-828a-0b59879c1526 service neutron] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:23.496466 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-24c6a1e6-a521-49a0-828a-0b59879c1526 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:23.518236 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c6a1e6-a521-49a0-828a-0b59879c1526 service neutron] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:23.654723 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1355515f-db8a-4014-8076-168e66098894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:23.655655 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1355515f-db8a-4014-8076-168e66098894 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:23.656274 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1355515f-db8a-4014-8076-168e66098894 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:23.656886 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1355515f-db8a-4014-8076-168e66098894 admin admin] PATH_INFO: `/v3/users/d81afc1d7c574e4588ddea6dba5a094d` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:23.659459 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1355515f-db8a-4014-8076-168e66098894 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d81afc1d7c574e4588ddea6dba5a094d)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:23.669555 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1355515f-db8a-4014-8076-168e66098894 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:23.763168 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-1355515f-db8a-4014-8076-168e66098894 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd81afc1d7c574e4588ddea6dba5a094d'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:23.764805 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-1355515f-db8a-4014-8076-168e66098894 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd81afc1d7c574e4588ddea6dba5a094d'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:23.787396 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-1355515f-db8a-4014-8076-168e66098894 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd81afc1d7c574e4588ddea6dba5a094d'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:23.799597 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-1355515f-db8a-4014-8076-168e66098894 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd81afc1d7c574e4588ddea6dba5a094d'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:23.800454 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-1355515f-db8a-4014-8076-168e66098894 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd81afc1d7c574e4588ddea6dba5a094d'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:23.814901 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:23.828895 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1114/2232] 10.222.0.49 () {58 vars in 1224 bytes} [Thu Sep 29 02:13:23 2022] DELETE /identity/v3/users/d81afc1d7c574e4588ddea6dba5a094d => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:13:23.830448 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b9ea93-c610-4e19-b7d3-313972c6ba70 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:23.830903 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b9ea93-c610-4e19-b7d3-313972c6ba70 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:23.830996 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b9ea93-c610-4e19-b7d3-313972c6ba70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:23.861602 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-29b9ea93-c610-4e19-b7d3-313972c6ba70 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:23.861602 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-29b9ea93-c610-4e19-b7d3-313972c6ba70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:23.942423 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:23.968232 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1119/2233] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:13:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 29 02:13:23.978723 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1355515f-db8a-4014-8076-168e66098894 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:23.980230 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-1355515f-db8a-4014-8076-168e66098894 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:24.080308 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1355515f-db8a-4014-8076-168e66098894 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:24.085665 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb054f7-1548-4d65-ae1b-9110e9cfe83c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:24.086314 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb054f7-1548-4d65-ae1b-9110e9cfe83c service neutron] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:24.086563 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb054f7-1548-4d65-ae1b-9110e9cfe83c service neutron] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:24.086835 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb054f7-1548-4d65-ae1b-9110e9cfe83c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:24.099029 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb054f7-1548-4d65-ae1b-9110e9cfe83c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:24.100631 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb054f7-1548-4d65-ae1b-9110e9cfe83c service neutron] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:24.112778 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1115/2234] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:13:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:13:24.763743 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b9ea93-c610-4e19-b7d3-313972c6ba70 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:24.765291 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-29b9ea93-c610-4e19-b7d3-313972c6ba70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:24.779964 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b9ea93-c610-4e19-b7d3-313972c6ba70 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:24.786215 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a83f5b-f763-426f-afec-7fb095668bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:24.787064 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a83f5b-f763-426f-afec-7fb095668bc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:24.787428 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a83f5b-f763-426f-afec-7fb095668bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:24.787775 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a83f5b-f763-426f-afec-7fb095668bc0 admin admin] PATH_INFO: `/v3/users/d94f9f739ade490e9e96b24d296a0e94` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:24.789006 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a83f5b-f763-426f-afec-7fb095668bc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d94f9f739ade490e9e96b24d296a0e94)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:24.791222 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a83f5b-f763-426f-afec-7fb095668bc0 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:24.838752 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-b4a83f5b-f763-426f-afec-7fb095668bc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd94f9f739ade490e9e96b24d296a0e94'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:24.839436 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-b4a83f5b-f763-426f-afec-7fb095668bc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd94f9f739ade490e9e96b24d296a0e94'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:24.858828 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-b4a83f5b-f763-426f-afec-7fb095668bc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd94f9f739ade490e9e96b24d296a0e94'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:24.867369 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-b4a83f5b-f763-426f-afec-7fb095668bc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd94f9f739ade490e9e96b24d296a0e94'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:24.868115 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-b4a83f5b-f763-426f-afec-7fb095668bc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd94f9f739ade490e9e96b24d296a0e94'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:24.886843 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1120/2235] 10.222.0.49 () {58 vars in 1224 bytes} [Thu Sep 29 02:13:24 2022] DELETE /identity/v3/users/d94f9f739ade490e9e96b24d296a0e94 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:13:24.887636 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb054f7-1548-4d65-ae1b-9110e9cfe83c service neutron] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:24.889340 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-2cb054f7-1548-4d65-ae1b-9110e9cfe83c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:24.903602 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb054f7-1548-4d65-ae1b-9110e9cfe83c service neutron] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:24.968771 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455a31ea-7205-4cc9-8c60-2fbdeb8ad94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:24.969420 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455a31ea-7205-4cc9-8c60-2fbdeb8ad94e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:24.969699 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455a31ea-7205-4cc9-8c60-2fbdeb8ad94e admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:24.969969 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455a31ea-7205-4cc9-8c60-2fbdeb8ad94e admin admin] PATH_INFO: `/v3/projects/e5ee0732e2d3455a8863b5b97cf86dcd` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:24.971077 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455a31ea-7205-4cc9-8c60-2fbdeb8ad94e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5ee0732e2d3455a8863b5b97cf86dcd)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:24.973541 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455a31ea-7205-4cc9-8c60-2fbdeb8ad94e admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:25.022186 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-455a31ea-7205-4cc9-8c60-2fbdeb8ad94e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5ee0732e2d3455a8863b5b97cf86dcd', 'request_id': 'req-455a31ea-7205-4cc9-8c60-2fbdeb8ad94e'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:25.028345 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-455a31ea-7205-4cc9-8c60-2fbdeb8ad94e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5ee0732e2d3455a8863b5b97cf86dcd', 'request_id': 'req-455a31ea-7205-4cc9-8c60-2fbdeb8ad94e'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:25.037007 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-455a31ea-7205-4cc9-8c60-2fbdeb8ad94e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5ee0732e2d3455a8863b5b97cf86dcd', 'request_id': 'req-455a31ea-7205-4cc9-8c60-2fbdeb8ad94e'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:25.048274 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-455a31ea-7205-4cc9-8c60-2fbdeb8ad94e admin admin] The token cache is being invalidate because project e5ee0732e2d3455a8863b5b97cf86dcd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81648) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:13:25.049001 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-455a31ea-7205-4cc9-8c60-2fbdeb8ad94e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:25.049274 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-455a31ea-7205-4cc9-8c60-2fbdeb8ad94e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:25.054769 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1116/2236] 10.222.0.49 () {58 vars in 1233 bytes} [Thu Sep 29 02:13:24 2022] DELETE /identity/v3/projects/e5ee0732e2d3455a8863b5b97cf86dcd => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:13:25.056222 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17809eb-5ec4-4657-b7c2-d208bd16c3f2 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:25.056509 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17809eb-5ec4-4657-b7c2-d208bd16c3f2 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:25.056810 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17809eb-5ec4-4657-b7c2-d208bd16c3f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:25.089255 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455a31ea-7205-4cc9-8c60-2fbdeb8ad94e admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:25.089840 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-b17809eb-5ec4-4657-b7c2-d208bd16c3f2 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:25.090673 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-455a31ea-7205-4cc9-8c60-2fbdeb8ad94e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:25.092203 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-b17809eb-5ec4-4657-b7c2-d208bd16c3f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:25.133923 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:25.177857 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455a31ea-7205-4cc9-8c60-2fbdeb8ad94e admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:25.184145 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d43ec95-b06b-45e3-8b46-9c994ada9255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:25.185005 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d43ec95-b06b-45e3-8b46-9c994ada9255 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:25.185277 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d43ec95-b06b-45e3-8b46-9c994ada9255 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:25.185591 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d43ec95-b06b-45e3-8b46-9c994ada9255 admin admin] PATH_INFO: `/v3/projects/93f0a445590941e088a4d13d9e9b904f` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:25.188033 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d43ec95-b06b-45e3-8b46-9c994ada9255 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93f0a445590941e088a4d13d9e9b904f)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:25.189910 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1121/2237] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:13:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:13:25.190447 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d43ec95-b06b-45e3-8b46-9c994ada9255 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:25.190633 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17809eb-5ec4-4657-b7c2-d208bd16c3f2 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:25.192565 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-b17809eb-5ec4-4657-b7c2-d208bd16c3f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:25.205171 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17809eb-5ec4-4657-b7c2-d208bd16c3f2 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:25.211619 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3b7fdb-8a9b-4a76-8ce7-d038d01972e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:25.211789 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3b7fdb-8a9b-4a76-8ce7-d038d01972e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:25.212083 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3b7fdb-8a9b-4a76-8ce7-d038d01972e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:25.212556 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3b7fdb-8a9b-4a76-8ce7-d038d01972e9 admin admin] PATH_INFO: `/v3/users/191b9a1d363b493a9577f018fbe81238` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:25.214600 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3b7fdb-8a9b-4a76-8ce7-d038d01972e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=191b9a1d363b493a9577f018fbe81238)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:25.217544 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3b7fdb-8a9b-4a76-8ce7-d038d01972e9 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:25.245039 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-5d43ec95-b06b-45e3-8b46-9c994ada9255 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93f0a445590941e088a4d13d9e9b904f', 'request_id': 'req-5d43ec95-b06b-45e3-8b46-9c994ada9255'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:25.255021 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-5d43ec95-b06b-45e3-8b46-9c994ada9255 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93f0a445590941e088a4d13d9e9b904f', 'request_id': 'req-5d43ec95-b06b-45e3-8b46-9c994ada9255'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:25.263623 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-5d43ec95-b06b-45e3-8b46-9c994ada9255 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93f0a445590941e088a4d13d9e9b904f', 'request_id': 'req-5d43ec95-b06b-45e3-8b46-9c994ada9255'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:25.276843 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-5d43ec95-b06b-45e3-8b46-9c994ada9255 admin admin] The token cache is being invalidate because project 93f0a445590941e088a4d13d9e9b904f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81648) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:13:25.277234 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-5d43ec95-b06b-45e3-8b46-9c994ada9255 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:25.278099 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-5d43ec95-b06b-45e3-8b46-9c994ada9255 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:25.280275 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1117/2238] 10.222.0.49 () {58 vars in 1233 bytes} [Thu Sep 29 02:13:25 2022] DELETE /identity/v3/projects/93f0a445590941e088a4d13d9e9b904f => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:13:25.281605 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c7ab1-6159-4802-9d20-6907e1a06ad0 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:25.281955 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c7ab1-6159-4802-9d20-6907e1a06ad0 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:25.282306 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c7ab1-6159-4802-9d20-6907e1a06ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:25.285741 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-cc3b7fdb-8a9b-4a76-8ce7-d038d01972e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '191b9a1d363b493a9577f018fbe81238'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:25.286729 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-cc3b7fdb-8a9b-4a76-8ce7-d038d01972e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '191b9a1d363b493a9577f018fbe81238'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:25.305622 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:25.309768 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-d37c7ab1-6159-4802-9d20-6907e1a06ad0 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:25.312412 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-d37c7ab1-6159-4802-9d20-6907e1a06ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:25.312646 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-cc3b7fdb-8a9b-4a76-8ce7-d038d01972e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '191b9a1d363b493a9577f018fbe81238'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:25.324997 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-cc3b7fdb-8a9b-4a76-8ce7-d038d01972e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '191b9a1d363b493a9577f018fbe81238'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:25.326103 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-cc3b7fdb-8a9b-4a76-8ce7-d038d01972e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '191b9a1d363b493a9577f018fbe81238'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:25.343482 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1122/2239] 10.222.0.49 () {58 vars in 1224 bytes} [Thu Sep 29 02:13:25 2022] DELETE /identity/v3/users/191b9a1d363b493a9577f018fbe81238 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:13:25.346683 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3b7fdb-8a9b-4a76-8ce7-d038d01972e9 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:25.346683 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-cc3b7fdb-8a9b-4a76-8ce7-d038d01972e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:25.397472 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1118/2240] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:13:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:13:25.398954 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f99fc9-1cf3-451d-9593-bd124b4d3fcc None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:25.399240 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f99fc9-1cf3-451d-9593-bd124b4d3fcc None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:25.399941 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f99fc9-1cf3-451d-9593-bd124b4d3fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:25.428114 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-43f99fc9-1cf3-451d-9593-bd124b4d3fcc None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:25.429830 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-43f99fc9-1cf3-451d-9593-bd124b4d3fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:25.432508 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3b7fdb-8a9b-4a76-8ce7-d038d01972e9 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:25.437613 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8dbda6-483f-467c-817b-4e5b4a0e50ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:25.438321 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8dbda6-483f-467c-817b-4e5b4a0e50ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:25.438728 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8dbda6-483f-467c-817b-4e5b4a0e50ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:25.439063 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8dbda6-483f-467c-817b-4e5b4a0e50ca admin admin] PATH_INFO: `/v3/users/b5ee7a619dbd4f31bd3ddfd10f127e0f` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:25.441958 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1119/2241] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:13:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:13:25.441958 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f99fc9-1cf3-451d-9593-bd124b4d3fcc None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:25.444520 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8dbda6-483f-467c-817b-4e5b4a0e50ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5ee7a619dbd4f31bd3ddfd10f127e0f)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:25.446644 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8dbda6-483f-467c-817b-4e5b4a0e50ca admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:25.454622 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f99fc9-1cf3-451d-9593-bd124b4d3fcc None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:25.460543 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b22a45-f90a-4388-a36a-83750f6d93f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:25.461652 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b22a45-f90a-4388-a36a-83750f6d93f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:25.462013 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b22a45-f90a-4388-a36a-83750f6d93f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:25.462357 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b22a45-f90a-4388-a36a-83750f6d93f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:25.463200 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b22a45-f90a-4388-a36a-83750f6d93f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:13:25.463642 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b22a45-f90a-4388-a36a-83750f6d93f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:25.465610 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b22a45-f90a-4388-a36a-83750f6d93f7 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:25.480336 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1120/2242] 10.222.0.49 () {58 vars in 1153 bytes} [Thu Sep 29 02:13:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:13:25.481683 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b22a45-f90a-4388-a36a-83750f6d93f7 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:25.485857 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-f9b22a45-f90a-4388-a36a-83750f6d93f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:25.515599 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-8b8dbda6-483f-467c-817b-4e5b4a0e50ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5ee7a619dbd4f31bd3ddfd10f127e0f'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:25.516180 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-8b8dbda6-483f-467c-817b-4e5b4a0e50ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5ee7a619dbd4f31bd3ddfd10f127e0f'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:25.531851 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-8b8dbda6-483f-467c-817b-4e5b4a0e50ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5ee7a619dbd4f31bd3ddfd10f127e0f'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:25.540197 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:25.543764 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-8b8dbda6-483f-467c-817b-4e5b4a0e50ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5ee7a619dbd4f31bd3ddfd10f127e0f'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:25.544378 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-8b8dbda6-483f-467c-817b-4e5b4a0e50ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5ee7a619dbd4f31bd3ddfd10f127e0f'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:25.558667 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b22a45-f90a-4388-a36a-83750f6d93f7 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:25.561375 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1123/2243] 10.222.0.49 () {58 vars in 1224 bytes} [Thu Sep 29 02:13:25 2022] DELETE /identity/v3/users/b5ee7a619dbd4f31bd3ddfd10f127e0f => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:13:25.562584 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8dbda6-483f-467c-817b-4e5b4a0e50ca admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:25.564151 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-8b8dbda6-483f-467c-817b-4e5b4a0e50ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:25.567902 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de13953e-e0a9-4f89-adbf-ab4962a89c7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:25.569439 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de13953e-e0a9-4f89-adbf-ab4962a89c7f service neutron] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:25.569998 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de13953e-e0a9-4f89-adbf-ab4962a89c7f service neutron] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:25.571261 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de13953e-e0a9-4f89-adbf-ab4962a89c7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:25.574425 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-de13953e-e0a9-4f89-adbf-ab4962a89c7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:25.595777 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de13953e-e0a9-4f89-adbf-ab4962a89c7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:25.597269 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de13953e-e0a9-4f89-adbf-ab4962a89c7f service neutron] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:25.611042 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1121/2244] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:13:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:13:25.666872 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:25.671350 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8dbda6-483f-467c-817b-4e5b4a0e50ca admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:25.683816 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1f34ff-9b00-4e0e-ab8b-d45deff3e844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:25.684576 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f34ff-9b00-4e0e-ab8b-d45deff3e844 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:25.684998 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f34ff-9b00-4e0e-ab8b-d45deff3e844 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:25.685432 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f34ff-9b00-4e0e-ab8b-d45deff3e844 admin admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:25.687720 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1f34ff-9b00-4e0e-ab8b-d45deff3e844 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:25.690812 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1f34ff-9b00-4e0e-ab8b-d45deff3e844 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:25.761088 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1124/2245] 10.222.0.49 () {60 vars in 1153 bytes} [Thu Sep 29 02:13:25 2022] POST /identity/v3/projects => generated 399 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:13:25.765265 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de13953e-e0a9-4f89-adbf-ab4962a89c7f service neutron] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:25.779549 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de13953e-e0a9-4f89-adbf-ab4962a89c7f service neutron] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:25.850210 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac46021-90b4-4b7c-81b6-cdb885b84645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:25.851229 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac46021-90b4-4b7c-81b6-cdb885b84645 admin admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:25.851604 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac46021-90b4-4b7c-81b6-cdb885b84645 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:25.852028 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac46021-90b4-4b7c-81b6-cdb885b84645 admin admin] PATH_INFO: `/v3/users` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:25.853056 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac46021-90b4-4b7c-81b6-cdb885b84645 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:25.855752 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac46021-90b4-4b7c-81b6-cdb885b84645 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:25.883469 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1122/2246] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 02:13:25 2022] POST /identity/v3/users => generated 300 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:13:25.887383 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1f34ff-9b00-4e0e-ab8b-d45deff3e844 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:25.900128 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1f34ff-9b00-4e0e-ab8b-d45deff3e844 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:25.905400 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79c8883-bbc6-4b58-a6b0-9aa5f79f6631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:25.906609 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c8883-bbc6-4b58-a6b0-9aa5f79f6631 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:25.906609 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c8883-bbc6-4b58-a6b0-9aa5f79f6631 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:25.906942 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c8883-bbc6-4b58-a6b0-9aa5f79f6631 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:25.907688 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79c8883-bbc6-4b58-a6b0-9aa5f79f6631 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:25.909599 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79c8883-bbc6-4b58-a6b0-9aa5f79f6631 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:25.926590 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1125/2247] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:13:25 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:13:25.927583 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac46021-90b4-4b7c-81b6-cdb885b84645 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:25.938740 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac46021-90b4-4b7c-81b6-cdb885b84645 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:25.945653 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52e79a3-825f-491b-8d31-efe456238194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:25.946871 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52e79a3-825f-491b-8d31-efe456238194 admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:25.947188 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52e79a3-825f-491b-8d31-efe456238194 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:25.947521 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52e79a3-825f-491b-8d31-efe456238194 admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:25.948242 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52e79a3-825f-491b-8d31-efe456238194 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:25.950445 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52e79a3-825f-491b-8d31-efe456238194 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:25.963502 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1123/2248] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:13:25 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 29 02:13:25.967897 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79c8883-bbc6-4b58-a6b0-9aa5f79f6631 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:25.979339 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79c8883-bbc6-4b58-a6b0-9aa5f79f6631 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:25.984902 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae88fc9-84a1-4e02-8bbe-51527fa2b891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:25.985632 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae88fc9-84a1-4e02-8bbe-51527fa2b891 admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:25.985907 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae88fc9-84a1-4e02-8bbe-51527fa2b891 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:25.987104 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae88fc9-84a1-4e02-8bbe-51527fa2b891 admin admin] PATH_INFO: `/v3/projects/cdd4c92340ab4a369623f5ccfe5bc98b/users/e27235300f5e4649aa617dbfde4e98c4/roles/f157f905c9c94ccfbfb46e52d443e8f2` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:26.006128 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae88fc9-84a1-4e02-8bbe-51527fa2b891 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdd4c92340ab4a369623f5ccfe5bc98b, user_id=e27235300f5e4649aa617dbfde4e98c4, role_id=f157f905c9c94ccfbfb46e52d443e8f2)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:26.010689 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae88fc9-84a1-4e02-8bbe-51527fa2b891 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:26.042141 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6352d8fc-c915-4ba8-9774-5fb194dc0060 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:26.043444 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6352d8fc-c915-4ba8-9774-5fb194dc0060 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:26.043817 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6352d8fc-c915-4ba8-9774-5fb194dc0060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:26.048296 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1126/2249] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:13:25 2022] PUT /identity/v3/projects/cdd4c92340ab4a369623f5ccfe5bc98b/users/e27235300f5e4649aa617dbfde4e98c4/roles/f157f905c9c94ccfbfb46e52d443e8f2 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:13:26.075292 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae88fc9-84a1-4e02-8bbe-51527fa2b891 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:26.077712 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-2ae88fc9-84a1-4e02-8bbe-51527fa2b891 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:26.094194 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-6352d8fc-c915-4ba8-9774-5fb194dc0060 None None] MFA Rules not processed for user `e27235300f5e4649aa617dbfde4e98c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:26.096210 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-6352d8fc-c915-4ba8-9774-5fb194dc0060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:26.197918 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1124/2250] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:13:26 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:13:26.211319 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6352d8fc-c915-4ba8-9774-5fb194dc0060 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:26.212682 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-6352d8fc-c915-4ba8-9774-5fb194dc0060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:26.223923 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae88fc9-84a1-4e02-8bbe-51527fa2b891 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:26.231158 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e9fee6-daca-497d-b7d1-291c5b1e5e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:26.231947 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e9fee6-daca-497d-b7d1-291c5b1e5e89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:26.232085 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e9fee6-daca-497d-b7d1-291c5b1e5e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:26.232344 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e9fee6-daca-497d-b7d1-291c5b1e5e89 admin admin] PATH_INFO: `/v3/projects/b2b771f7f618417aaa920f52182a9949` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:26.234144 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e9fee6-daca-497d-b7d1-291c5b1e5e89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2b771f7f618417aaa920f52182a9949)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:26.236534 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e9fee6-daca-497d-b7d1-291c5b1e5e89 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:26.274864 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6352d8fc-c915-4ba8-9774-5fb194dc0060 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:26.278667 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87074fa4-22df-4c4e-8ee4-341a4d7fc15e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75135b856134ba4b9ccac337886f682', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:26.279276 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87074fa4-22df-4c4e-8ee4-341a4d7fc15e service cinder] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:26.279555 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87074fa4-22df-4c4e-8ee4-341a4d7fc15e service cinder] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:26.279827 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87074fa4-22df-4c4e-8ee4-341a4d7fc15e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:26.287792 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:26.290695 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87074fa4-22df-4c4e-8ee4-341a4d7fc15e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:26.293167 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87074fa4-22df-4c4e-8ee4-341a4d7fc15e service cinder] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:26.297240 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-37e9fee6-daca-497d-b7d1-291c5b1e5e89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2b771f7f618417aaa920f52182a9949', 'request_id': 'req-37e9fee6-daca-497d-b7d1-291c5b1e5e89'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:26.304998 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-37e9fee6-daca-497d-b7d1-291c5b1e5e89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2b771f7f618417aaa920f52182a9949', 'request_id': 'req-37e9fee6-daca-497d-b7d1-291c5b1e5e89'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:26.306218 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1125/2251] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:13:26 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 29 02:13:26.315548 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-37e9fee6-daca-497d-b7d1-291c5b1e5e89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2b771f7f618417aaa920f52182a9949', 'request_id': 'req-37e9fee6-daca-497d-b7d1-291c5b1e5e89'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:26.327617 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-37e9fee6-daca-497d-b7d1-291c5b1e5e89 admin admin] The token cache is being invalidate because project b2b771f7f618417aaa920f52182a9949 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81649) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:13:26.328033 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-37e9fee6-daca-497d-b7d1-291c5b1e5e89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:26.328983 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-37e9fee6-daca-497d-b7d1-291c5b1e5e89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:26.331143 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1127/2252] 10.222.0.49 () {58 vars in 1233 bytes} [Thu Sep 29 02:13:26 2022] DELETE /identity/v3/projects/b2b771f7f618417aaa920f52182a9949 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:13:26.338104 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da80076-b0d5-407d-9e7a-253f6f868149 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:26.338384 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da80076-b0d5-407d-9e7a-253f6f868149 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:26.338994 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da80076-b0d5-407d-9e7a-253f6f868149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:26.366929 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-8da80076-b0d5-407d-9e7a-253f6f868149 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:26.368290 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-8da80076-b0d5-407d-9e7a-253f6f868149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:26.452475 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e9fee6-daca-497d-b7d1-291c5b1e5e89 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:26.454425 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1126/2253] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:13:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 29 02:13:26.455154 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-37e9fee6-daca-497d-b7d1-291c5b1e5e89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:26.464358 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff72b7f4-a12e-44ea-9f4f-7e4795bdd3c9 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:26.464772 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff72b7f4-a12e-44ea-9f4f-7e4795bdd3c9 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:26.465592 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff72b7f4-a12e-44ea-9f4f-7e4795bdd3c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:26.474556 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e9fee6-daca-497d-b7d1-291c5b1e5e89 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:26.483887 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d862e5-7be5-45ad-8b0e-3e741f386cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:26.484530 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d862e5-7be5-45ad-8b0e-3e741f386cc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:26.484810 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d862e5-7be5-45ad-8b0e-3e741f386cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:26.485118 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d862e5-7be5-45ad-8b0e-3e741f386cc3 admin admin] PATH_INFO: `/v3/projects/07f32a4e24954c0883538ea158d799aa` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:26.486435 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d862e5-7be5-45ad-8b0e-3e741f386cc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07f32a4e24954c0883538ea158d799aa)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:26.489763 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d862e5-7be5-45ad-8b0e-3e741f386cc3 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:26.494467 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-ff72b7f4-a12e-44ea-9f4f-7e4795bdd3c9 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:26.496255 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-ff72b7f4-a12e-44ea-9f4f-7e4795bdd3c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:26.519071 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1127/2254] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:13:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:13:26.524250 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff72b7f4-a12e-44ea-9f4f-7e4795bdd3c9 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:26.538698 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff72b7f4-a12e-44ea-9f4f-7e4795bdd3c9 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:26.550730 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813629e7-a1a6-4d07-97d3-5736877cb78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:26.553119 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813629e7-a1a6-4d07-97d3-5736877cb78b admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:26.553514 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813629e7-a1a6-4d07-97d3-5736877cb78b admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:26.553672 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:26.553926 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813629e7-a1a6-4d07-97d3-5736877cb78b admin admin] PATH_INFO: `/v3/domains` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:26.555001 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813629e7-a1a6-4d07-97d3-5736877cb78b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:13:26.555001 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813629e7-a1a6-4d07-97d3-5736877cb78b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:26.556952 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813629e7-a1a6-4d07-97d3-5736877cb78b admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:26.579870 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-a2d862e5-7be5-45ad-8b0e-3e741f386cc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07f32a4e24954c0883538ea158d799aa', 'request_id': 'req-a2d862e5-7be5-45ad-8b0e-3e741f386cc3'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:26.580094 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1128/2255] 10.222.0.49 () {58 vars in 1153 bytes} [Thu Sep 29 02:13:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 02:13:26.581579 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813629e7-a1a6-4d07-97d3-5736877cb78b admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:26.589194 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-a2d862e5-7be5-45ad-8b0e-3e741f386cc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07f32a4e24954c0883538ea158d799aa', 'request_id': 'req-a2d862e5-7be5-45ad-8b0e-3e741f386cc3'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:26.594912 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813629e7-a1a6-4d07-97d3-5736877cb78b admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:26.601968 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-a2d862e5-7be5-45ad-8b0e-3e741f386cc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07f32a4e24954c0883538ea158d799aa', 'request_id': 'req-a2d862e5-7be5-45ad-8b0e-3e741f386cc3'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:26.618249 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-a2d862e5-7be5-45ad-8b0e-3e741f386cc3 admin admin] The token cache is being invalidate because project 07f32a4e24954c0883538ea158d799aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81649) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:13:26.618637 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-a2d862e5-7be5-45ad-8b0e-3e741f386cc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:26.619779 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-a2d862e5-7be5-45ad-8b0e-3e741f386cc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:26.624338 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1128/2256] 10.222.0.49 () {58 vars in 1233 bytes} [Thu Sep 29 02:13:26 2022] DELETE /identity/v3/projects/07f32a4e24954c0883538ea158d799aa => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:13:26.625857 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d862e5-7be5-45ad-8b0e-3e741f386cc3 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:26.627526 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-a2d862e5-7be5-45ad-8b0e-3e741f386cc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:26.671279 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4140204e-02e4-4d65-85d0-3b1840c4deea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:26.672490 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4140204e-02e4-4d65-85d0-3b1840c4deea admin admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:26.672848 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4140204e-02e4-4d65-85d0-3b1840c4deea admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:26.673492 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4140204e-02e4-4d65-85d0-3b1840c4deea admin admin] PATH_INFO: `/v3/projects` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:26.674230 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4140204e-02e4-4d65-85d0-3b1840c4deea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:26.678056 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4140204e-02e4-4d65-85d0-3b1840c4deea admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:26.718108 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1129/2257] 10.222.0.49 () {60 vars in 1153 bytes} [Thu Sep 29 02:13:26 2022] POST /identity/v3/projects => generated 375 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 29 02:13:26.722654 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4140204e-02e4-4d65-85d0-3b1840c4deea admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:26.724738 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-4140204e-02e4-4d65-85d0-3b1840c4deea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:26.730471 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d862e5-7be5-45ad-8b0e-3e741f386cc3 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:26.811392 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4140204e-02e4-4d65-85d0-3b1840c4deea admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:26.814043 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd310a2d-3001-488a-b573-6915c3c348ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:26.815138 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd310a2d-3001-488a-b573-6915c3c348ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:26.815427 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd310a2d-3001-488a-b573-6915c3c348ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:26.815817 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd310a2d-3001-488a-b573-6915c3c348ec admin admin] PATH_INFO: `/v3/users/b60f2e80617c400bb911faaa69a68df3` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:26.829604 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd310a2d-3001-488a-b573-6915c3c348ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=b60f2e80617c400bb911faaa69a68df3)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:26.829604 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd310a2d-3001-488a-b573-6915c3c348ec admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:26.835559 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07325e66-6bed-47ed-983c-0ff75473f061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:26.836338 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07325e66-6bed-47ed-983c-0ff75473f061 admin admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:26.836709 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07325e66-6bed-47ed-983c-0ff75473f061 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:26.837098 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07325e66-6bed-47ed-983c-0ff75473f061 admin admin] PATH_INFO: `/v3/users` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:26.837871 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07325e66-6bed-47ed-983c-0ff75473f061 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:26.840743 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07325e66-6bed-47ed-983c-0ff75473f061 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:26.852958 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:26.872232 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1130/2258] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 02:13:26 2022] POST /identity/v3/users => generated 288 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:13:26.876515 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07325e66-6bed-47ed-983c-0ff75473f061 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:26.901124 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07325e66-6bed-47ed-983c-0ff75473f061 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:26.915597 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1e514e-f98e-4dd1-b461-4353a3f39f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:26.917274 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1e514e-f98e-4dd1-b461-4353a3f39f9f admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:26.917740 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1e514e-f98e-4dd1-b461-4353a3f39f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:26.918214 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1e514e-f98e-4dd1-b461-4353a3f39f9f admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:26.919867 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1e514e-f98e-4dd1-b461-4353a3f39f9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:26.926781 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1e514e-f98e-4dd1-b461-4353a3f39f9f admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:26.941915 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1131/2259] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:13:26 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 29 02:13:26.947389 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1e514e-f98e-4dd1-b461-4353a3f39f9f admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:26.950011 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-fd310a2d-3001-488a-b573-6915c3c348ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b60f2e80617c400bb911faaa69a68df3'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:26.951087 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-fd310a2d-3001-488a-b573-6915c3c348ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b60f2e80617c400bb911faaa69a68df3'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:26.963422 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1e514e-f98e-4dd1-b461-4353a3f39f9f admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:26.969875 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976e6155-9c3e-4f88-b725-bdb246fb2a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:26.971141 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e6155-9c3e-4f88-b725-bdb246fb2a66 admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:26.971429 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e6155-9c3e-4f88-b725-bdb246fb2a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:26.971835 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-fd310a2d-3001-488a-b573-6915c3c348ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b60f2e80617c400bb911faaa69a68df3'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:26.971955 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e6155-9c3e-4f88-b725-bdb246fb2a66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:26.973129 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976e6155-9c3e-4f88-b725-bdb246fb2a66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:26.975476 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976e6155-9c3e-4f88-b725-bdb246fb2a66 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:26.978379 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:26.985361 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-fd310a2d-3001-488a-b573-6915c3c348ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b60f2e80617c400bb911faaa69a68df3'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:26.988249 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-fd310a2d-3001-488a-b573-6915c3c348ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b60f2e80617c400bb911faaa69a68df3'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:26.990490 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1132/2260] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:13:26 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:13:26.995068 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976e6155-9c3e-4f88-b725-bdb246fb2a66 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:26.997659 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-976e6155-9c3e-4f88-b725-bdb246fb2a66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:27.007849 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1129/2261] 10.222.0.49 () {58 vars in 1224 bytes} [Thu Sep 29 02:13:26 2022] DELETE /identity/v3/users/b60f2e80617c400bb911faaa69a68df3 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:13:27.014162 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976e6155-9c3e-4f88-b725-bdb246fb2a66 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:27.110926 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd25b5c1-3291-4e4e-ba5c-b34b46b34ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:27.111660 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd25b5c1-3291-4e4e-ba5c-b34b46b34ed5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:27.111943 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd25b5c1-3291-4e4e-ba5c-b34b46b34ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:27.112220 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd25b5c1-3291-4e4e-ba5c-b34b46b34ed5 admin admin] PATH_INFO: `/v3/projects/5d4ebd62151047ac9329ffd342ec5cf3/users/8af86200622e4dd79fcc2e10d89493a7/roles/f157f905c9c94ccfbfb46e52d443e8f2` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:27.137369 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd25b5c1-3291-4e4e-ba5c-b34b46b34ed5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d4ebd62151047ac9329ffd342ec5cf3, user_id=8af86200622e4dd79fcc2e10d89493a7, role_id=f157f905c9c94ccfbfb46e52d443e8f2)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:27.143473 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd25b5c1-3291-4e4e-ba5c-b34b46b34ed5 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:27.176599 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1133/2262] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:13:26 2022] PUT /identity/v3/projects/5d4ebd62151047ac9329ffd342ec5cf3/users/8af86200622e4dd79fcc2e10d89493a7/roles/f157f905c9c94ccfbfb46e52d443e8f2 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:13:27.177978 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eb94da-3f5d-48c1-9f47-79ae665ddcb8 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:27.178360 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eb94da-3f5d-48c1-9f47-79ae665ddcb8 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:27.178704 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eb94da-3f5d-48c1-9f47-79ae665ddcb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:27.211233 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-02eb94da-3f5d-48c1-9f47-79ae665ddcb8 None None] MFA Rules not processed for user `8af86200622e4dd79fcc2e10d89493a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:27.212776 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-02eb94da-3f5d-48c1-9f47-79ae665ddcb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:27.292636 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1130/2263] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:13:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:13:27.298013 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd25b5c1-3291-4e4e-ba5c-b34b46b34ed5 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:27.389067 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd25b5c1-3291-4e4e-ba5c-b34b46b34ed5 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:27.396267 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5c0594-2ec4-41a2-8be1-8097840dc592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:27.397142 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c0594-2ec4-41a2-8be1-8097840dc592 admin admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:27.397955 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c0594-2ec4-41a2-8be1-8097840dc592 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:27.398334 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c0594-2ec4-41a2-8be1-8097840dc592 admin admin] PATH_INFO: `/v3/projects` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:27.399083 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5c0594-2ec4-41a2-8be1-8097840dc592 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:27.403043 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5c0594-2ec4-41a2-8be1-8097840dc592 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:27.434890 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1134/2264] 10.222.0.49 () {60 vars in 1153 bytes} [Thu Sep 29 02:13:27 2022] POST /identity/v3/projects => generated 375 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:13:27.436083 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eb94da-3f5d-48c1-9f47-79ae665ddcb8 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:27.447528 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eb94da-3f5d-48c1-9f47-79ae665ddcb8 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:27.512611 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5ea9eb-7914-468e-9cbb-90d9d2672990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:27.513358 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ea9eb-7914-468e-9cbb-90d9d2672990 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:27.513646 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ea9eb-7914-468e-9cbb-90d9d2672990 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:27.513918 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ea9eb-7914-468e-9cbb-90d9d2672990 admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:27.514664 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5ea9eb-7914-468e-9cbb-90d9d2672990 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:27.516990 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5ea9eb-7914-468e-9cbb-90d9d2672990 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:27.546008 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1131/2265] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 02:13:27 2022] POST /identity/v3/users => generated 294 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:13:27.547123 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5c0594-2ec4-41a2-8be1-8097840dc592 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:27.561448 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5c0594-2ec4-41a2-8be1-8097840dc592 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:27.569421 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0226fb5-9015-4df9-9bf7-0d9df7a04d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:27.587216 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0226fb5-9015-4df9-9bf7-0d9df7a04d7a admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:27.587216 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0226fb5-9015-4df9-9bf7-0d9df7a04d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:27.587216 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0226fb5-9015-4df9-9bf7-0d9df7a04d7a admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:27.587216 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0226fb5-9015-4df9-9bf7-0d9df7a04d7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:27.587216 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0226fb5-9015-4df9-9bf7-0d9df7a04d7a admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:27.602902 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1135/2266] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:13:27 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 29 02:13:27.607154 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5ea9eb-7914-468e-9cbb-90d9d2672990 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:27.623809 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5ea9eb-7914-468e-9cbb-90d9d2672990 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:27.633649 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cc9781-1c2c-468b-9f35-15061cdcda8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:27.634760 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc9781-1c2c-468b-9f35-15061cdcda8a admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:27.635276 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc9781-1c2c-468b-9f35-15061cdcda8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:27.635926 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc9781-1c2c-468b-9f35-15061cdcda8a admin admin] PATH_INFO: `/v3/projects/fb1fb85db0cd4ee4a0d91d1617d886a5/users/6ad4c7ef234a4f6dbf341dc1d814035c/roles/fe9bbc67742f4f5893f39b18eb31d59a` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:27.638226 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0226fb5-9015-4df9-9bf7-0d9df7a04d7a admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:27.640947 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-f0226fb5-9015-4df9-9bf7-0d9df7a04d7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:27.662720 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0226fb5-9015-4df9-9bf7-0d9df7a04d7a admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:27.664598 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cc9781-1c2c-468b-9f35-15061cdcda8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb1fb85db0cd4ee4a0d91d1617d886a5, user_id=6ad4c7ef234a4f6dbf341dc1d814035c, role_id=fe9bbc67742f4f5893f39b18eb31d59a)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:27.670030 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b92410-0ac0-487b-82a4-ab095c081dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:27.670713 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b92410-0ac0-487b-82a4-ab095c081dbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:27.671272 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b92410-0ac0-487b-82a4-ab095c081dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:27.671722 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b92410-0ac0-487b-82a4-ab095c081dbd admin admin] PATH_INFO: `/v3/projects/8bb8cd2513e641c2aaffdc19d60f8ba2` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:27.673240 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b92410-0ac0-487b-82a4-ab095c081dbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bb8cd2513e641c2aaffdc19d60f8ba2)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:27.675430 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cc9781-1c2c-468b-9f35-15061cdcda8a admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:27.675595 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b92410-0ac0-487b-82a4-ab095c081dbd admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:27.692821 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1132/2267] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:13:27 2022] PUT /identity/v3/projects/fb1fb85db0cd4ee4a0d91d1617d886a5/users/6ad4c7ef234a4f6dbf341dc1d814035c/roles/fe9bbc67742f4f5893f39b18eb31d59a => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:13:27.696957 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cc9781-1c2c-468b-9f35-15061cdcda8a admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:27.706183 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:27.737440 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-22b92410-0ac0-487b-82a4-ab095c081dbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bb8cd2513e641c2aaffdc19d60f8ba2', 'request_id': 'req-22b92410-0ac0-487b-82a4-ab095c081dbd'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:27.745001 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-22b92410-0ac0-487b-82a4-ab095c081dbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bb8cd2513e641c2aaffdc19d60f8ba2', 'request_id': 'req-22b92410-0ac0-487b-82a4-ab095c081dbd'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:27.746892 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:27.754654 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-22b92410-0ac0-487b-82a4-ab095c081dbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bb8cd2513e641c2aaffdc19d60f8ba2', 'request_id': 'req-22b92410-0ac0-487b-82a4-ab095c081dbd'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:27.765679 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-22b92410-0ac0-487b-82a4-ab095c081dbd admin admin] The token cache is being invalidate because project 8bb8cd2513e641c2aaffdc19d60f8ba2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81648) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:13:27.765985 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-22b92410-0ac0-487b-82a4-ab095c081dbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:27.766606 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-22b92410-0ac0-487b-82a4-ab095c081dbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:27.768537 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1136/2268] 10.222.0.49 () {58 vars in 1233 bytes} [Thu Sep 29 02:13:27 2022] DELETE /identity/v3/projects/8bb8cd2513e641c2aaffdc19d60f8ba2 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:13:27.773112 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cc9781-1c2c-468b-9f35-15061cdcda8a admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:27.773741 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b92410-0ac0-487b-82a4-ab095c081dbd admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:27.775142 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-22b92410-0ac0-487b-82a4-ab095c081dbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:27.842597 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c466db76-074b-401f-94da-93e303bf40f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:27.843507 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c466db76-074b-401f-94da-93e303bf40f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:27.843844 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c466db76-074b-401f-94da-93e303bf40f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:27.844183 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c466db76-074b-401f-94da-93e303bf40f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:27.844882 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c466db76-074b-401f-94da-93e303bf40f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:27.846503 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c466db76-074b-401f-94da-93e303bf40f9 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:27.855640 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b92410-0ac0-487b-82a4-ab095c081dbd admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:27.858492 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1133/2269] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:13:27 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 29 02:13:27.860652 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b556ca0-cca2-43d0-84b0-2a848775e82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:27.861574 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b556ca0-cca2-43d0-84b0-2a848775e82d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:27.861702 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b556ca0-cca2-43d0-84b0-2a848775e82d admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:27.861917 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b556ca0-cca2-43d0-84b0-2a848775e82d admin admin] PATH_INFO: `/v3/users/a719c5340d28409995122f48a21ebdfc` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:27.862587 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c466db76-074b-401f-94da-93e303bf40f9 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:27.863078 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b556ca0-cca2-43d0-84b0-2a848775e82d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a719c5340d28409995122f48a21ebdfc)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:27.865106 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b556ca0-cca2-43d0-84b0-2a848775e82d admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:27.866056 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-c466db76-074b-401f-94da-93e303bf40f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:27.880630 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c466db76-074b-401f-94da-93e303bf40f9 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:27.888837 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854c3edf-fdbb-4492-99a0-bcf3040d26f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:27.889605 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c3edf-fdbb-4492-99a0-bcf3040d26f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:27.889942 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c3edf-fdbb-4492-99a0-bcf3040d26f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:27.890273 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c3edf-fdbb-4492-99a0-bcf3040d26f1 admin admin] PATH_INFO: `/v3/projects/fb1fb85db0cd4ee4a0d91d1617d886a5/users/6ad4c7ef234a4f6dbf341dc1d814035c/roles/fe9bbc67742f4f5893f39b18eb31d59a` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:27.892922 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854c3edf-fdbb-4492-99a0-bcf3040d26f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb1fb85db0cd4ee4a0d91d1617d886a5, user_id=6ad4c7ef234a4f6dbf341dc1d814035c, role_id=fe9bbc67742f4f5893f39b18eb31d59a)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:27.897003 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854c3edf-fdbb-4492-99a0-bcf3040d26f1 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:27.931190 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1134/2270] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:13:27 2022] PUT /identity/v3/projects/fb1fb85db0cd4ee4a0d91d1617d886a5/users/6ad4c7ef234a4f6dbf341dc1d814035c/roles/fe9bbc67742f4f5893f39b18eb31d59a => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:13:27.936822 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-6b556ca0-cca2-43d0-84b0-2a848775e82d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a719c5340d28409995122f48a21ebdfc'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:27.937536 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-6b556ca0-cca2-43d0-84b0-2a848775e82d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a719c5340d28409995122f48a21ebdfc'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:27.942629 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5492c6-4e86-4b8e-b3e4-11d09c6e29bb None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:27.943021 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5492c6-4e86-4b8e-b3e4-11d09c6e29bb None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:27.943390 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5492c6-4e86-4b8e-b3e4-11d09c6e29bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:27.964857 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-6b556ca0-cca2-43d0-84b0-2a848775e82d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a719c5340d28409995122f48a21ebdfc'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:27.983140 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-6b556ca0-cca2-43d0-84b0-2a848775e82d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a719c5340d28409995122f48a21ebdfc'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:27.983374 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-fd5492c6-4e86-4b8e-b3e4-11d09c6e29bb None None] MFA Rules not processed for user `6ad4c7ef234a4f6dbf341dc1d814035c`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:27.983980 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-6b556ca0-cca2-43d0-84b0-2a848775e82d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a719c5340d28409995122f48a21ebdfc'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:27.984799 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-fd5492c6-4e86-4b8e-b3e4-11d09c6e29bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:28.002942 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1137/2271] 10.222.0.49 () {58 vars in 1224 bytes} [Thu Sep 29 02:13:27 2022] DELETE /identity/v3/users/a719c5340d28409995122f48a21ebdfc => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:13:28.098094 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1135/2272] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:13:27 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:13:28.108569 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b556ca0-cca2-43d0-84b0-2a848775e82d admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:28.110029 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-6b556ca0-cca2-43d0-84b0-2a848775e82d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:28.165986 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:28.219333 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b556ca0-cca2-43d0-84b0-2a848775e82d admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:28.224215 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47100518-4ec0-4a7b-a2f9-ed84bb36d012 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75135b856134ba4b9ccac337886f682', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:28.225934 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47100518-4ec0-4a7b-a2f9-ed84bb36d012 service cinder] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:28.226457 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47100518-4ec0-4a7b-a2f9-ed84bb36d012 service cinder] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:28.227040 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47100518-4ec0-4a7b-a2f9-ed84bb36d012 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:28.236362 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-47100518-4ec0-4a7b-a2f9-ed84bb36d012 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:28.336184 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47100518-4ec0-4a7b-a2f9-ed84bb36d012 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:28.338114 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47100518-4ec0-4a7b-a2f9-ed84bb36d012 service cinder] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:28.349352 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1138/2273] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:13:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:13:28.406827 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5492c6-4e86-4b8e-b3e4-11d09c6e29bb None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:28.408774 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-fd5492c6-4e86-4b8e-b3e4-11d09c6e29bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:28.496064 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:28.500887 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5492c6-4e86-4b8e-b3e4-11d09c6e29bb None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:28.565794 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a876fe2-94b1-4061-885e-e1a4e66c5ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:28.566616 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a876fe2-94b1-4061-885e-e1a4e66c5ed2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:28.567127 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a876fe2-94b1-4061-885e-e1a4e66c5ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:28.567435 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a876fe2-94b1-4061-885e-e1a4e66c5ed2 admin admin] PATH_INFO: `/v3/projects/9bd155d2f2ae4730a1be7b0d64f3a9b8` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:28.568729 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a876fe2-94b1-4061-885e-e1a4e66c5ed2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bd155d2f2ae4730a1be7b0d64f3a9b8)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:28.570729 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a876fe2-94b1-4061-885e-e1a4e66c5ed2 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:28.627207 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-6a876fe2-94b1-4061-885e-e1a4e66c5ed2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bd155d2f2ae4730a1be7b0d64f3a9b8', 'request_id': 'req-6a876fe2-94b1-4061-885e-e1a4e66c5ed2'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:28.634040 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-6a876fe2-94b1-4061-885e-e1a4e66c5ed2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bd155d2f2ae4730a1be7b0d64f3a9b8', 'request_id': 'req-6a876fe2-94b1-4061-885e-e1a4e66c5ed2'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:28.644072 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-6a876fe2-94b1-4061-885e-e1a4e66c5ed2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bd155d2f2ae4730a1be7b0d64f3a9b8', 'request_id': 'req-6a876fe2-94b1-4061-885e-e1a4e66c5ed2'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:28.661175 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-6a876fe2-94b1-4061-885e-e1a4e66c5ed2 admin admin] The token cache is being invalidate because project 9bd155d2f2ae4730a1be7b0d64f3a9b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81649) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:13:28.661175 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-6a876fe2-94b1-4061-885e-e1a4e66c5ed2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:28.662149 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-6a876fe2-94b1-4061-885e-e1a4e66c5ed2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:28.669227 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1136/2274] 10.222.0.49 () {58 vars in 1233 bytes} [Thu Sep 29 02:13:28 2022] DELETE /identity/v3/projects/9bd155d2f2ae4730a1be7b0d64f3a9b8 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:13:28.671275 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9350c07c-a253-489e-913b-9cfef0ccfcfd None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:28.671570 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9350c07c-a253-489e-913b-9cfef0ccfcfd None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:28.671851 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9350c07c-a253-489e-913b-9cfef0ccfcfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:28.709075 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-9350c07c-a253-489e-913b-9cfef0ccfcfd None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:28.710601 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-9350c07c-a253-489e-913b-9cfef0ccfcfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:28.773428 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1139/2275] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:13:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:13:28.781790 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad8e441-2416-49ea-9c63-0381548a29dc None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:28.782118 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad8e441-2416-49ea-9c63-0381548a29dc None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:28.782398 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad8e441-2416-49ea-9c63-0381548a29dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:28.802535 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-0ad8e441-2416-49ea-9c63-0381548a29dc None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:28.803740 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-0ad8e441-2416-49ea-9c63-0381548a29dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:28.811534 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1137/2276] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:13:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 29 02:13:28.815780 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9350c07c-a253-489e-913b-9cfef0ccfcfd None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:28.825560 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9350c07c-a253-489e-913b-9cfef0ccfcfd None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:28.830136 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84544117-e542-408a-a2c6-f0504d7808f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:28.830729 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84544117-e542-408a-a2c6-f0504d7808f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:28.831007 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84544117-e542-408a-a2c6-f0504d7808f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:28.831278 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84544117-e542-408a-a2c6-f0504d7808f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:28.832429 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84544117-e542-408a-a2c6-f0504d7808f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:13:28.832722 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84544117-e542-408a-a2c6-f0504d7808f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:28.834343 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84544117-e542-408a-a2c6-f0504d7808f3 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:28.846295 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1140/2277] 10.222.0.49 () {58 vars in 1153 bytes} [Thu Sep 29 02:13:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:13:28.852232 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad8e441-2416-49ea-9c63-0381548a29dc None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:28.861896 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad8e441-2416-49ea-9c63-0381548a29dc None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:28.866978 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a9e7db-e7c0-4096-b7af-5e4c7c204a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:28.867603 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a9e7db-e7c0-4096-b7af-5e4c7c204a4e admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:28.867880 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a9e7db-e7c0-4096-b7af-5e4c7c204a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:28.868150 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a9e7db-e7c0-4096-b7af-5e4c7c204a4e admin admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:28.868788 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a9e7db-e7c0-4096-b7af-5e4c7c204a4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:28.870788 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a9e7db-e7c0-4096-b7af-5e4c7c204a4e admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:28.897372 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1138/2278] 10.222.0.49 () {60 vars in 1153 bytes} [Thu Sep 29 02:13:28 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:13:28.901999 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84544117-e542-408a-a2c6-f0504d7808f3 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:28.913055 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84544117-e542-408a-a2c6-f0504d7808f3 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:28.969884 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4acf63c-f44a-4fde-bbfe-80b71a59b29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:28.970707 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4acf63c-f44a-4fde-bbfe-80b71a59b29e admin admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:28.970993 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4acf63c-f44a-4fde-bbfe-80b71a59b29e admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:28.971376 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4acf63c-f44a-4fde-bbfe-80b71a59b29e admin admin] PATH_INFO: `/v3/users` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:28.972101 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4acf63c-f44a-4fde-bbfe-80b71a59b29e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:28.974383 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4acf63c-f44a-4fde-bbfe-80b71a59b29e admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:28.992131 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:28.998435 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1141/2279] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 02:13:28 2022] POST /identity/v3/users => generated 286 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 29 02:13:29.002436 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a9e7db-e7c0-4096-b7af-5e4c7c204a4e admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:29.013466 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a9e7db-e7c0-4096-b7af-5e4c7c204a4e admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:29.018105 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9edc78-7c89-4076-8bcd-728627634dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:29.018696 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9edc78-7c89-4076-8bcd-728627634dd7 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:29.018964 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9edc78-7c89-4076-8bcd-728627634dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:29.019237 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9edc78-7c89-4076-8bcd-728627634dd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:29.020140 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9edc78-7c89-4076-8bcd-728627634dd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:29.022073 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9edc78-7c89-4076-8bcd-728627634dd7 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:29.032065 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1139/2280] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 29 02:13:29.036357 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4acf63c-f44a-4fde-bbfe-80b71a59b29e admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:29.046868 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4acf63c-f44a-4fde-bbfe-80b71a59b29e admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:29.052133 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d752914-a2ea-4d2d-86ee-4b9e20d924e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:29.052732 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d752914-a2ea-4d2d-86ee-4b9e20d924e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:29.053012 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d752914-a2ea-4d2d-86ee-4b9e20d924e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:29.053467 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d752914-a2ea-4d2d-86ee-4b9e20d924e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:29.054113 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d752914-a2ea-4d2d-86ee-4b9e20d924e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:29.055703 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d752914-a2ea-4d2d-86ee-4b9e20d924e6 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:29.066479 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1142/2281] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:13:29.070816 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9edc78-7c89-4076-8bcd-728627634dd7 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:29.080996 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9edc78-7c89-4076-8bcd-728627634dd7 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:29.086211 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4264ed-cddc-4cab-9544-b302938a6e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:29.087173 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4264ed-cddc-4cab-9544-b302938a6e4d admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:29.087481 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4264ed-cddc-4cab-9544-b302938a6e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:29.087752 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4264ed-cddc-4cab-9544-b302938a6e4d admin admin] PATH_INFO: `/v3/projects/a1b7230dfc074faa96453fb90a0ce65c/users/b78b5ec7f7824659b83b93cd8f2104ce/roles/f157f905c9c94ccfbfb46e52d443e8f2` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:29.103049 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4264ed-cddc-4cab-9544-b302938a6e4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1b7230dfc074faa96453fb90a0ce65c, user_id=b78b5ec7f7824659b83b93cd8f2104ce, role_id=f157f905c9c94ccfbfb46e52d443e8f2)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:29.105740 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4264ed-cddc-4cab-9544-b302938a6e4d admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:29.122126 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1140/2282] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:13:29 2022] PUT /identity/v3/projects/a1b7230dfc074faa96453fb90a0ce65c/users/b78b5ec7f7824659b83b93cd8f2104ce/roles/f157f905c9c94ccfbfb46e52d443e8f2 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:13:29.134356 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e90bcd7-93c3-4b0e-a5db-3f00686d4c82 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:29.134574 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e90bcd7-93c3-4b0e-a5db-3f00686d4c82 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:29.134863 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e90bcd7-93c3-4b0e-a5db-3f00686d4c82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:29.166594 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-0e90bcd7-93c3-4b0e-a5db-3f00686d4c82 None None] MFA Rules not processed for user `b78b5ec7f7824659b83b93cd8f2104ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:29.167867 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-0e90bcd7-93c3-4b0e-a5db-3f00686d4c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:29.239655 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1143/2283] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:13:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:13:29.251318 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4264ed-cddc-4cab-9544-b302938a6e4d admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:29.253168 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-be4264ed-cddc-4cab-9544-b302938a6e4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:29.291647 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:29.323703 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4264ed-cddc-4cab-9544-b302938a6e4d admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:29.327542 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2703f9d1-70fa-4de8-8863-32ea39eaba11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75135b856134ba4b9ccac337886f682', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:29.328143 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2703f9d1-70fa-4de8-8863-32ea39eaba11 service cinder] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:29.328420 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2703f9d1-70fa-4de8-8863-32ea39eaba11 service cinder] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:29.328687 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2703f9d1-70fa-4de8-8863-32ea39eaba11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:29.337428 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2703f9d1-70fa-4de8-8863-32ea39eaba11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:29.339008 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2703f9d1-70fa-4de8-8863-32ea39eaba11 service cinder] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:29.348663 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1141/2284] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:13:29 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:13:29.372090 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e90bcd7-93c3-4b0e-a5db-3f00686d4c82 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:29.440071 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e90bcd7-93c3-4b0e-a5db-3f00686d4c82 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:29.444937 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d883eb-3a0f-48b0-89c3-1fc74f7815c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:29.445821 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d883eb-3a0f-48b0-89c3-1fc74f7815c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:29.446171 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d883eb-3a0f-48b0-89c3-1fc74f7815c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:29.446567 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d883eb-3a0f-48b0-89c3-1fc74f7815c8 admin admin] PATH_INFO: `/v3/users/b78b5ec7f7824659b83b93cd8f2104ce` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:29.447771 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d883eb-3a0f-48b0-89c3-1fc74f7815c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b78b5ec7f7824659b83b93cd8f2104ce)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:29.449961 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d883eb-3a0f-48b0-89c3-1fc74f7815c8 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:29.497445 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-59d883eb-3a0f-48b0-89c3-1fc74f7815c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b78b5ec7f7824659b83b93cd8f2104ce'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:29.498141 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-59d883eb-3a0f-48b0-89c3-1fc74f7815c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b78b5ec7f7824659b83b93cd8f2104ce'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:29.510611 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-59d883eb-3a0f-48b0-89c3-1fc74f7815c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b78b5ec7f7824659b83b93cd8f2104ce'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:29.518129 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-59d883eb-3a0f-48b0-89c3-1fc74f7815c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b78b5ec7f7824659b83b93cd8f2104ce'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:29.518878 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-59d883eb-3a0f-48b0-89c3-1fc74f7815c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b78b5ec7f7824659b83b93cd8f2104ce'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:29.528017 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:29.533958 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1144/2285] 10.222.0.49 () {58 vars in 1224 bytes} [Thu Sep 29 02:13:29 2022] DELETE /identity/v3/users/b78b5ec7f7824659b83b93cd8f2104ce => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:13:29.539436 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30efd9d-4a23-4221-bc05-1152dd26b7ef None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:29.539725 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30efd9d-4a23-4221-bc05-1152dd26b7ef None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:29.540005 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30efd9d-4a23-4221-bc05-1152dd26b7ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:29.559016 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-c30efd9d-4a23-4221-bc05-1152dd26b7ef None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:29.560244 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-c30efd9d-4a23-4221-bc05-1152dd26b7ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:29.621551 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1142/2286] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:13:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:13:29.631663 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d883eb-3a0f-48b0-89c3-1fc74f7815c8 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:29.633088 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-59d883eb-3a0f-48b0-89c3-1fc74f7815c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:29.698086 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d883eb-3a0f-48b0-89c3-1fc74f7815c8 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:29.701866 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c736f97-e3f3-4435-9cb8-755766334bb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:29.702387 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c736f97-e3f3-4435-9cb8-755766334bb2 service neutron] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:29.702663 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c736f97-e3f3-4435-9cb8-755766334bb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:29.702928 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c736f97-e3f3-4435-9cb8-755766334bb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:29.712362 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c736f97-e3f3-4435-9cb8-755766334bb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:29.713822 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c736f97-e3f3-4435-9cb8-755766334bb2 service neutron] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:29.723499 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1145/2287] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:13:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:13:30.007365 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30efd9d-4a23-4221-bc05-1152dd26b7ef None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:30.008898 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-c30efd9d-4a23-4221-bc05-1152dd26b7ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:30.024746 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30efd9d-4a23-4221-bc05-1152dd26b7ef None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:30.030037 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5cf144-c910-4ad8-883a-e7eb48ffa247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:30.030597 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5cf144-c910-4ad8-883a-e7eb48ffa247 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:30.030931 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5cf144-c910-4ad8-883a-e7eb48ffa247 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:30.031129 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5cf144-c910-4ad8-883a-e7eb48ffa247 admin admin] PATH_INFO: `/v3/projects/a1b7230dfc074faa96453fb90a0ce65c` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:30.032250 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5cf144-c910-4ad8-883a-e7eb48ffa247 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1b7230dfc074faa96453fb90a0ce65c)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:30.034185 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5cf144-c910-4ad8-883a-e7eb48ffa247 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:30.080692 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-ea5cf144-c910-4ad8-883a-e7eb48ffa247 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1b7230dfc074faa96453fb90a0ce65c', 'request_id': 'req-ea5cf144-c910-4ad8-883a-e7eb48ffa247'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:30.086954 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-ea5cf144-c910-4ad8-883a-e7eb48ffa247 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1b7230dfc074faa96453fb90a0ce65c', 'request_id': 'req-ea5cf144-c910-4ad8-883a-e7eb48ffa247'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:30.095134 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-ea5cf144-c910-4ad8-883a-e7eb48ffa247 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1b7230dfc074faa96453fb90a0ce65c', 'request_id': 'req-ea5cf144-c910-4ad8-883a-e7eb48ffa247'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:30.107389 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-ea5cf144-c910-4ad8-883a-e7eb48ffa247 admin admin] The token cache is being invalidate because project a1b7230dfc074faa96453fb90a0ce65c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81649) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:13:30.107680 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-ea5cf144-c910-4ad8-883a-e7eb48ffa247 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:30.108324 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-ea5cf144-c910-4ad8-883a-e7eb48ffa247 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:30.109929 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1143/2288] 10.222.0.49 () {58 vars in 1233 bytes} [Thu Sep 29 02:13:30 2022] DELETE /identity/v3/projects/a1b7230dfc074faa96453fb90a0ce65c => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:13:30.115534 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21940570-bbf6-4f61-9cd0-65d40dbb56e1 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:30.116074 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21940570-bbf6-4f61-9cd0-65d40dbb56e1 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:30.116293 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21940570-bbf6-4f61-9cd0-65d40dbb56e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:30.138657 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-21940570-bbf6-4f61-9cd0-65d40dbb56e1 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:30.139799 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-21940570-bbf6-4f61-9cd0-65d40dbb56e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:30.209294 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1146/2289] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:13:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:13:30.217768 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad00681a-aa73-4b3a-bebe-2453c5de715c None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:30.218055 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad00681a-aa73-4b3a-bebe-2453c5de715c None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:30.218333 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad00681a-aa73-4b3a-bebe-2453c5de715c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:30.239569 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-ad00681a-aa73-4b3a-bebe-2453c5de715c None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:30.240781 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-ad00681a-aa73-4b3a-bebe-2453c5de715c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:30.248617 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1144/2290] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:13:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:13:30.252869 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21940570-bbf6-4f61-9cd0-65d40dbb56e1 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:30.262923 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21940570-bbf6-4f61-9cd0-65d40dbb56e1 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:30.267817 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bfcbab-d3a3-4164-97ed-d3b4fc1b2283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:30.268444 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bfcbab-d3a3-4164-97ed-d3b4fc1b2283 admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:30.268723 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bfcbab-d3a3-4164-97ed-d3b4fc1b2283 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:30.268991 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bfcbab-d3a3-4164-97ed-d3b4fc1b2283 admin admin] PATH_INFO: `/v3/domains` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:30.270475 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bfcbab-d3a3-4164-97ed-d3b4fc1b2283 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:13:30.270783 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bfcbab-d3a3-4164-97ed-d3b4fc1b2283 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:30.272640 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bfcbab-d3a3-4164-97ed-d3b4fc1b2283 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:30.284199 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1147/2291] 10.222.0.49 () {58 vars in 1153 bytes} [Thu Sep 29 02:13:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:13:30.289297 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad00681a-aa73-4b3a-bebe-2453c5de715c None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:30.298385 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad00681a-aa73-4b3a-bebe-2453c5de715c None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:30.303173 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769e4668-c790-497f-9afc-c2eea8ca3c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:30.303764 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e4668-c790-497f-9afc-c2eea8ca3c93 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:30.304038 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e4668-c790-497f-9afc-c2eea8ca3c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:30.304304 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e4668-c790-497f-9afc-c2eea8ca3c93 admin admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:30.304938 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769e4668-c790-497f-9afc-c2eea8ca3c93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:30.306854 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769e4668-c790-497f-9afc-c2eea8ca3c93 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:30.337046 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1145/2292] 10.222.0.49 () {60 vars in 1153 bytes} [Thu Sep 29 02:13:30 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:13:30.338769 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bfcbab-d3a3-4164-97ed-d3b4fc1b2283 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:30.349610 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bfcbab-d3a3-4164-97ed-d3b4fc1b2283 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:30.411798 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd3077f-cb5d-4edd-bd89-698b4faedcbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:30.412301 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd3077f-cb5d-4edd-bd89-698b4faedcbe admin admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:30.412573 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd3077f-cb5d-4edd-bd89-698b4faedcbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:30.412842 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd3077f-cb5d-4edd-bd89-698b4faedcbe admin admin] PATH_INFO: `/v3/users` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:30.413516 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd3077f-cb5d-4edd-bd89-698b4faedcbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:30.415456 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd3077f-cb5d-4edd-bd89-698b4faedcbe admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:30.436557 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1148/2293] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 02:13:30 2022] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 29 02:13:30.440748 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769e4668-c790-497f-9afc-c2eea8ca3c93 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:30.451394 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769e4668-c790-497f-9afc-c2eea8ca3c93 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:30.456020 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aee18c3-b518-482a-8cc6-bc984d4f6086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:30.457112 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aee18c3-b518-482a-8cc6-bc984d4f6086 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:30.457686 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aee18c3-b518-482a-8cc6-bc984d4f6086 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:30.457978 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aee18c3-b518-482a-8cc6-bc984d4f6086 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:30.458619 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aee18c3-b518-482a-8cc6-bc984d4f6086 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:30.460214 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aee18c3-b518-482a-8cc6-bc984d4f6086 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:30.471625 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1146/2294] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:13:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:13:30.476502 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd3077f-cb5d-4edd-bd89-698b4faedcbe admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:30.488462 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd3077f-cb5d-4edd-bd89-698b4faedcbe admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:30.493470 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6311ab-45ad-44c9-b0c6-3d173f99051f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:30.494058 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6311ab-45ad-44c9-b0c6-3d173f99051f admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:30.494336 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6311ab-45ad-44c9-b0c6-3d173f99051f admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:30.494605 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6311ab-45ad-44c9-b0c6-3d173f99051f admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:30.495245 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6311ab-45ad-44c9-b0c6-3d173f99051f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:30.502618 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6311ab-45ad-44c9-b0c6-3d173f99051f admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:30.509000 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1149/2295] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:13:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:13:30.513690 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aee18c3-b518-482a-8cc6-bc984d4f6086 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:30.524996 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aee18c3-b518-482a-8cc6-bc984d4f6086 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:30.529910 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd23fc25-7f95-4e26-b382-5030ea47a7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:30.530688 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd23fc25-7f95-4e26-b382-5030ea47a7b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:30.530972 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd23fc25-7f95-4e26-b382-5030ea47a7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:30.531249 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd23fc25-7f95-4e26-b382-5030ea47a7b5 admin admin] PATH_INFO: `/v3/projects/70b714875efb4ea59ec67ea8b515361f/users/63fedcb68c144caa893d245a8333b65e/roles/f157f905c9c94ccfbfb46e52d443e8f2` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:30.551709 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd23fc25-7f95-4e26-b382-5030ea47a7b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70b714875efb4ea59ec67ea8b515361f, user_id=63fedcb68c144caa893d245a8333b65e, role_id=f157f905c9c94ccfbfb46e52d443e8f2)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:30.554435 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd23fc25-7f95-4e26-b382-5030ea47a7b5 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:30.556677 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:30.572281 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1147/2296] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:13:30 2022] PUT /identity/v3/projects/70b714875efb4ea59ec67ea8b515361f/users/63fedcb68c144caa893d245a8333b65e/roles/f157f905c9c94ccfbfb46e52d443e8f2 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:13:30.582848 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8b4ab-1b04-4de8-b295-ccd661d4dac6 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:30.583345 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8b4ab-1b04-4de8-b295-ccd661d4dac6 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:30.583705 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8b4ab-1b04-4de8-b295-ccd661d4dac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:30.597788 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:30.612559 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-38f8b4ab-1b04-4de8-b295-ccd661d4dac6 None None] MFA Rules not processed for user `63fedcb68c144caa893d245a8333b65e`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:30.614453 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-38f8b4ab-1b04-4de8-b295-ccd661d4dac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:30.681620 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1150/2297] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:13:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 29 02:13:30.693038 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd23fc25-7f95-4e26-b382-5030ea47a7b5 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:30.694832 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-cd23fc25-7f95-4e26-b382-5030ea47a7b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:30.782536 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd23fc25-7f95-4e26-b382-5030ea47a7b5 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:30.786428 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f56aac6-3453-4720-93c2-f4f5bb4343e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75135b856134ba4b9ccac337886f682', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:30.786912 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f56aac6-3453-4720-93c2-f4f5bb4343e6 service cinder] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:30.787189 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f56aac6-3453-4720-93c2-f4f5bb4343e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:30.787460 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f56aac6-3453-4720-93c2-f4f5bb4343e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:30.797871 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f56aac6-3453-4720-93c2-f4f5bb4343e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:30.799322 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f56aac6-3453-4720-93c2-f4f5bb4343e6 service cinder] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:30.808974 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1148/2298] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:13:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 29 02:13:30.940789 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f8b4ab-1b04-4de8-b295-ccd661d4dac6 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:30.942266 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-38f8b4ab-1b04-4de8-b295-ccd661d4dac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:31.011381 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f8b4ab-1b04-4de8-b295-ccd661d4dac6 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:31.016124 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1296864b-8c09-4b67-8fd2-529d2879b2f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:31.016776 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1296864b-8c09-4b67-8fd2-529d2879b2f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:31.017114 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1296864b-8c09-4b67-8fd2-529d2879b2f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:31.017417 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1296864b-8c09-4b67-8fd2-529d2879b2f3 admin admin] PATH_INFO: `/v3/users/8af86200622e4dd79fcc2e10d89493a7` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:31.018556 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1296864b-8c09-4b67-8fd2-529d2879b2f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8af86200622e4dd79fcc2e10d89493a7)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:31.021573 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1296864b-8c09-4b67-8fd2-529d2879b2f3 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:31.078963 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-1296864b-8c09-4b67-8fd2-529d2879b2f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8af86200622e4dd79fcc2e10d89493a7'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:31.079699 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-1296864b-8c09-4b67-8fd2-529d2879b2f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8af86200622e4dd79fcc2e10d89493a7'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:31.102536 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-1296864b-8c09-4b67-8fd2-529d2879b2f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8af86200622e4dd79fcc2e10d89493a7'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:31.113379 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-1296864b-8c09-4b67-8fd2-529d2879b2f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8af86200622e4dd79fcc2e10d89493a7'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:31.114116 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-1296864b-8c09-4b67-8fd2-529d2879b2f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8af86200622e4dd79fcc2e10d89493a7'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:31.133158 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1151/2299] 10.222.0.49 () {58 vars in 1224 bytes} [Thu Sep 29 02:13:30 2022] DELETE /identity/v3/users/8af86200622e4dd79fcc2e10d89493a7 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:13:31.136413 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f810a1-24e8-4a25-a5d5-c42b6c42f450 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:31.136876 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f810a1-24e8-4a25-a5d5-c42b6c42f450 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:31.137345 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f810a1-24e8-4a25-a5d5-c42b6c42f450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:31.167359 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-a6f810a1-24e8-4a25-a5d5-c42b6c42f450 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:31.169119 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-a6f810a1-24e8-4a25-a5d5-c42b6c42f450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:31.262980 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1149/2300] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:13:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:13:31.273667 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1296864b-8c09-4b67-8fd2-529d2879b2f3 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:31.273667 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-1296864b-8c09-4b67-8fd2-529d2879b2f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:31.296477 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:31.348214 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1296864b-8c09-4b67-8fd2-529d2879b2f3 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:31.352382 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec67bc38-2dac-46ee-acf8-fba82e2efaa1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:31.353020 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67bc38-2dac-46ee-acf8-fba82e2efaa1 service neutron] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:31.353291 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67bc38-2dac-46ee-acf8-fba82e2efaa1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:31.353583 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67bc38-2dac-46ee-acf8-fba82e2efaa1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:31.364446 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec67bc38-2dac-46ee-acf8-fba82e2efaa1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:31.365962 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec67bc38-2dac-46ee-acf8-fba82e2efaa1 service neutron] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:31.376637 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1152/2301] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:13:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:13:31.629293 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f810a1-24e8-4a25-a5d5-c42b6c42f450 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:31.630795 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-a6f810a1-24e8-4a25-a5d5-c42b6c42f450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:31.655118 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f810a1-24e8-4a25-a5d5-c42b6c42f450 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:31.662421 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddcd65f-8628-4006-b890-8c462dcae75c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:31.663222 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddcd65f-8628-4006-b890-8c462dcae75c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:31.663649 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddcd65f-8628-4006-b890-8c462dcae75c admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:31.663916 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddcd65f-8628-4006-b890-8c462dcae75c admin admin] PATH_INFO: `/v3/users/e27235300f5e4649aa617dbfde4e98c4` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:31.665070 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddcd65f-8628-4006-b890-8c462dcae75c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e27235300f5e4649aa617dbfde4e98c4)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:31.667049 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddcd65f-8628-4006-b890-8c462dcae75c admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:31.749818 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-1ddcd65f-8628-4006-b890-8c462dcae75c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e27235300f5e4649aa617dbfde4e98c4'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:31.751307 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-1ddcd65f-8628-4006-b890-8c462dcae75c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e27235300f5e4649aa617dbfde4e98c4'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:31.771166 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-1ddcd65f-8628-4006-b890-8c462dcae75c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e27235300f5e4649aa617dbfde4e98c4'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:31.786608 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-1ddcd65f-8628-4006-b890-8c462dcae75c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e27235300f5e4649aa617dbfde4e98c4'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:31.790295 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-1ddcd65f-8628-4006-b890-8c462dcae75c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e27235300f5e4649aa617dbfde4e98c4'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:31.813205 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1150/2302] 10.222.0.49 () {58 vars in 1224 bytes} [Thu Sep 29 02:13:31 2022] DELETE /identity/v3/users/e27235300f5e4649aa617dbfde4e98c4 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:13:31.828062 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a67fe01-f84b-41f9-9992-9d5d74fb5728 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:31.829264 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a67fe01-f84b-41f9-9992-9d5d74fb5728 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:31.830139 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a67fe01-f84b-41f9-9992-9d5d74fb5728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:31.844480 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddcd65f-8628-4006-b890-8c462dcae75c admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:31.856304 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-1ddcd65f-8628-4006-b890-8c462dcae75c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:31.872575 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:31.880215 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-0a67fe01-f84b-41f9-9992-9d5d74fb5728 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:31.882457 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-0a67fe01-f84b-41f9-9992-9d5d74fb5728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:31.981749 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddcd65f-8628-4006-b890-8c462dcae75c admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:31.990718 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26b3fc5-617f-4482-96c8-27b023602042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:31.991629 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b3fc5-617f-4482-96c8-27b023602042 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:31.991968 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b3fc5-617f-4482-96c8-27b023602042 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:31.992328 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b3fc5-617f-4482-96c8-27b023602042 admin admin] PATH_INFO: `/v3/projects/5d4ebd62151047ac9329ffd342ec5cf3` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:31.993868 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26b3fc5-617f-4482-96c8-27b023602042 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d4ebd62151047ac9329ffd342ec5cf3)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:31.995588 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26b3fc5-617f-4482-96c8-27b023602042 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:32.012894 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1153/2303] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:13:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:13:32.025271 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a67fe01-f84b-41f9-9992-9d5d74fb5728 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:32.027258 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-0a67fe01-f84b-41f9-9992-9d5d74fb5728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:32.064980 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-d26b3fc5-617f-4482-96c8-27b023602042 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d4ebd62151047ac9329ffd342ec5cf3', 'request_id': 'req-d26b3fc5-617f-4482-96c8-27b023602042'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:32.072666 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-d26b3fc5-617f-4482-96c8-27b023602042 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d4ebd62151047ac9329ffd342ec5cf3', 'request_id': 'req-d26b3fc5-617f-4482-96c8-27b023602042'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:32.082287 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-d26b3fc5-617f-4482-96c8-27b023602042 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d4ebd62151047ac9329ffd342ec5cf3', 'request_id': 'req-d26b3fc5-617f-4482-96c8-27b023602042'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:32.109722 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-d26b3fc5-617f-4482-96c8-27b023602042 admin admin] The token cache is being invalidate because project 5d4ebd62151047ac9329ffd342ec5cf3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81649) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:13:32.110019 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-d26b3fc5-617f-4482-96c8-27b023602042 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:32.110707 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-d26b3fc5-617f-4482-96c8-27b023602042 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:32.113492 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1151/2304] 10.222.0.49 () {58 vars in 1233 bytes} [Thu Sep 29 02:13:31 2022] DELETE /identity/v3/projects/5d4ebd62151047ac9329ffd342ec5cf3 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:13:32.117428 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26b3fc5-617f-4482-96c8-27b023602042 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:32.118808 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-d26b3fc5-617f-4482-96c8-27b023602042 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:32.119598 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a67fe01-f84b-41f9-9992-9d5d74fb5728 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:32.171717 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415d283d-0451-4169-b17c-6c669f6807cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:32.172409 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415d283d-0451-4169-b17c-6c669f6807cf service neutron] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:32.172586 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415d283d-0451-4169-b17c-6c669f6807cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:32.172852 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415d283d-0451-4169-b17c-6c669f6807cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:32.175377 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-415d283d-0451-4169-b17c-6c669f6807cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:32.183495 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26b3fc5-617f-4482-96c8-27b023602042 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:32.188353 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7eedc7-5728-4ec6-89e8-f7f7194eece0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:32.188985 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7eedc7-5728-4ec6-89e8-f7f7194eece0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:32.189256 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7eedc7-5728-4ec6-89e8-f7f7194eece0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:32.189474 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415d283d-0451-4169-b17c-6c669f6807cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:32.189580 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7eedc7-5728-4ec6-89e8-f7f7194eece0 admin admin] PATH_INFO: `/v3/users/6ad4c7ef234a4f6dbf341dc1d814035c` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:32.190705 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7eedc7-5728-4ec6-89e8-f7f7194eece0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ad4c7ef234a4f6dbf341dc1d814035c)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:32.191484 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415d283d-0451-4169-b17c-6c669f6807cf service neutron] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:32.193134 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7eedc7-5728-4ec6-89e8-f7f7194eece0 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:32.202726 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1154/2305] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:13:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 29 02:13:32.244118 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:32.250564 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-5c7eedc7-5728-4ec6-89e8-f7f7194eece0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ad4c7ef234a4f6dbf341dc1d814035c'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:32.252795 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-5c7eedc7-5728-4ec6-89e8-f7f7194eece0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ad4c7ef234a4f6dbf341dc1d814035c'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:32.271596 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-5c7eedc7-5728-4ec6-89e8-f7f7194eece0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ad4c7ef234a4f6dbf341dc1d814035c'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:32.279596 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-5c7eedc7-5728-4ec6-89e8-f7f7194eece0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ad4c7ef234a4f6dbf341dc1d814035c'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:32.280525 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-5c7eedc7-5728-4ec6-89e8-f7f7194eece0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ad4c7ef234a4f6dbf341dc1d814035c'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:32.317113 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1152/2306] 10.222.0.49 () {58 vars in 1224 bytes} [Thu Sep 29 02:13:32 2022] DELETE /identity/v3/users/6ad4c7ef234a4f6dbf341dc1d814035c => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:13:32.523774 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415d283d-0451-4169-b17c-6c669f6807cf service neutron] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:32.525751 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-415d283d-0451-4169-b17c-6c669f6807cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:32.546543 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415d283d-0451-4169-b17c-6c669f6807cf service neutron] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:32.573120 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:32.652327 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd5f7c5-df8e-43a0-9fdb-ffa170592202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:32.652968 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd5f7c5-df8e-43a0-9fdb-ffa170592202 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:32.653245 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd5f7c5-df8e-43a0-9fdb-ffa170592202 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:32.653565 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd5f7c5-df8e-43a0-9fdb-ffa170592202 admin admin] PATH_INFO: `/v3/projects/cdd4c92340ab4a369623f5ccfe5bc98b` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:32.654826 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd5f7c5-df8e-43a0-9fdb-ffa170592202 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdd4c92340ab4a369623f5ccfe5bc98b)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:32.657473 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd5f7c5-df8e-43a0-9fdb-ffa170592202 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:32.702087 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7eedc7-5728-4ec6-89e8-f7f7194eece0 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:32.703705 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-5c7eedc7-5728-4ec6-89e8-f7f7194eece0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:32.725281 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7eedc7-5728-4ec6-89e8-f7f7194eece0 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:32.765848 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5ad9ed-186b-4424-9d2a-6b243cb524e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:32.765848 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5ad9ed-186b-4424-9d2a-6b243cb524e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:32.765848 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5ad9ed-186b-4424-9d2a-6b243cb524e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:32.765848 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5ad9ed-186b-4424-9d2a-6b243cb524e8 admin admin] PATH_INFO: `/v3/projects/fb1fb85db0cd4ee4a0d91d1617d886a5` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:32.766714 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5ad9ed-186b-4424-9d2a-6b243cb524e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb1fb85db0cd4ee4a0d91d1617d886a5)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:32.766877 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-3fd5f7c5-df8e-43a0-9fdb-ffa170592202 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdd4c92340ab4a369623f5ccfe5bc98b', 'request_id': 'req-3fd5f7c5-df8e-43a0-9fdb-ffa170592202'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:32.766959 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5ad9ed-186b-4424-9d2a-6b243cb524e8 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:32.771195 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-3fd5f7c5-df8e-43a0-9fdb-ffa170592202 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdd4c92340ab4a369623f5ccfe5bc98b', 'request_id': 'req-3fd5f7c5-df8e-43a0-9fdb-ffa170592202'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:32.780734 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-3fd5f7c5-df8e-43a0-9fdb-ffa170592202 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdd4c92340ab4a369623f5ccfe5bc98b', 'request_id': 'req-3fd5f7c5-df8e-43a0-9fdb-ffa170592202'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:32.794999 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-3fd5f7c5-df8e-43a0-9fdb-ffa170592202 admin admin] The token cache is being invalidate because project cdd4c92340ab4a369623f5ccfe5bc98b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81648) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:13:32.795295 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-3fd5f7c5-df8e-43a0-9fdb-ffa170592202 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:32.796030 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-3fd5f7c5-df8e-43a0-9fdb-ffa170592202 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:32.797820 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1155/2307] 10.222.0.49 () {58 vars in 1233 bytes} [Thu Sep 29 02:13:32 2022] DELETE /identity/v3/projects/cdd4c92340ab4a369623f5ccfe5bc98b => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:13:32.803530 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04437a8-5e27-4d8c-b100-06686eb5d47d None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:32.803799 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04437a8-5e27-4d8c-b100-06686eb5d47d None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:32.804073 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04437a8-5e27-4d8c-b100-06686eb5d47d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:32.819150 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-9c5ad9ed-186b-4424-9d2a-6b243cb524e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb1fb85db0cd4ee4a0d91d1617d886a5', 'request_id': 'req-9c5ad9ed-186b-4424-9d2a-6b243cb524e8'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:32.824909 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-b04437a8-5e27-4d8c-b100-06686eb5d47d None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:32.826103 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-9c5ad9ed-186b-4424-9d2a-6b243cb524e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb1fb85db0cd4ee4a0d91d1617d886a5', 'request_id': 'req-9c5ad9ed-186b-4424-9d2a-6b243cb524e8'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:32.826303 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-b04437a8-5e27-4d8c-b100-06686eb5d47d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:32.835068 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-9c5ad9ed-186b-4424-9d2a-6b243cb524e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb1fb85db0cd4ee4a0d91d1617d886a5', 'request_id': 'req-9c5ad9ed-186b-4424-9d2a-6b243cb524e8'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:32.851404 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-9c5ad9ed-186b-4424-9d2a-6b243cb524e8 admin admin] The token cache is being invalidate because project fb1fb85db0cd4ee4a0d91d1617d886a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81649) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:13:32.851697 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-9c5ad9ed-186b-4424-9d2a-6b243cb524e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:32.852536 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-9c5ad9ed-186b-4424-9d2a-6b243cb524e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:32.854578 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1153/2308] 10.222.0.49 () {58 vars in 1233 bytes} [Thu Sep 29 02:13:32 2022] DELETE /identity/v3/projects/fb1fb85db0cd4ee4a0d91d1617d886a5 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:13:32.859804 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf016800-97d3-4384-aaf6-b960cb74998d None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:32.860214 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf016800-97d3-4384-aaf6-b960cb74998d None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:32.860549 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf016800-97d3-4384-aaf6-b960cb74998d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:32.881827 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-bf016800-97d3-4384-aaf6-b960cb74998d None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:32.883123 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-bf016800-97d3-4384-aaf6-b960cb74998d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:32.905645 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1156/2309] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:13:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 29 02:13:32.914441 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a794a439-f11b-46e2-a7d7-c1049ec1136f None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:32.914725 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a794a439-f11b-46e2-a7d7-c1049ec1136f None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:32.914999 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a794a439-f11b-46e2-a7d7-c1049ec1136f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:32.940690 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-a794a439-f11b-46e2-a7d7-c1049ec1136f None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:32.942045 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-a794a439-f11b-46e2-a7d7-c1049ec1136f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:32.950630 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1157/2310] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:13:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 29 02:13:32.954582 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a794a439-f11b-46e2-a7d7-c1049ec1136f None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:32.964627 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a794a439-f11b-46e2-a7d7-c1049ec1136f None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:32.966552 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1154/2311] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:13:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 29 02:13:32.973423 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db1ca82-7f78-4541-8c9d-6394178b2323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:32.974729 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4af601-ced7-4907-a6b7-4c95f07656b3 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:32.975006 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4af601-ced7-4907-a6b7-4c95f07656b3 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:32.975271 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4af601-ced7-4907-a6b7-4c95f07656b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:32.978489 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db1ca82-7f78-4541-8c9d-6394178b2323 admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:32.978709 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db1ca82-7f78-4541-8c9d-6394178b2323 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:32.978980 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db1ca82-7f78-4541-8c9d-6394178b2323 admin admin] PATH_INFO: `/v3/domains` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:32.979706 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db1ca82-7f78-4541-8c9d-6394178b2323 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:13:32.979930 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db1ca82-7f78-4541-8c9d-6394178b2323 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:32.981584 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db1ca82-7f78-4541-8c9d-6394178b2323 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:32.994810 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1158/2312] 10.222.0.49 () {58 vars in 1153 bytes} [Thu Sep 29 02:13:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 02:13:32.999328 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db1ca82-7f78-4541-8c9d-6394178b2323 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:33.004785 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-cb4af601-ced7-4907-a6b7-4c95f07656b3 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:33.006238 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-cb4af601-ced7-4907-a6b7-4c95f07656b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:33.011916 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db1ca82-7f78-4541-8c9d-6394178b2323 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:33.018636 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76f0570-96e5-49e4-8916-544fbf1e5f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:33.019496 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1155/2313] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:13:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 29 02:13:33.019690 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f0570-96e5-49e4-8916-544fbf1e5f2d admin admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:33.020150 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f0570-96e5-49e4-8916-544fbf1e5f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:33.020575 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f0570-96e5-49e4-8916-544fbf1e5f2d admin admin] PATH_INFO: `/v3/projects` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:33.022168 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76f0570-96e5-49e4-8916-544fbf1e5f2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:33.024208 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4af601-ced7-4907-a6b7-4c95f07656b3 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:33.024321 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76f0570-96e5-49e4-8916-544fbf1e5f2d admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:33.034351 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4af601-ced7-4907-a6b7-4c95f07656b3 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:33.039442 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e391291c-23b8-4171-bf58-7f9e1437b2ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:33.040149 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e391291c-23b8-4171-bf58-7f9e1437b2ff admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:33.040429 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e391291c-23b8-4171-bf58-7f9e1437b2ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:33.041002 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e391291c-23b8-4171-bf58-7f9e1437b2ff admin admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:33.041688 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e391291c-23b8-4171-bf58-7f9e1437b2ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:13:33.041990 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e391291c-23b8-4171-bf58-7f9e1437b2ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:33.043574 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e391291c-23b8-4171-bf58-7f9e1437b2ff admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:33.053184 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1159/2314] 10.222.0.49 () {60 vars in 1153 bytes} [Thu Sep 29 02:13:32 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 29 02:13:33.057175 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76f0570-96e5-49e4-8916-544fbf1e5f2d admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:33.062315 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1156/2315] 10.222.0.49 () {58 vars in 1153 bytes} [Thu Sep 29 02:13:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:13:33.063505 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e391291c-23b8-4171-bf58-7f9e1437b2ff admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:33.065731 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:33.075575 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e391291c-23b8-4171-bf58-7f9e1437b2ff admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:33.095292 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:33.126883 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76f0570-96e5-49e4-8916-544fbf1e5f2d admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:33.132886 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4332eddf-51ae-4f48-8d1c-b743ca477183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:33.133542 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4332eddf-51ae-4f48-8d1c-b743ca477183 admin admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:33.133825 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4332eddf-51ae-4f48-8d1c-b743ca477183 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:33.134099 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4332eddf-51ae-4f48-8d1c-b743ca477183 admin admin] PATH_INFO: `/v3/users` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:33.134741 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4332eddf-51ae-4f48-8d1c-b743ca477183 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:33.136664 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4332eddf-51ae-4f48-8d1c-b743ca477183 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:33.140957 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dcbd24-05c0-42b7-8810-8d497c3a5552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:33.141892 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dcbd24-05c0-42b7-8810-8d497c3a5552 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:33.142177 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dcbd24-05c0-42b7-8810-8d497c3a5552 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:33.142448 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dcbd24-05c0-42b7-8810-8d497c3a5552 admin admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:33.143082 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dcbd24-05c0-42b7-8810-8d497c3a5552 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:33.146048 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dcbd24-05c0-42b7-8810-8d497c3a5552 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:33.161764 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1160/2316] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 02:13:33 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 29 02:13:33.165856 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4332eddf-51ae-4f48-8d1c-b743ca477183 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:33.176674 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4332eddf-51ae-4f48-8d1c-b743ca477183 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:33.180514 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1157/2317] 10.222.0.49 () {60 vars in 1153 bytes} [Thu Sep 29 02:13:33 2022] POST /identity/v3/projects => generated 377 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 29 02:13:33.181338 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dcbd24-05c0-42b7-8810-8d497c3a5552 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:33.248054 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f56cd8-f2fc-4cfd-96dc-8667583df6e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:33.248922 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f56cd8-f2fc-4cfd-96dc-8667583df6e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:33.249414 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f56cd8-f2fc-4cfd-96dc-8667583df6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:33.249839 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f56cd8-f2fc-4cfd-96dc-8667583df6e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:33.250664 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f56cd8-f2fc-4cfd-96dc-8667583df6e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:33.252269 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f56cd8-f2fc-4cfd-96dc-8667583df6e7 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:33.253835 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dcbd24-05c0-42b7-8810-8d497c3a5552 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:33.259647 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac990b13-f2c5-4653-93a6-4313d2677cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:33.260314 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac990b13-f2c5-4653-93a6-4313d2677cfc admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:33.260589 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac990b13-f2c5-4653-93a6-4313d2677cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:33.260866 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac990b13-f2c5-4653-93a6-4313d2677cfc admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:33.261528 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac990b13-f2c5-4653-93a6-4313d2677cfc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:33.263430 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac990b13-f2c5-4653-93a6-4313d2677cfc admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:33.264850 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1161/2318] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:13:33 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:13:33.269861 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f56cd8-f2fc-4cfd-96dc-8667583df6e7 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:33.281717 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f56cd8-f2fc-4cfd-96dc-8667583df6e7 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:33.287639 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea084ee-a952-4830-96d9-9e3f7554e4aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:33.288350 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea084ee-a952-4830-96d9-9e3f7554e4aa admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:33.288698 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea084ee-a952-4830-96d9-9e3f7554e4aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:33.289043 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea084ee-a952-4830-96d9-9e3f7554e4aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:33.289797 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea084ee-a952-4830-96d9-9e3f7554e4aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:33.290450 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1158/2319] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 02:13:33 2022] POST /identity/v3/users => generated 289 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 29 02:13:33.291541 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea084ee-a952-4830-96d9-9e3f7554e4aa admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:33.295088 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac990b13-f2c5-4653-93a6-4313d2677cfc admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:33.302607 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1162/2320] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:13:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 29 02:13:33.306896 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea084ee-a952-4830-96d9-9e3f7554e4aa admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:33.307711 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac990b13-f2c5-4653-93a6-4313d2677cfc admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:33.312450 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e42983-f300-4936-bf54-84275c84e821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:33.313071 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e42983-f300-4936-bf54-84275c84e821 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:33.313383 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e42983-f300-4936-bf54-84275c84e821 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:33.313684 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e42983-f300-4936-bf54-84275c84e821 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:33.314477 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e42983-f300-4936-bf54-84275c84e821 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:33.316122 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e42983-f300-4936-bf54-84275c84e821 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:33.318132 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea084ee-a952-4830-96d9-9e3f7554e4aa admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:33.325806 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10b0aae-5563-43e9-a6c3-c052101a9698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:33.326542 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10b0aae-5563-43e9-a6c3-c052101a9698 admin admin] REQUEST_METHOD: `PUT` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:33.326905 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10b0aae-5563-43e9-a6c3-c052101a9698 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:33.327124 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10b0aae-5563-43e9-a6c3-c052101a9698 admin admin] PATH_INFO: `/v3/projects/7d0ac285a6454f88bd1ea0382844f6bf/users/bcd3fa0a082144c3892221602eeeb4d9/roles/f157f905c9c94ccfbfb46e52d443e8f2` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:33.328783 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1159/2321] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:13:33 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 29 02:13:33.333865 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e42983-f300-4936-bf54-84275c84e821 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:33.344039 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e42983-f300-4936-bf54-84275c84e821 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:33.346013 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10b0aae-5563-43e9-a6c3-c052101a9698 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d0ac285a6454f88bd1ea0382844f6bf, user_id=bcd3fa0a082144c3892221602eeeb4d9, role_id=f157f905c9c94ccfbfb46e52d443e8f2)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:33.349346 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0994c0-1ea5-4e16-9981-7e8bd5b5796d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:33.349502 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10b0aae-5563-43e9-a6c3-c052101a9698 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:33.349952 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0994c0-1ea5-4e16-9981-7e8bd5b5796d admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:33.350237 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0994c0-1ea5-4e16-9981-7e8bd5b5796d admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:33.350510 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0994c0-1ea5-4e16-9981-7e8bd5b5796d admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:33.351155 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0994c0-1ea5-4e16-9981-7e8bd5b5796d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:33.352844 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0994c0-1ea5-4e16-9981-7e8bd5b5796d admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:33.363741 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1163/2322] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:13:33 2022] PUT /identity/v3/projects/7d0ac285a6454f88bd1ea0382844f6bf/users/bcd3fa0a082144c3892221602eeeb4d9/roles/f157f905c9c94ccfbfb46e52d443e8f2 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:13:33.367663 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1160/2323] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:13:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 29 02:13:33.369105 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11647f26-68d1-4c3f-b9df-3d36dd618029 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:33.369420 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11647f26-68d1-4c3f-b9df-3d36dd618029 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:33.369532 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10b0aae-5563-43e9-a6c3-c052101a9698 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:33.369697 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11647f26-68d1-4c3f-b9df-3d36dd618029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:33.388125 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-11647f26-68d1-4c3f-b9df-3d36dd618029 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:33.389378 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-11647f26-68d1-4c3f-b9df-3d36dd618029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:33.428095 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:33.432817 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10b0aae-5563-43e9-a6c3-c052101a9698 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:33.439115 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdafbd69-469d-4b53-ac67-9959c88cd7c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:33.439769 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdafbd69-469d-4b53-ac67-9959c88cd7c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:33.440062 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdafbd69-469d-4b53-ac67-9959c88cd7c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:33.440313 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdafbd69-469d-4b53-ac67-9959c88cd7c4 admin admin] PATH_INFO: `/v3/projects/38989274c7054da59394b0bdf3099e41/users/3553670b2175477db3f63f1558380b59/roles/f157f905c9c94ccfbfb46e52d443e8f2` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:33.454468 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1161/2324] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:13:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 29 02:13:33.455434 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdafbd69-469d-4b53-ac67-9959c88cd7c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38989274c7054da59394b0bdf3099e41, user_id=3553670b2175477db3f63f1558380b59, role_id=f157f905c9c94ccfbfb46e52d443e8f2)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:33.458700 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdafbd69-469d-4b53-ac67-9959c88cd7c4 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:33.465114 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11647f26-68d1-4c3f-b9df-3d36dd618029 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:33.466547 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-11647f26-68d1-4c3f-b9df-3d36dd618029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:33.473120 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1164/2325] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:13:33 2022] PUT /identity/v3/projects/38989274c7054da59394b0bdf3099e41/users/3553670b2175477db3f63f1558380b59/roles/f157f905c9c94ccfbfb46e52d443e8f2 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:13:33.484146 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d3cb8d-defd-40f5-ae11-dc23ee0dcc91 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:33.484615 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d3cb8d-defd-40f5-ae11-dc23ee0dcc91 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:33.484891 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d3cb8d-defd-40f5-ae11-dc23ee0dcc91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:33.490071 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:33.516320 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-11d3cb8d-defd-40f5-ae11-dc23ee0dcc91 None None] MFA Rules not processed for user `3553670b2175477db3f63f1558380b59`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:33.517539 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-11d3cb8d-defd-40f5-ae11-dc23ee0dcc91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:33.539538 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11647f26-68d1-4c3f-b9df-3d36dd618029 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:33.600695 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1165/2326] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:13:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 29 02:13:33.605372 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d3cb8d-defd-40f5-ae11-dc23ee0dcc91 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:33.609486 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1126014c-260d-462b-acb2-80607b6fe482 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:33.610096 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1126014c-260d-462b-acb2-80607b6fe482 service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:33.610374 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1126014c-260d-462b-acb2-80607b6fe482 service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:33.611006 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1126014c-260d-462b-acb2-80607b6fe482 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:33.680425 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d3cb8d-defd-40f5-ae11-dc23ee0dcc91 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:33.686980 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4784fa58-d1b1-460d-b411-865484b9ed9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:33.687859 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4784fa58-d1b1-460d-b411-865484b9ed9f admin admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:33.688217 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4784fa58-d1b1-460d-b411-865484b9ed9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:33.688486 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4784fa58-d1b1-460d-b411-865484b9ed9f admin admin] PATH_INFO: `/v3/projects` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:33.689762 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4784fa58-d1b1-460d-b411-865484b9ed9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:33.692326 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1126014c-260d-462b-acb2-80607b6fe482 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:33.692796 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4784fa58-d1b1-460d-b411-865484b9ed9f admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:33.693865 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1126014c-260d-462b-acb2-80607b6fe482 service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:33.718903 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1162/2327] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:13:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 29 02:13:33.736154 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1166/2328] 10.222.0.49 () {60 vars in 1153 bytes} [Thu Sep 29 02:13:33 2022] POST /identity/v3/projects => generated 377 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 29 02:13:33.740592 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1126014c-260d-462b-acb2-80607b6fe482 service neutron] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:33.753193 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1126014c-260d-462b-acb2-80607b6fe482 service neutron] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:33.846730 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee2ed85-7b3c-4315-bffc-23022d5916a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:33.848284 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee2ed85-7b3c-4315-bffc-23022d5916a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:33.848701 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee2ed85-7b3c-4315-bffc-23022d5916a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:33.849045 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee2ed85-7b3c-4315-bffc-23022d5916a4 admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:33.849801 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee2ed85-7b3c-4315-bffc-23022d5916a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:33.851935 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee2ed85-7b3c-4315-bffc-23022d5916a4 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:33.876251 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1163/2329] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 02:13:33 2022] POST /identity/v3/users => generated 289 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:13:33.881172 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4784fa58-d1b1-460d-b411-865484b9ed9f admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:33.893811 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4784fa58-d1b1-460d-b411-865484b9ed9f admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:33.921151 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb862738-b875-49e4-93be-6704773bf45c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:33.921931 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb862738-b875-49e4-93be-6704773bf45c admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:33.922149 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb862738-b875-49e4-93be-6704773bf45c admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:33.922414 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb862738-b875-49e4-93be-6704773bf45c admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:33.923111 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb862738-b875-49e4-93be-6704773bf45c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:33.925026 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb862738-b875-49e4-93be-6704773bf45c admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:33.937255 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1167/2330] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:13:33 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:13:33.942707 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee2ed85-7b3c-4315-bffc-23022d5916a4 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:33.957956 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee2ed85-7b3c-4315-bffc-23022d5916a4 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:33.964420 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2de77c6-5c51-46bc-8bb7-18e667ee90ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:33.965659 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2de77c6-5c51-46bc-8bb7-18e667ee90ac admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:33.966268 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2de77c6-5c51-46bc-8bb7-18e667ee90ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:33.966598 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2de77c6-5c51-46bc-8bb7-18e667ee90ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:33.967363 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2de77c6-5c51-46bc-8bb7-18e667ee90ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:33.969984 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2de77c6-5c51-46bc-8bb7-18e667ee90ac admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:33.977612 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:33.986470 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1164/2331] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:13:33 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 29 02:13:33.991383 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb862738-b875-49e4-93be-6704773bf45c admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:34.007246 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb862738-b875-49e4-93be-6704773bf45c admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:34.012317 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d54a22-3b70-49e3-af85-8d71bca1eea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:34.013086 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d54a22-3b70-49e3-af85-8d71bca1eea7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:34.013405 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d54a22-3b70-49e3-af85-8d71bca1eea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:34.014030 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d54a22-3b70-49e3-af85-8d71bca1eea7 admin admin] PATH_INFO: `/v3/projects/374648af0c594ec7a8dc169505e2d6d6/users/266bc96c676144c8bc5e8a8d6ad5bb5e/roles/f157f905c9c94ccfbfb46e52d443e8f2` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:34.032554 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d54a22-3b70-49e3-af85-8d71bca1eea7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=374648af0c594ec7a8dc169505e2d6d6, user_id=266bc96c676144c8bc5e8a8d6ad5bb5e, role_id=f157f905c9c94ccfbfb46e52d443e8f2)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:34.036873 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d54a22-3b70-49e3-af85-8d71bca1eea7 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:34.056550 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1168/2332] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:13:33 2022] PUT /identity/v3/projects/374648af0c594ec7a8dc169505e2d6d6/users/266bc96c676144c8bc5e8a8d6ad5bb5e/roles/f157f905c9c94ccfbfb46e52d443e8f2 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:13:34.069543 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f15b9-3086-4d71-a1a2-1de383e9791f None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:34.069934 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f15b9-3086-4d71-a1a2-1de383e9791f None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:34.070219 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f15b9-3086-4d71-a1a2-1de383e9791f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:34.131187 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-3a6f15b9-3086-4d71-a1a2-1de383e9791f None None] MFA Rules not processed for user `266bc96c676144c8bc5e8a8d6ad5bb5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:34.132545 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-3a6f15b9-3086-4d71-a1a2-1de383e9791f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:34.271318 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1165/2333] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:13:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:13:34.272490 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d54a22-3b70-49e3-af85-8d71bca1eea7 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:34.298002 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:34.387771 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d54a22-3b70-49e3-af85-8d71bca1eea7 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:34.397402 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e062aa49-cf87-4cd9-b9fc-077855fac26f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:34.398348 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e062aa49-cf87-4cd9-b9fc-077855fac26f admin admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:34.398746 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e062aa49-cf87-4cd9-b9fc-077855fac26f admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:34.399064 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e062aa49-cf87-4cd9-b9fc-077855fac26f admin admin] PATH_INFO: `/v3/projects` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:34.399868 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e062aa49-cf87-4cd9-b9fc-077855fac26f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:34.402223 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e062aa49-cf87-4cd9-b9fc-077855fac26f admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:34.437044 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1169/2334] 10.222.0.49 () {60 vars in 1153 bytes} [Thu Sep 29 02:13:34 2022] POST /identity/v3/projects => generated 373 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 29 02:13:34.438250 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6f15b9-3086-4d71-a1a2-1de383e9791f None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:34.451274 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6f15b9-3086-4d71-a1a2-1de383e9791f None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:34.522269 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ebe14d-0b52-42a1-815f-618136feb115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:34.533332 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ebe14d-0b52-42a1-815f-618136feb115 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:34.533332 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ebe14d-0b52-42a1-815f-618136feb115 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:34.533332 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ebe14d-0b52-42a1-815f-618136feb115 admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:34.533332 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ebe14d-0b52-42a1-815f-618136feb115 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:34.533332 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ebe14d-0b52-42a1-815f-618136feb115 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:34.555951 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1166/2335] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 02:13:34 2022] POST /identity/v3/users => generated 293 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 29 02:13:34.557117 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e062aa49-cf87-4cd9-b9fc-077855fac26f admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:34.568804 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e062aa49-cf87-4cd9-b9fc-077855fac26f admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:34.574116 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7d8423-e004-4699-8cfd-4f0a5b0c6f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:34.574740 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d8423-e004-4699-8cfd-4f0a5b0c6f2e admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:34.575069 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d8423-e004-4699-8cfd-4f0a5b0c6f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:34.575515 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d8423-e004-4699-8cfd-4f0a5b0c6f2e admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:34.576148 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7d8423-e004-4699-8cfd-4f0a5b0c6f2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:34.578121 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7d8423-e004-4699-8cfd-4f0a5b0c6f2e admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:34.591099 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1170/2336] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:13:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:13:34.597944 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ebe14d-0b52-42a1-815f-618136feb115 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:34.608137 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ebe14d-0b52-42a1-815f-618136feb115 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:34.613582 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983508aa-2f15-4b26-bd61-0ef7862f0113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:34.614619 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983508aa-2f15-4b26-bd61-0ef7862f0113 admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:34.615179 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983508aa-2f15-4b26-bd61-0ef7862f0113 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:34.615448 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983508aa-2f15-4b26-bd61-0ef7862f0113 admin admin] PATH_INFO: `/v3/projects/795e943e46fd47ea9914d3136be68dda/users/15d128ea46e34a59b0b55883e689115d/roles/fe9bbc67742f4f5893f39b18eb31d59a` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:34.632172 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983508aa-2f15-4b26-bd61-0ef7862f0113 admin admin] RBAC: Authorizing `identity:create_grant(project_id=795e943e46fd47ea9914d3136be68dda, user_id=15d128ea46e34a59b0b55883e689115d, role_id=fe9bbc67742f4f5893f39b18eb31d59a)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:34.634862 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983508aa-2f15-4b26-bd61-0ef7862f0113 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:34.654360 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1167/2337] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:13:34 2022] PUT /identity/v3/projects/795e943e46fd47ea9914d3136be68dda/users/15d128ea46e34a59b0b55883e689115d/roles/fe9bbc67742f4f5893f39b18eb31d59a => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:13:34.658428 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7d8423-e004-4699-8cfd-4f0a5b0c6f2e admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:34.673768 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7d8423-e004-4699-8cfd-4f0a5b0c6f2e admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:34.740485 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0021c9e2-2fd5-4469-8f49-7eac7ce0568e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:34.741105 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0021c9e2-2fd5-4469-8f49-7eac7ce0568e admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:34.741426 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0021c9e2-2fd5-4469-8f49-7eac7ce0568e admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:34.741705 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0021c9e2-2fd5-4469-8f49-7eac7ce0568e admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:34.742348 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0021c9e2-2fd5-4469-8f49-7eac7ce0568e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:34.744261 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0021c9e2-2fd5-4469-8f49-7eac7ce0568e admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:34.759216 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1171/2338] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:13:34 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:13:34.760373 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983508aa-2f15-4b26-bd61-0ef7862f0113 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:34.772117 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983508aa-2f15-4b26-bd61-0ef7862f0113 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:34.777172 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5638d640-0595-4d7c-9ce4-baccb0a3ee67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:34.777938 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5638d640-0595-4d7c-9ce4-baccb0a3ee67 admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:34.778290 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5638d640-0595-4d7c-9ce4-baccb0a3ee67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:34.778667 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5638d640-0595-4d7c-9ce4-baccb0a3ee67 admin admin] PATH_INFO: `/v3/projects/795e943e46fd47ea9914d3136be68dda/users/15d128ea46e34a59b0b55883e689115d/roles/fe9bbc67742f4f5893f39b18eb31d59a` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:34.780868 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5638d640-0595-4d7c-9ce4-baccb0a3ee67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=795e943e46fd47ea9914d3136be68dda, user_id=15d128ea46e34a59b0b55883e689115d, role_id=fe9bbc67742f4f5893f39b18eb31d59a)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:34.783883 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5638d640-0595-4d7c-9ce4-baccb0a3ee67 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:34.797407 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1168/2339] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:13:34 2022] PUT /identity/v3/projects/795e943e46fd47ea9914d3136be68dda/users/15d128ea46e34a59b0b55883e689115d/roles/fe9bbc67742f4f5893f39b18eb31d59a => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:13:34.808039 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef642156-2db5-4d4c-a856-bee4d32f070a None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:34.808327 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef642156-2db5-4d4c-a856-bee4d32f070a None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:34.808593 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef642156-2db5-4d4c-a856-bee4d32f070a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:34.841288 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-ef642156-2db5-4d4c-a856-bee4d32f070a None None] MFA Rules not processed for user `15d128ea46e34a59b0b55883e689115d`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:34.842553 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-ef642156-2db5-4d4c-a856-bee4d32f070a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:34.939764 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1172/2340] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:13:34 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:13:34.952047 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5638d640-0595-4d7c-9ce4-baccb0a3ee67 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:34.954380 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-5638d640-0595-4d7c-9ce4-baccb0a3ee67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:35.007831 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:35.026278 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5638d640-0595-4d7c-9ce4-baccb0a3ee67 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:35.030177 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefd5a7a-fa0e-484d-b14d-39f642d89942 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75135b856134ba4b9ccac337886f682', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:35.036600 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefd5a7a-fa0e-484d-b14d-39f642d89942 service cinder] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:35.037054 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefd5a7a-fa0e-484d-b14d-39f642d89942 service cinder] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:35.037415 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefd5a7a-fa0e-484d-b14d-39f642d89942 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:35.107570 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefd5a7a-fa0e-484d-b14d-39f642d89942 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:35.110643 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefd5a7a-fa0e-484d-b14d-39f642d89942 service cinder] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:35.126180 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1169/2341] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:13:34 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:13:36.933038 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef642156-2db5-4d4c-a856-bee4d32f070a None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:36.935209 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-ef642156-2db5-4d4c-a856-bee4d32f070a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:36.951300 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef642156-2db5-4d4c-a856-bee4d32f070a None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:36.963082 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc312171-6134-4cad-9370-c8563f1f53dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75135b856134ba4b9ccac337886f682', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:36.964761 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc312171-6134-4cad-9370-c8563f1f53dc service cinder] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:36.966090 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc312171-6134-4cad-9370-c8563f1f53dc service cinder] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:36.966587 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc312171-6134-4cad-9370-c8563f1f53dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:36.985211 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:37.104588 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc312171-6134-4cad-9370-c8563f1f53dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:37.110082 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc312171-6134-4cad-9370-c8563f1f53dc service cinder] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:37.124839 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1173/2342] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:13:36 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:13:38.454278 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefd5a7a-fa0e-484d-b14d-39f642d89942 service cinder] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:38.466783 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefd5a7a-fa0e-484d-b14d-39f642d89942 service cinder] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:38.480721 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c3c42d-e750-4c09-aa8b-d7404ca3bae2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75135b856134ba4b9ccac337886f682', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:38.481769 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c3c42d-e750-4c09-aa8b-d7404ca3bae2 service cinder] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:38.482241 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c3c42d-e750-4c09-aa8b-d7404ca3bae2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:38.483061 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c3c42d-e750-4c09-aa8b-d7404ca3bae2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:38.500899 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c3c42d-e750-4c09-aa8b-d7404ca3bae2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:38.503065 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c3c42d-e750-4c09-aa8b-d7404ca3bae2 service cinder] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:38.529889 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1170/2343] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:13:38 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:13:39.199282 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2838da-7915-4e1b-91ee-7bf2ca590bc1 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:39.199772 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2838da-7915-4e1b-91ee-7bf2ca590bc1 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:39.199856 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2838da-7915-4e1b-91ee-7bf2ca590bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:39.239366 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-1b2838da-7915-4e1b-91ee-7bf2ca590bc1 None None] MFA Rules not processed for user `bcd3fa0a082144c3892221602eeeb4d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:39.240582 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-1b2838da-7915-4e1b-91ee-7bf2ca590bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:39.332276 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1174/2344] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:13:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 29 02:13:39.337805 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c3c42d-e750-4c09-aa8b-d7404ca3bae2 service cinder] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:39.419066 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c3c42d-e750-4c09-aa8b-d7404ca3bae2 service cinder] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:39.423746 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74709ae2-bcfc-4dcb-8d94-212761fb24c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:39.424386 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74709ae2-bcfc-4dcb-8d94-212761fb24c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:39.425268 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74709ae2-bcfc-4dcb-8d94-212761fb24c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:39.425636 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74709ae2-bcfc-4dcb-8d94-212761fb24c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:39.426474 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74709ae2-bcfc-4dcb-8d94-212761fb24c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:39.428475 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74709ae2-bcfc-4dcb-8d94-212761fb24c3 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:39.462975 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1171/2345] 10.222.0.49 () {60 vars in 1153 bytes} [Thu Sep 29 02:13:39 2022] POST /identity/v3/projects => generated 383 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:13:39.464584 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2838da-7915-4e1b-91ee-7bf2ca590bc1 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:39.490522 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2838da-7915-4e1b-91ee-7bf2ca590bc1 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:39.572100 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da693a6-5551-4a20-98c4-ad5d9ef56a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:39.572729 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da693a6-5551-4a20-98c4-ad5d9ef56a90 admin admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:39.573008 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da693a6-5551-4a20-98c4-ad5d9ef56a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:39.573282 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da693a6-5551-4a20-98c4-ad5d9ef56a90 admin admin] PATH_INFO: `/v3/users` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:39.573972 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da693a6-5551-4a20-98c4-ad5d9ef56a90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:39.575900 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da693a6-5551-4a20-98c4-ad5d9ef56a90 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:39.598281 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1175/2346] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 02:13:39 2022] POST /identity/v3/users => generated 298 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 29 02:13:39.602549 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74709ae2-bcfc-4dcb-8d94-212761fb24c3 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:39.614814 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74709ae2-bcfc-4dcb-8d94-212761fb24c3 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:39.619938 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2dd08b-bedf-46e2-b95d-de7e5deb0c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:39.620450 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2dd08b-bedf-46e2-b95d-de7e5deb0c4e admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:39.620733 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2dd08b-bedf-46e2-b95d-de7e5deb0c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:39.620980 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2dd08b-bedf-46e2-b95d-de7e5deb0c4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:39.622087 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2dd08b-bedf-46e2-b95d-de7e5deb0c4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:39.623692 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2dd08b-bedf-46e2-b95d-de7e5deb0c4e admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:39.635998 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1172/2347] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:13:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:13:39.640280 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da693a6-5551-4a20-98c4-ad5d9ef56a90 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:39.652505 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da693a6-5551-4a20-98c4-ad5d9ef56a90 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:39.657749 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bb3a01-9431-4cc0-a586-85fedb332db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:39.658436 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bb3a01-9431-4cc0-a586-85fedb332db4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:39.658715 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bb3a01-9431-4cc0-a586-85fedb332db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:39.658985 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bb3a01-9431-4cc0-a586-85fedb332db4 admin admin] PATH_INFO: `/v3/projects/a0f6cd46c1dc4a8db7c523f4baa60fa4/users/f8fe6445d56b4fc18ff2bcdb3abd76a2/roles/fe9bbc67742f4f5893f39b18eb31d59a` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:39.677102 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bb3a01-9431-4cc0-a586-85fedb332db4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0f6cd46c1dc4a8db7c523f4baa60fa4, user_id=f8fe6445d56b4fc18ff2bcdb3abd76a2, role_id=fe9bbc67742f4f5893f39b18eb31d59a)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:39.679730 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bb3a01-9431-4cc0-a586-85fedb332db4 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:39.694970 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1176/2348] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:13:39 2022] PUT /identity/v3/projects/a0f6cd46c1dc4a8db7c523f4baa60fa4/users/f8fe6445d56b4fc18ff2bcdb3abd76a2/roles/fe9bbc67742f4f5893f39b18eb31d59a => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:13:39.699018 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2dd08b-bedf-46e2-b95d-de7e5deb0c4e admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:39.709832 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2dd08b-bedf-46e2-b95d-de7e5deb0c4e admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:39.780015 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:39.792770 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0579bbf1-97fe-4dbf-a569-eca5af8a13a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:39.793776 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0579bbf1-97fe-4dbf-a569-eca5af8a13a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:39.794032 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0579bbf1-97fe-4dbf-a569-eca5af8a13a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:39.794291 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0579bbf1-97fe-4dbf-a569-eca5af8a13a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:39.794931 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0579bbf1-97fe-4dbf-a569-eca5af8a13a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:39.796515 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0579bbf1-97fe-4dbf-a569-eca5af8a13a1 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:39.807409 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1173/2349] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:13:39 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 29 02:13:39.811446 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bb3a01-9431-4cc0-a586-85fedb332db4 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:39.828178 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bb3a01-9431-4cc0-a586-85fedb332db4 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:39.834121 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b403696-9c34-4d6b-b0e6-09e4dbca19d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:39.834995 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b403696-9c34-4d6b-b0e6-09e4dbca19d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:39.835282 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b403696-9c34-4d6b-b0e6-09e4dbca19d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:39.835555 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b403696-9c34-4d6b-b0e6-09e4dbca19d0 admin admin] PATH_INFO: `/v3/projects/a0f6cd46c1dc4a8db7c523f4baa60fa4/users/f8fe6445d56b4fc18ff2bcdb3abd76a2/roles/fe9bbc67742f4f5893f39b18eb31d59a` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:39.837677 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b403696-9c34-4d6b-b0e6-09e4dbca19d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0f6cd46c1dc4a8db7c523f4baa60fa4, user_id=f8fe6445d56b4fc18ff2bcdb3abd76a2, role_id=fe9bbc67742f4f5893f39b18eb31d59a)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:39.840312 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b403696-9c34-4d6b-b0e6-09e4dbca19d0 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:39.843959 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:39.855382 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1177/2350] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:13:39 2022] PUT /identity/v3/projects/a0f6cd46c1dc4a8db7c523f4baa60fa4/users/f8fe6445d56b4fc18ff2bcdb3abd76a2/roles/fe9bbc67742f4f5893f39b18eb31d59a => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:13:42.883587 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0579bbf1-97fe-4dbf-a569-eca5af8a13a1 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:42.885648 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-0579bbf1-97fe-4dbf-a569-eca5af8a13a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:42.894788 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b403696-9c34-4d6b-b0e6-09e4dbca19d0 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:42.907849 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0579bbf1-97fe-4dbf-a569-eca5af8a13a1 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:43.011415 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b403696-9c34-4d6b-b0e6-09e4dbca19d0 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:43.018620 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a982d357-b878-4266-a1ae-29dcf9034478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:43.021119 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a982d357-b878-4266-a1ae-29dcf9034478 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:43.021850 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a982d357-b878-4266-a1ae-29dcf9034478 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:43.022439 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a982d357-b878-4266-a1ae-29dcf9034478 admin admin] PATH_INFO: `/v3/users/3553670b2175477db3f63f1558380b59` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:43.025877 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a982d357-b878-4266-a1ae-29dcf9034478 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3553670b2175477db3f63f1558380b59)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:43.027941 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a982d357-b878-4266-a1ae-29dcf9034478 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:43.032177 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda80828-ee92-4a61-986c-debf8349b252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:43.033601 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda80828-ee92-4a61-986c-debf8349b252 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:43.034271 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda80828-ee92-4a61-986c-debf8349b252 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:43.034707 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda80828-ee92-4a61-986c-debf8349b252 admin admin] PATH_INFO: `/v3/users/63fedcb68c144caa893d245a8333b65e` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:43.037114 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda80828-ee92-4a61-986c-debf8349b252 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63fedcb68c144caa893d245a8333b65e)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:43.043210 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda80828-ee92-4a61-986c-debf8349b252 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:43.126942 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-a982d357-b878-4266-a1ae-29dcf9034478 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3553670b2175477db3f63f1558380b59'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:43.128071 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-a982d357-b878-4266-a1ae-29dcf9034478 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3553670b2175477db3f63f1558380b59'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:43.136453 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-cda80828-ee92-4a61-986c-debf8349b252 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63fedcb68c144caa893d245a8333b65e'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:43.137141 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-cda80828-ee92-4a61-986c-debf8349b252 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63fedcb68c144caa893d245a8333b65e'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:43.146864 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-a982d357-b878-4266-a1ae-29dcf9034478 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3553670b2175477db3f63f1558380b59'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:43.158561 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-cda80828-ee92-4a61-986c-debf8349b252 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63fedcb68c144caa893d245a8333b65e'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:43.162549 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-a982d357-b878-4266-a1ae-29dcf9034478 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3553670b2175477db3f63f1558380b59'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:43.163479 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-a982d357-b878-4266-a1ae-29dcf9034478 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3553670b2175477db3f63f1558380b59'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:43.189980 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-cda80828-ee92-4a61-986c-debf8349b252 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63fedcb68c144caa893d245a8333b65e'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:43.191260 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-cda80828-ee92-4a61-986c-debf8349b252 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63fedcb68c144caa893d245a8333b65e'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:43.199132 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1178/2351] 10.222.0.49 () {58 vars in 1224 bytes} [Thu Sep 29 02:13:42 2022] DELETE /identity/v3/users/3553670b2175477db3f63f1558380b59 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:13:43.203536 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb1c7c1-efbb-4b96-a3d2-8572bc8f203b None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:43.204121 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb1c7c1-efbb-4b96-a3d2-8572bc8f203b None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:43.204612 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb1c7c1-efbb-4b96-a3d2-8572bc8f203b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:43.230517 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1174/2352] 10.222.0.49 () {58 vars in 1224 bytes} [Thu Sep 29 02:13:42 2022] DELETE /identity/v3/users/63fedcb68c144caa893d245a8333b65e => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:13:43.237489 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85698967-bf08-49c5-a222-9df948754288 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:43.238919 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85698967-bf08-49c5-a222-9df948754288 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:43.239213 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85698967-bf08-49c5-a222-9df948754288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:43.254843 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-5cb1c7c1-efbb-4b96-a3d2-8572bc8f203b None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:43.256269 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-5cb1c7c1-efbb-4b96-a3d2-8572bc8f203b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:43.288930 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-85698967-bf08-49c5-a222-9df948754288 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:43.292756 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-85698967-bf08-49c5-a222-9df948754288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:43.350855 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1179/2353] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:13:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 29 02:13:43.365197 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb1c7c1-efbb-4b96-a3d2-8572bc8f203b None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:43.372057 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-5cb1c7c1-efbb-4b96-a3d2-8572bc8f203b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:43.422319 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:43.452842 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1175/2354] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:13:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 29 02:13:43.468808 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85698967-bf08-49c5-a222-9df948754288 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:43.473291 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-85698967-bf08-49c5-a222-9df948754288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:43.508542 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb1c7c1-efbb-4b96-a3d2-8572bc8f203b None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:43.517903 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e18c50-d9bf-456d-8d17-688b99901df5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:43.519021 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e18c50-d9bf-456d-8d17-688b99901df5 service neutron] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:43.519301 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e18c50-d9bf-456d-8d17-688b99901df5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:43.519573 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e18c50-d9bf-456d-8d17-688b99901df5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:43.548272 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e18c50-d9bf-456d-8d17-688b99901df5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:43.548644 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:43.549854 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e18c50-d9bf-456d-8d17-688b99901df5 service neutron] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:43.573476 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1180/2355] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:13:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:13:43.648010 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85698967-bf08-49c5-a222-9df948754288 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:43.664893 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ae7ee4-e680-45c2-825a-24ce4297b152 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:43.665670 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ae7ee4-e680-45c2-825a-24ce4297b152 service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:43.665964 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ae7ee4-e680-45c2-825a-24ce4297b152 service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:43.667815 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ae7ee4-e680-45c2-825a-24ce4297b152 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:43.693900 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ae7ee4-e680-45c2-825a-24ce4297b152 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:43.696140 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ae7ee4-e680-45c2-825a-24ce4297b152 service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:43.721615 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1176/2356] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:13:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:13:44.444818 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e18c50-d9bf-456d-8d17-688b99901df5 service neutron] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:44.447053 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-23e18c50-d9bf-456d-8d17-688b99901df5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:44.475445 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e18c50-d9bf-456d-8d17-688b99901df5 service neutron] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:44.490181 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34577a8-3d7f-4ab5-950f-ac4e80534eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:44.492181 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34577a8-3d7f-4ab5-950f-ac4e80534eea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:44.493987 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34577a8-3d7f-4ab5-950f-ac4e80534eea admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:44.494944 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34577a8-3d7f-4ab5-950f-ac4e80534eea admin admin] PATH_INFO: `/v3/projects/38989274c7054da59394b0bdf3099e41` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:44.498567 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34577a8-3d7f-4ab5-950f-ac4e80534eea admin admin] RBAC: Authorizing `identity:delete_project(project_id=38989274c7054da59394b0bdf3099e41)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:44.501778 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34577a8-3d7f-4ab5-950f-ac4e80534eea admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:44.600113 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-e34577a8-3d7f-4ab5-950f-ac4e80534eea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38989274c7054da59394b0bdf3099e41', 'request_id': 'req-e34577a8-3d7f-4ab5-950f-ac4e80534eea'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:44.617577 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ae7ee4-e680-45c2-825a-24ce4297b152 service neutron] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:44.619510 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-d1ae7ee4-e680-45c2-825a-24ce4297b152 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:44.631576 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-e34577a8-3d7f-4ab5-950f-ac4e80534eea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38989274c7054da59394b0bdf3099e41', 'request_id': 'req-e34577a8-3d7f-4ab5-950f-ac4e80534eea'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:44.637458 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ae7ee4-e680-45c2-825a-24ce4297b152 service neutron] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:44.650623 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-e34577a8-3d7f-4ab5-950f-ac4e80534eea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38989274c7054da59394b0bdf3099e41', 'request_id': 'req-e34577a8-3d7f-4ab5-950f-ac4e80534eea'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:44.677918 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-e34577a8-3d7f-4ab5-950f-ac4e80534eea admin admin] The token cache is being invalidate because project 38989274c7054da59394b0bdf3099e41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81648) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:13:44.678240 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-e34577a8-3d7f-4ab5-950f-ac4e80534eea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:44.680004 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-e34577a8-3d7f-4ab5-950f-ac4e80534eea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:44.681918 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1181/2357] 10.222.0.49 () {58 vars in 1233 bytes} [Thu Sep 29 02:13:44 2022] DELETE /identity/v3/projects/38989274c7054da59394b0bdf3099e41 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:13:44.684838 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea90d0ad-bf0a-4f91-a1c4-214716b52812 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:44.684838 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea90d0ad-bf0a-4f91-a1c4-214716b52812 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:44.684838 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea90d0ad-bf0a-4f91-a1c4-214716b52812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:44.728955 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-ea90d0ad-bf0a-4f91-a1c4-214716b52812 None None] MFA Rules not processed for user `5e482260d1d840b4821122a7896c0a2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:44.730235 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-ea90d0ad-bf0a-4f91-a1c4-214716b52812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:44.757045 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2524a79f-d98a-45d6-b734-2df56859fc18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:44.758122 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2524a79f-d98a-45d6-b734-2df56859fc18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:44.758616 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2524a79f-d98a-45d6-b734-2df56859fc18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:44.759251 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2524a79f-d98a-45d6-b734-2df56859fc18 admin admin] PATH_INFO: `/v3/projects/70b714875efb4ea59ec67ea8b515361f` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:44.760903 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2524a79f-d98a-45d6-b734-2df56859fc18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70b714875efb4ea59ec67ea8b515361f)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:44.763570 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2524a79f-d98a-45d6-b734-2df56859fc18 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:44.834458 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-2524a79f-d98a-45d6-b734-2df56859fc18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70b714875efb4ea59ec67ea8b515361f', 'request_id': 'req-2524a79f-d98a-45d6-b734-2df56859fc18'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:44.842608 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-2524a79f-d98a-45d6-b734-2df56859fc18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70b714875efb4ea59ec67ea8b515361f', 'request_id': 'req-2524a79f-d98a-45d6-b734-2df56859fc18'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:44.844286 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1182/2358] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:13:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:13:44.849562 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea90d0ad-bf0a-4f91-a1c4-214716b52812 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:44.851465 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-ea90d0ad-bf0a-4f91-a1c4-214716b52812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:44.874462 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-2524a79f-d98a-45d6-b734-2df56859fc18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70b714875efb4ea59ec67ea8b515361f', 'request_id': 'req-2524a79f-d98a-45d6-b734-2df56859fc18'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:44.883439 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea90d0ad-bf0a-4f91-a1c4-214716b52812 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:44.895108 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-2524a79f-d98a-45d6-b734-2df56859fc18 admin admin] The token cache is being invalidate because project 70b714875efb4ea59ec67ea8b515361f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81649) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:13:44.897830 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-2524a79f-d98a-45d6-b734-2df56859fc18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:44.898645 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-2524a79f-d98a-45d6-b734-2df56859fc18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:44.902379 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1177/2359] 10.222.0.49 () {58 vars in 1233 bytes} [Thu Sep 29 02:13:44 2022] DELETE /identity/v3/projects/70b714875efb4ea59ec67ea8b515361f => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:13:44.918039 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147cc977-f152-4654-aa04-9f7e53acd5f8 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:44.922988 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147cc977-f152-4654-aa04-9f7e53acd5f8 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:44.923780 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147cc977-f152-4654-aa04-9f7e53acd5f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:44.988968 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:44.989194 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-147cc977-f152-4654-aa04-9f7e53acd5f8 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:44.991486 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-147cc977-f152-4654-aa04-9f7e53acd5f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:45.014545 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faab9c4-3bbd-408d-9322-88198397c83c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:45.014780 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faab9c4-3bbd-408d-9322-88198397c83c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:45.014989 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faab9c4-3bbd-408d-9322-88198397c83c admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:45.017118 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faab9c4-3bbd-408d-9322-88198397c83c admin admin] PATH_INFO: `/v3/users/266bc96c676144c8bc5e8a8d6ad5bb5e` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:45.022001 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faab9c4-3bbd-408d-9322-88198397c83c admin admin] RBAC: Authorizing `identity:delete_user(user_id=266bc96c676144c8bc5e8a8d6ad5bb5e)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:45.024813 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faab9c4-3bbd-408d-9322-88198397c83c admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:45.084685 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:45.133025 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-6faab9c4-3bbd-408d-9322-88198397c83c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '266bc96c676144c8bc5e8a8d6ad5bb5e'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:45.134926 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-6faab9c4-3bbd-408d-9322-88198397c83c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '266bc96c676144c8bc5e8a8d6ad5bb5e'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:45.142049 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1178/2360] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:13:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:13:45.150828 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a155d-29af-488e-818d-5911d4bea548 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:45.151119 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a155d-29af-488e-818d-5911d4bea548 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:45.151370 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a155d-29af-488e-818d-5911d4bea548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:45.162354 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-6faab9c4-3bbd-408d-9322-88198397c83c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '266bc96c676144c8bc5e8a8d6ad5bb5e'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:45.178768 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-6faab9c4-3bbd-408d-9322-88198397c83c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '266bc96c676144c8bc5e8a8d6ad5bb5e'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:45.179770 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-6faab9c4-3bbd-408d-9322-88198397c83c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '266bc96c676144c8bc5e8a8d6ad5bb5e'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:45.181019 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-8f2a155d-29af-488e-818d-5911d4bea548 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:45.182985 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-8f2a155d-29af-488e-818d-5911d4bea548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:45.195384 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1179/2361] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:13:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:13:45.199292 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2a155d-29af-488e-818d-5911d4bea548 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:45.199889 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1183/2362] 10.222.0.49 () {58 vars in 1224 bytes} [Thu Sep 29 02:13:44 2022] DELETE /identity/v3/users/266bc96c676144c8bc5e8a8d6ad5bb5e => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:13:45.220078 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2a155d-29af-488e-818d-5911d4bea548 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:45.347001 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4224292-9e76-454a-b681-e40a9ab10a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:45.347863 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4224292-9e76-454a-b681-e40a9ab10a93 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:45.348288 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4224292-9e76-454a-b681-e40a9ab10a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:45.348841 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4224292-9e76-454a-b681-e40a9ab10a93 admin admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:45.354864 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4224292-9e76-454a-b681-e40a9ab10a93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:13:45.355578 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4224292-9e76-454a-b681-e40a9ab10a93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:45.358543 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4224292-9e76-454a-b681-e40a9ab10a93 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:45.396024 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1180/2363] 10.222.0.49 () {58 vars in 1153 bytes} [Thu Sep 29 02:13:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 02:13:45.396994 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faab9c4-3bbd-408d-9322-88198397c83c admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:45.416134 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faab9c4-3bbd-408d-9322-88198397c83c admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:45.424051 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237b073f-7d4e-4192-9c7b-4c07ca049133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:45.425039 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237b073f-7d4e-4192-9c7b-4c07ca049133 admin admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:45.425337 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237b073f-7d4e-4192-9c7b-4c07ca049133 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:45.425612 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237b073f-7d4e-4192-9c7b-4c07ca049133 admin admin] PATH_INFO: `/v3/projects` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:45.426257 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237b073f-7d4e-4192-9c7b-4c07ca049133 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:45.428174 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237b073f-7d4e-4192-9c7b-4c07ca049133 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:45.484196 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1184/2364] 10.222.0.49 () {60 vars in 1153 bytes} [Thu Sep 29 02:13:45 2022] POST /identity/v3/projects => generated 389 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:13:45.485532 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4224292-9e76-454a-b681-e40a9ab10a93 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:45.499441 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4224292-9e76-454a-b681-e40a9ab10a93 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:45.589100 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc14658-28e6-45e4-b9c9-890ba3200643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:45.589702 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc14658-28e6-45e4-b9c9-890ba3200643 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:45.589981 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc14658-28e6-45e4-b9c9-890ba3200643 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:45.590651 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc14658-28e6-45e4-b9c9-890ba3200643 admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:45.590934 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc14658-28e6-45e4-b9c9-890ba3200643 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:45.593195 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc14658-28e6-45e4-b9c9-890ba3200643 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:45.641744 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1181/2365] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 02:13:45 2022] POST /identity/v3/users => generated 295 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:13:45.647108 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237b073f-7d4e-4192-9c7b-4c07ca049133 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:45.667984 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237b073f-7d4e-4192-9c7b-4c07ca049133 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:45.676966 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a585fa-1649-498b-960c-df78bbd3d862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:45.678588 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a585fa-1649-498b-960c-df78bbd3d862 admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:45.679130 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a585fa-1649-498b-960c-df78bbd3d862 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:45.679626 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a585fa-1649-498b-960c-df78bbd3d862 admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:45.680536 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a585fa-1649-498b-960c-df78bbd3d862 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:45.682527 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a585fa-1649-498b-960c-df78bbd3d862 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:45.698563 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1185/2366] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:13:45 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:13:45.702653 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc14658-28e6-45e4-b9c9-890ba3200643 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:45.715620 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc14658-28e6-45e4-b9c9-890ba3200643 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:45.721185 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7552ebd9-d6a1-4912-a40f-f152f43d9428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:45.722742 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7552ebd9-d6a1-4912-a40f-f152f43d9428 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:45.723198 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7552ebd9-d6a1-4912-a40f-f152f43d9428 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:45.724014 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7552ebd9-d6a1-4912-a40f-f152f43d9428 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:45.724273 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7552ebd9-d6a1-4912-a40f-f152f43d9428 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:45.726093 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7552ebd9-d6a1-4912-a40f-f152f43d9428 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:45.738005 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1182/2367] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:13:45 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 29 02:13:45.742367 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a585fa-1649-498b-960c-df78bbd3d862 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:45.758970 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a585fa-1649-498b-960c-df78bbd3d862 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:45.770995 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb87142-2ebe-444f-8699-558b9dfffcda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:45.772015 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb87142-2ebe-444f-8699-558b9dfffcda admin admin] REQUEST_METHOD: `PUT` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:45.772304 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb87142-2ebe-444f-8699-558b9dfffcda admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:45.772678 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb87142-2ebe-444f-8699-558b9dfffcda admin admin] PATH_INFO: `/v3/projects/8f65987ae0c7490ebc13e30228347f8d/users/4b31d206367b4c5c8c0fb0f8b56dcab2/roles/f157f905c9c94ccfbfb46e52d443e8f2` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:45.797592 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb87142-2ebe-444f-8699-558b9dfffcda admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f65987ae0c7490ebc13e30228347f8d, user_id=4b31d206367b4c5c8c0fb0f8b56dcab2, role_id=f157f905c9c94ccfbfb46e52d443e8f2)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:45.801826 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb87142-2ebe-444f-8699-558b9dfffcda admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:45.820597 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1186/2368] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:13:45 2022] PUT /identity/v3/projects/8f65987ae0c7490ebc13e30228347f8d/users/4b31d206367b4c5c8c0fb0f8b56dcab2/roles/f157f905c9c94ccfbfb46e52d443e8f2 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:13:45.832023 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daeac36-b540-4ff7-a10e-7b8862b5e9b5 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:45.832381 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daeac36-b540-4ff7-a10e-7b8862b5e9b5 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:45.832569 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daeac36-b540-4ff7-a10e-7b8862b5e9b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:45.864002 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-4daeac36-b540-4ff7-a10e-7b8862b5e9b5 None None] MFA Rules not processed for user `4b31d206367b4c5c8c0fb0f8b56dcab2`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:45.865374 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-4daeac36-b540-4ff7-a10e-7b8862b5e9b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:45.921820 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:45.957929 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1183/2369] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:13:45 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:13:45.965415 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb87142-2ebe-444f-8699-558b9dfffcda admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:45.967803 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-9cb87142-2ebe-444f-8699-558b9dfffcda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:46.040210 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb87142-2ebe-444f-8699-558b9dfffcda admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:46.045276 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14a26f6-d06d-4808-9206-ebfe9823c36d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75135b856134ba4b9ccac337886f682', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:46.045936 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14a26f6-d06d-4808-9206-ebfe9823c36d service cinder] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:46.048095 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14a26f6-d06d-4808-9206-ebfe9823c36d service cinder] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:46.048095 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14a26f6-d06d-4808-9206-ebfe9823c36d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:46.058370 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14a26f6-d06d-4808-9206-ebfe9823c36d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:46.059989 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14a26f6-d06d-4808-9206-ebfe9823c36d service cinder] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:46.072306 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1187/2370] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:13:45 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 29 02:13:46.329871 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daeac36-b540-4ff7-a10e-7b8862b5e9b5 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:46.331841 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-4daeac36-b540-4ff7-a10e-7b8862b5e9b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:46.502144 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daeac36-b540-4ff7-a10e-7b8862b5e9b5 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:46.528810 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9800e8dc-ff55-4a46-8a75-62f9ad8552d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:46.529497 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9800e8dc-ff55-4a46-8a75-62f9ad8552d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:46.529791 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9800e8dc-ff55-4a46-8a75-62f9ad8552d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:46.530044 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9800e8dc-ff55-4a46-8a75-62f9ad8552d6 admin admin] PATH_INFO: `/v3/projects/374648af0c594ec7a8dc169505e2d6d6` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:46.534096 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9800e8dc-ff55-4a46-8a75-62f9ad8552d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=374648af0c594ec7a8dc169505e2d6d6)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:46.536246 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9800e8dc-ff55-4a46-8a75-62f9ad8552d6 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:46.728710 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-9800e8dc-ff55-4a46-8a75-62f9ad8552d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '374648af0c594ec7a8dc169505e2d6d6', 'request_id': 'req-9800e8dc-ff55-4a46-8a75-62f9ad8552d6'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:46.737134 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-9800e8dc-ff55-4a46-8a75-62f9ad8552d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '374648af0c594ec7a8dc169505e2d6d6', 'request_id': 'req-9800e8dc-ff55-4a46-8a75-62f9ad8552d6'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:46.758912 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-9800e8dc-ff55-4a46-8a75-62f9ad8552d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '374648af0c594ec7a8dc169505e2d6d6', 'request_id': 'req-9800e8dc-ff55-4a46-8a75-62f9ad8552d6'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:46.789125 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-9800e8dc-ff55-4a46-8a75-62f9ad8552d6 admin admin] The token cache is being invalidate because project 374648af0c594ec7a8dc169505e2d6d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81649) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:13:46.789683 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-9800e8dc-ff55-4a46-8a75-62f9ad8552d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:46.790922 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-9800e8dc-ff55-4a46-8a75-62f9ad8552d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:46.793157 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1184/2371] 10.222.0.49 () {58 vars in 1233 bytes} [Thu Sep 29 02:13:46 2022] DELETE /identity/v3/projects/374648af0c594ec7a8dc169505e2d6d6 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:13:46.798044 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14a26f6-d06d-4808-9206-ebfe9823c36d service cinder] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:46.846190 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14a26f6-d06d-4808-9206-ebfe9823c36d service cinder] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:46.852720 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:46.939050 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180a4fdf-88aa-4d66-b324-6884f25b6519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:46.939943 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180a4fdf-88aa-4d66-b324-6884f25b6519 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:46.940231 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180a4fdf-88aa-4d66-b324-6884f25b6519 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:46.940569 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180a4fdf-88aa-4d66-b324-6884f25b6519 admin admin] PATH_INFO: `/v3/users/15d128ea46e34a59b0b55883e689115d` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:46.941847 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180a4fdf-88aa-4d66-b324-6884f25b6519 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15d128ea46e34a59b0b55883e689115d)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:46.943840 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180a4fdf-88aa-4d66-b324-6884f25b6519 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:47.068395 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-180a4fdf-88aa-4d66-b324-6884f25b6519 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15d128ea46e34a59b0b55883e689115d'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:47.069260 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-180a4fdf-88aa-4d66-b324-6884f25b6519 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15d128ea46e34a59b0b55883e689115d'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:47.115202 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-180a4fdf-88aa-4d66-b324-6884f25b6519 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15d128ea46e34a59b0b55883e689115d'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:47.124498 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-180a4fdf-88aa-4d66-b324-6884f25b6519 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15d128ea46e34a59b0b55883e689115d'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:47.125339 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-180a4fdf-88aa-4d66-b324-6884f25b6519 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15d128ea46e34a59b0b55883e689115d'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:47.141823 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1188/2372] 10.222.0.49 () {58 vars in 1224 bytes} [Thu Sep 29 02:13:46 2022] DELETE /identity/v3/users/15d128ea46e34a59b0b55883e689115d => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:13:47.731768 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9800e8dc-ff55-4a46-8a75-62f9ad8552d6 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:47.734109 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-9800e8dc-ff55-4a46-8a75-62f9ad8552d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:47.768246 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9800e8dc-ff55-4a46-8a75-62f9ad8552d6 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:47.924195 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff63bc4-3563-4e6d-a4ab-e6873c435387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:47.925393 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff63bc4-3563-4e6d-a4ab-e6873c435387 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:47.925672 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff63bc4-3563-4e6d-a4ab-e6873c435387 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:47.929075 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff63bc4-3563-4e6d-a4ab-e6873c435387 admin admin] PATH_INFO: `/v3/projects/795e943e46fd47ea9914d3136be68dda` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:47.933614 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff63bc4-3563-4e6d-a4ab-e6873c435387 admin admin] RBAC: Authorizing `identity:delete_project(project_id=795e943e46fd47ea9914d3136be68dda)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:47.936552 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff63bc4-3563-4e6d-a4ab-e6873c435387 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:47.962098 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:48.016227 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-7ff63bc4-3563-4e6d-a4ab-e6873c435387 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '795e943e46fd47ea9914d3136be68dda', 'request_id': 'req-7ff63bc4-3563-4e6d-a4ab-e6873c435387'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:48.023737 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-7ff63bc4-3563-4e6d-a4ab-e6873c435387 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '795e943e46fd47ea9914d3136be68dda', 'request_id': 'req-7ff63bc4-3563-4e6d-a4ab-e6873c435387'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:48.043172 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-7ff63bc4-3563-4e6d-a4ab-e6873c435387 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '795e943e46fd47ea9914d3136be68dda', 'request_id': 'req-7ff63bc4-3563-4e6d-a4ab-e6873c435387'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:48.056839 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-7ff63bc4-3563-4e6d-a4ab-e6873c435387 admin admin] The token cache is being invalidate because project 795e943e46fd47ea9914d3136be68dda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81649) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:13:48.057425 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-7ff63bc4-3563-4e6d-a4ab-e6873c435387 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:48.058438 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-7ff63bc4-3563-4e6d-a4ab-e6873c435387 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:48.060273 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1185/2373] 10.222.0.49 () {58 vars in 1233 bytes} [Thu Sep 29 02:13:47 2022] DELETE /identity/v3/projects/795e943e46fd47ea9914d3136be68dda => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:13:48.066202 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4206c8-cb0f-4ce4-bdfe-0ac97edd8b5a None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:48.067756 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4206c8-cb0f-4ce4-bdfe-0ac97edd8b5a None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:48.069119 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4206c8-cb0f-4ce4-bdfe-0ac97edd8b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:48.095089 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-bc4206c8-cb0f-4ce4-bdfe-0ac97edd8b5a None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:48.097063 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-bc4206c8-cb0f-4ce4-bdfe-0ac97edd8b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:48.189283 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1189/2374] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:13:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:13:48.191955 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeed946-4300-4373-9a69-9a4622ba31b1 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:48.192593 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeed946-4300-4373-9a69-9a4622ba31b1 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:48.192944 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeed946-4300-4373-9a69-9a4622ba31b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:48.199326 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbad20e1-cbd4-4d7c-a7c9-07b268880bf5 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:48.201658 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbad20e1-cbd4-4d7c-a7c9-07b268880bf5 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:48.203757 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbad20e1-cbd4-4d7c-a7c9-07b268880bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:48.218334 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-4aeed946-4300-4373-9a69-9a4622ba31b1 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:48.219469 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-4aeed946-4300-4373-9a69-9a4622ba31b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:48.228555 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1186/2375] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:13:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:13:48.232304 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeed946-4300-4373-9a69-9a4622ba31b1 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:48.242049 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeed946-4300-4373-9a69-9a4622ba31b1 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:48.244441 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-cbad20e1-cbd4-4d7c-a7c9-07b268880bf5 None None] MFA Rules not processed for user `f8fe6445d56b4fc18ff2bcdb3abd76a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:48.245778 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-cbad20e1-cbd4-4d7c-a7c9-07b268880bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:48.247208 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5be59b-fb0f-4a08-b7c4-63fa2215926c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:48.247960 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5be59b-fb0f-4a08-b7c4-63fa2215926c admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:48.248240 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5be59b-fb0f-4a08-b7c4-63fa2215926c admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:48.248507 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5be59b-fb0f-4a08-b7c4-63fa2215926c admin admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:48.249147 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5be59b-fb0f-4a08-b7c4-63fa2215926c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:13:48.249513 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5be59b-fb0f-4a08-b7c4-63fa2215926c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:48.251562 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5be59b-fb0f-4a08-b7c4-63fa2215926c admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:48.269495 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:48.270334 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1187/2376] 10.222.0.49 () {58 vars in 1153 bytes} [Thu Sep 29 02:13:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:13:48.272880 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5be59b-fb0f-4a08-b7c4-63fa2215926c admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:48.286147 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5be59b-fb0f-4a08-b7c4-63fa2215926c admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:48.292139 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60756fc2-2e69-477b-a4f6-e93306f9835a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:48.293026 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60756fc2-2e69-477b-a4f6-e93306f9835a admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:48.293300 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60756fc2-2e69-477b-a4f6-e93306f9835a admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:48.293599 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60756fc2-2e69-477b-a4f6-e93306f9835a admin admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:48.294244 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60756fc2-2e69-477b-a4f6-e93306f9835a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:48.296270 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60756fc2-2e69-477b-a4f6-e93306f9835a admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:48.337804 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1188/2377] 10.222.0.49 () {60 vars in 1153 bytes} [Thu Sep 29 02:13:48 2022] POST /identity/v3/projects => generated 367 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:13:48.341377 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60756fc2-2e69-477b-a4f6-e93306f9835a admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:48.346838 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1190/2378] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:13:48 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:13:48.359381 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbad20e1-cbd4-4d7c-a7c9-07b268880bf5 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:48.360981 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-cbad20e1-cbd4-4d7c-a7c9-07b268880bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:48.429960 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60756fc2-2e69-477b-a4f6-e93306f9835a admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:48.434843 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f086b00-2e3d-41c0-b7df-495aa066af9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:48.435609 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f086b00-2e3d-41c0-b7df-495aa066af9c admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:48.435981 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f086b00-2e3d-41c0-b7df-495aa066af9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:48.436317 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f086b00-2e3d-41c0-b7df-495aa066af9c admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:48.437009 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f086b00-2e3d-41c0-b7df-495aa066af9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:48.439039 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f086b00-2e3d-41c0-b7df-495aa066af9c admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:48.439185 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbad20e1-cbd4-4d7c-a7c9-07b268880bf5 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:48.470802 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1189/2379] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 02:13:48 2022] POST /identity/v3/users => generated 284 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:13:48.475529 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f086b00-2e3d-41c0-b7df-495aa066af9c admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:48.488002 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f086b00-2e3d-41c0-b7df-495aa066af9c admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:48.493147 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463228e6-a78a-484c-8657-0901055d9099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:48.493797 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463228e6-a78a-484c-8657-0901055d9099 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:48.494085 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463228e6-a78a-484c-8657-0901055d9099 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:48.494361 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463228e6-a78a-484c-8657-0901055d9099 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:48.495017 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463228e6-a78a-484c-8657-0901055d9099 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:48.496621 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463228e6-a78a-484c-8657-0901055d9099 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:48.502079 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4b3ba7-d9f2-4e0d-875e-58cada995d2f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d36669146554031ba8596cb583cd6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:48.503301 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4b3ba7-d9f2-4e0d-875e-58cada995d2f service glance] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:48.503572 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4b3ba7-d9f2-4e0d-875e-58cada995d2f service glance] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:48.503834 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4b3ba7-d9f2-4e0d-875e-58cada995d2f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:48.505591 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-ef4b3ba7-d9f2-4e0d-875e-58cada995d2f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:48.508347 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1190/2380] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:13:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 29 02:13:48.512471 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463228e6-a78a-484c-8657-0901055d9099 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:48.522956 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463228e6-a78a-484c-8657-0901055d9099 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:48.528701 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc64992-7817-476a-9964-2279b3839814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:48.529631 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc64992-7817-476a-9964-2279b3839814 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:48.529913 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc64992-7817-476a-9964-2279b3839814 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:48.530203 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc64992-7817-476a-9964-2279b3839814 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:48.530826 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc64992-7817-476a-9964-2279b3839814 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:48.532659 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc64992-7817-476a-9964-2279b3839814 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:48.549527 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1191/2381] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:13:48 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 29 02:13:48.550827 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc64992-7817-476a-9964-2279b3839814 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:48.562895 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc64992-7817-476a-9964-2279b3839814 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:48.569928 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6fdf71-319d-4b91-b664-8faffdd8bf2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:48.570922 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6fdf71-319d-4b91-b664-8faffdd8bf2d admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:48.571297 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6fdf71-319d-4b91-b664-8faffdd8bf2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:48.571749 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6fdf71-319d-4b91-b664-8faffdd8bf2d admin admin] PATH_INFO: `/v3/projects/63b4129bf8494d19b14e595d741e0343/users/bc27c94b30854959b3bb7191f781b67e/roles/f157f905c9c94ccfbfb46e52d443e8f2` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:48.576144 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4b3ba7-d9f2-4e0d-875e-58cada995d2f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:48.577770 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4b3ba7-d9f2-4e0d-875e-58cada995d2f service glance] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:48.588694 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1191/2382] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:13:48 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 29 02:13:48.591839 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6fdf71-319d-4b91-b664-8faffdd8bf2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=63b4129bf8494d19b14e595d741e0343, user_id=bc27c94b30854959b3bb7191f781b67e, role_id=f157f905c9c94ccfbfb46e52d443e8f2)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:48.594725 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6fdf71-319d-4b91-b664-8faffdd8bf2d admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:48.608682 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1192/2383] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:13:48 2022] PUT /identity/v3/projects/63b4129bf8494d19b14e595d741e0343/users/bc27c94b30854959b3bb7191f781b67e/roles/f157f905c9c94ccfbfb46e52d443e8f2 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:13:48.620820 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87feef00-f5ad-4875-852f-946787a9f90e None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:48.621219 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87feef00-f5ad-4875-852f-946787a9f90e None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:48.621537 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87feef00-f5ad-4875-852f-946787a9f90e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:48.655665 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-87feef00-f5ad-4875-852f-946787a9f90e None None] MFA Rules not processed for user `bc27c94b30854959b3bb7191f781b67e`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:48.656024 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-87feef00-f5ad-4875-852f-946787a9f90e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:48.673021 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:48.734052 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1192/2384] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:13:48 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:13:48.747244 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6fdf71-319d-4b91-b664-8faffdd8bf2d admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:48.749845 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49a3715-cb81-4392-a07a-4747fbf04f4d None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:48.750140 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49a3715-cb81-4392-a07a-4747fbf04f4d None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:48.750418 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49a3715-cb81-4392-a07a-4747fbf04f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:48.754372 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:INSERT=6 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:48.778599 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-d49a3715-cb81-4392-a07a-4747fbf04f4d None None] MFA Rules not processed for user `0f8f13f302de4701a7f4e0562bca08cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:48.780166 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-d49a3715-cb81-4392-a07a-4747fbf04f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:48.839049 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6fdf71-319d-4b91-b664-8faffdd8bf2d admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:48.843829 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9293944a-4eeb-4f2d-a10e-048c3e90e2b5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d36669146554031ba8596cb583cd6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:48.844588 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9293944a-4eeb-4f2d-a10e-048c3e90e2b5 service glance] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:48.844973 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9293944a-4eeb-4f2d-a10e-048c3e90e2b5 service glance] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:48.845609 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9293944a-4eeb-4f2d-a10e-048c3e90e2b5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:48.874593 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9293944a-4eeb-4f2d-a10e-048c3e90e2b5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:48.876289 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9293944a-4eeb-4f2d-a10e-048c3e90e2b5 service glance] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:48.888384 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1193/2385] 10.222.0.49 () {58 vars in 1009 bytes} [Thu Sep 29 02:13:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:13:48.892526 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1193/2386] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:13:48 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:13:48.902269 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49a3715-cb81-4392-a07a-4747fbf04f4d None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:48.910168 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-d49a3715-cb81-4392-a07a-4747fbf04f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:49.017336 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49a3715-cb81-4392-a07a-4747fbf04f4d None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:49.024217 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0517278d-f48d-49a8-98f1-5862a5301806 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c88bc0f32600416ca7c6a59f4196e497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:49.024829 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0517278d-f48d-49a8-98f1-5862a5301806 service swift] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:49.025182 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0517278d-f48d-49a8-98f1-5862a5301806 service swift] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:49.025562 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0517278d-f48d-49a8-98f1-5862a5301806 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:49.037250 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0517278d-f48d-49a8-98f1-5862a5301806 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:49.039764 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0517278d-f48d-49a8-98f1-5862a5301806 service swift] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:49.050615 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1194/2387] 10.222.0.49 () {60 vars in 1384 bytes} [Thu Sep 29 02:13:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 29 02:13:55.765270 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fb8511-1c0b-442d-9540-96a204482b83 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:55.765859 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fb8511-1c0b-442d-9540-96a204482b83 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:55.765859 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fb8511-1c0b-442d-9540-96a204482b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:55.797082 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-04fb8511-1c0b-442d-9540-96a204482b83 None None] MFA Rules not processed for user `f167598e4a354a21b89825f2cbe8ff2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:55.800009 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-04fb8511-1c0b-442d-9540-96a204482b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:55.877210 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1194/2388] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:13:55 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:13:58.086105 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0517278d-f48d-49a8-98f1-5862a5301806 service swift] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:58.088473 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-0517278d-f48d-49a8-98f1-5862a5301806 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:58.161790 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:58.184983 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0517278d-f48d-49a8-98f1-5862a5301806 service swift] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:58.190664 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af952517-e9a1-40c5-97fd-4d6f84543b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:58.191425 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af952517-e9a1-40c5-97fd-4d6f84543b6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:58.192053 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af952517-e9a1-40c5-97fd-4d6f84543b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:58.192188 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af952517-e9a1-40c5-97fd-4d6f84543b6a admin admin] PATH_INFO: `/v3/users/4b31d206367b4c5c8c0fb0f8b56dcab2` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:58.193708 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af952517-e9a1-40c5-97fd-4d6f84543b6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b31d206367b4c5c8c0fb0f8b56dcab2)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:58.196196 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af952517-e9a1-40c5-97fd-4d6f84543b6a admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:58.287831 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-af952517-e9a1-40c5-97fd-4d6f84543b6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b31d206367b4c5c8c0fb0f8b56dcab2'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:58.290495 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-af952517-e9a1-40c5-97fd-4d6f84543b6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b31d206367b4c5c8c0fb0f8b56dcab2'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:58.305071 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-af952517-e9a1-40c5-97fd-4d6f84543b6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b31d206367b4c5c8c0fb0f8b56dcab2'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:58.316223 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-af952517-e9a1-40c5-97fd-4d6f84543b6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b31d206367b4c5c8c0fb0f8b56dcab2'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:58.316805 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-af952517-e9a1-40c5-97fd-4d6f84543b6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b31d206367b4c5c8c0fb0f8b56dcab2'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:58.330262 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1195/2389] 10.222.0.49 () {58 vars in 1224 bytes} [Thu Sep 29 02:13:58 2022] DELETE /identity/v3/users/4b31d206367b4c5c8c0fb0f8b56dcab2 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:13:58.334967 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a167e4cf-8f5f-46c2-9334-9194ac4f8a67 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:58.335528 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a167e4cf-8f5f-46c2-9334-9194ac4f8a67 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:58.335758 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a167e4cf-8f5f-46c2-9334-9194ac4f8a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:58.355931 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-a167e4cf-8f5f-46c2-9334-9194ac4f8a67 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:13:58.356742 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-a167e4cf-8f5f-46c2-9334-9194ac4f8a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:58.441415 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1195/2390] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:13:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 29 02:13:58.447898 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af952517-e9a1-40c5-97fd-4d6f84543b6a admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:58.449526 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-af952517-e9a1-40c5-97fd-4d6f84543b6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:58.645488 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af952517-e9a1-40c5-97fd-4d6f84543b6a admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:58.652724 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac199a8-c44f-461b-b82b-721db51bf0a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:58.653376 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac199a8-c44f-461b-b82b-721db51bf0a6 service neutron] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:58.653657 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac199a8-c44f-461b-b82b-721db51bf0a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:58.653923 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac199a8-c44f-461b-b82b-721db51bf0a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:58.664765 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac199a8-c44f-461b-b82b-721db51bf0a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:58.666226 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac199a8-c44f-461b-b82b-721db51bf0a6 service neutron] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:58.680735 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1196/2391] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:13:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:13:59.003737 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a167e4cf-8f5f-46c2-9334-9194ac4f8a67 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:13:59.005470 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-a167e4cf-8f5f-46c2-9334-9194ac4f8a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:13:59.019020 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a167e4cf-8f5f-46c2-9334-9194ac4f8a67 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:13:59.036140 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f98901-9605-46c7-95a7-7ffa28acd7ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:13:59.036732 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f98901-9605-46c7-95a7-7ffa28acd7ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:13:59.037019 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f98901-9605-46c7-95a7-7ffa28acd7ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:13:59.037342 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f98901-9605-46c7-95a7-7ffa28acd7ef admin admin] PATH_INFO: `/v3/projects/8f65987ae0c7490ebc13e30228347f8d` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:13:59.043399 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f98901-9605-46c7-95a7-7ffa28acd7ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f65987ae0c7490ebc13e30228347f8d)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:13:59.045402 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f98901-9605-46c7-95a7-7ffa28acd7ef admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:13:59.115636 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:59.117619 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-02f98901-9605-46c7-95a7-7ffa28acd7ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f65987ae0c7490ebc13e30228347f8d', 'request_id': 'req-02f98901-9605-46c7-95a7-7ffa28acd7ef'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:59.125003 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-02f98901-9605-46c7-95a7-7ffa28acd7ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f65987ae0c7490ebc13e30228347f8d', 'request_id': 'req-02f98901-9605-46c7-95a7-7ffa28acd7ef'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:59.135461 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-02f98901-9605-46c7-95a7-7ffa28acd7ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f65987ae0c7490ebc13e30228347f8d', 'request_id': 'req-02f98901-9605-46c7-95a7-7ffa28acd7ef'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:59.149736 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-02f98901-9605-46c7-95a7-7ffa28acd7ef admin admin] The token cache is being invalidate because project 8f65987ae0c7490ebc13e30228347f8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81649) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:13:59.150025 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-02f98901-9605-46c7-95a7-7ffa28acd7ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:59.150836 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-02f98901-9605-46c7-95a7-7ffa28acd7ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:13:59.152449 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1196/2392] 10.222.0.49 () {58 vars in 1233 bytes} [Thu Sep 29 02:13:59 2022] DELETE /identity/v3/projects/8f65987ae0c7490ebc13e30228347f8d => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:14:01.101498 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e115067-8c87-46c4-9522-97f0c6ee82aa None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:14:01.102110 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e115067-8c87-46c4-9522-97f0c6ee82aa None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:14:01.102110 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e115067-8c87-46c4-9522-97f0c6ee82aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:14:01.121018 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-8e115067-8c87-46c4-9522-97f0c6ee82aa None None] MFA Rules not processed for user `bcd3fa0a082144c3892221602eeeb4d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:14:01.122308 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-8e115067-8c87-46c4-9522-97f0c6ee82aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:14:01.180786 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1197/2393] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:14:01 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:14:08.308506 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e04c514-7301-404e-bb3e-03fab192627c None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:14:08.309082 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e04c514-7301-404e-bb3e-03fab192627c None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:14:08.309186 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e04c514-7301-404e-bb3e-03fab192627c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:14:08.330981 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-8e04c514-7301-404e-bb3e-03fab192627c None None] MFA Rules not processed for user `0f8f13f302de4701a7f4e0562bca08cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:14:08.332553 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-8e04c514-7301-404e-bb3e-03fab192627c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:14:08.398554 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1197/2394] 10.222.0.49 () {58 vars in 1009 bytes} [Thu Sep 29 02:14:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:14:08.414975 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e115067-8c87-46c4-9522-97f0c6ee82aa None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:14:08.416890 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-8e115067-8c87-46c4-9522-97f0c6ee82aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:14:08.443249 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:14:08.522080 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e115067-8c87-46c4-9522-97f0c6ee82aa None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:14:08.528731 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404e9be3-240c-4241-a09e-9beee3395bab service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c88bc0f32600416ca7c6a59f4196e497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:14:08.529195 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e9be3-240c-4241-a09e-9beee3395bab service swift] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:14:08.529528 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e9be3-240c-4241-a09e-9beee3395bab service swift] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:14:08.529802 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e9be3-240c-4241-a09e-9beee3395bab service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:14:08.542742 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404e9be3-240c-4241-a09e-9beee3395bab service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:14:08.544360 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404e9be3-240c-4241-a09e-9beee3395bab service swift] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:14:08.555584 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1198/2395] 10.222.0.49 () {60 vars in 1384 bytes} [Thu Sep 29 02:14:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 29 02:14:18.388707 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=32,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:14:18.551740 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=24 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:14:25.535004 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e04c514-7301-404e-bb3e-03fab192627c None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:14:25.536483 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-8e04c514-7301-404e-bb3e-03fab192627c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:14:25.603241 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e04c514-7301-404e-bb3e-03fab192627c None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:14:25.609352 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa0a5da-8e78-4b93-9405-5231bb7f3bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:14:25.609981 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa0a5da-8e78-4b93-9405-5231bb7f3bd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:14:25.610500 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa0a5da-8e78-4b93-9405-5231bb7f3bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:14:25.610626 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa0a5da-8e78-4b93-9405-5231bb7f3bd1 admin admin] PATH_INFO: `/v3/users/bc27c94b30854959b3bb7191f781b67e` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:14:25.611680 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa0a5da-8e78-4b93-9405-5231bb7f3bd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc27c94b30854959b3bb7191f781b67e)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:14:25.613630 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa0a5da-8e78-4b93-9405-5231bb7f3bd1 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:14:25.686188 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-4aa0a5da-8e78-4b93-9405-5231bb7f3bd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc27c94b30854959b3bb7191f781b67e'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:14:25.687054 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-4aa0a5da-8e78-4b93-9405-5231bb7f3bd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc27c94b30854959b3bb7191f781b67e'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:14:25.698711 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-4aa0a5da-8e78-4b93-9405-5231bb7f3bd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc27c94b30854959b3bb7191f781b67e'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:14:25.706512 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-4aa0a5da-8e78-4b93-9405-5231bb7f3bd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc27c94b30854959b3bb7191f781b67e'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:14:25.707178 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-4aa0a5da-8e78-4b93-9405-5231bb7f3bd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc27c94b30854959b3bb7191f781b67e'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:14:25.720341 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1198/2396] 10.222.0.49 () {58 vars in 1224 bytes} [Thu Sep 29 02:14:25 2022] DELETE /identity/v3/users/bc27c94b30854959b3bb7191f781b67e => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:14:25.724876 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127ce107-fcaa-4246-9575-878dd6271ac4 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:14:25.725454 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127ce107-fcaa-4246-9575-878dd6271ac4 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:14:25.725454 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127ce107-fcaa-4246-9575-878dd6271ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:14:25.746133 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-127ce107-fcaa-4246-9575-878dd6271ac4 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:14:25.747375 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-127ce107-fcaa-4246-9575-878dd6271ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:14:25.807987 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1199/2397] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:14:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:14:25.817386 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa0a5da-8e78-4b93-9405-5231bb7f3bd1 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:14:25.818874 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-4aa0a5da-8e78-4b93-9405-5231bb7f3bd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:14:25.875488 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa0a5da-8e78-4b93-9405-5231bb7f3bd1 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:14:25.879073 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36626501-290e-46b1-b143-58386777cb13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:14:25.879667 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36626501-290e-46b1-b143-58386777cb13 service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:14:25.879940 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36626501-290e-46b1-b143-58386777cb13 service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:14:25.880207 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36626501-290e-46b1-b143-58386777cb13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:14:25.889300 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36626501-290e-46b1-b143-58386777cb13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:14:25.891355 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36626501-290e-46b1-b143-58386777cb13 service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:14:25.900787 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1199/2398] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:14:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:14:26.163552 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127ce107-fcaa-4246-9575-878dd6271ac4 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:14:26.165015 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-127ce107-fcaa-4246-9575-878dd6271ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:14:26.179270 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127ce107-fcaa-4246-9575-878dd6271ac4 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:14:26.184256 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66748df3-0125-4389-9bbd-a412fa4eabc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:14:26.184892 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66748df3-0125-4389-9bbd-a412fa4eabc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:14:26.185168 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66748df3-0125-4389-9bbd-a412fa4eabc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:14:26.185517 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66748df3-0125-4389-9bbd-a412fa4eabc7 admin admin] PATH_INFO: `/v3/projects/63b4129bf8494d19b14e595d741e0343` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:14:26.186628 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66748df3-0125-4389-9bbd-a412fa4eabc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63b4129bf8494d19b14e595d741e0343)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:14:26.189265 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66748df3-0125-4389-9bbd-a412fa4eabc7 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:14:26.235082 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-66748df3-0125-4389-9bbd-a412fa4eabc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63b4129bf8494d19b14e595d741e0343', 'request_id': 'req-66748df3-0125-4389-9bbd-a412fa4eabc7'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:14:26.241155 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-66748df3-0125-4389-9bbd-a412fa4eabc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63b4129bf8494d19b14e595d741e0343', 'request_id': 'req-66748df3-0125-4389-9bbd-a412fa4eabc7'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:14:26.248373 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-66748df3-0125-4389-9bbd-a412fa4eabc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63b4129bf8494d19b14e595d741e0343', 'request_id': 'req-66748df3-0125-4389-9bbd-a412fa4eabc7'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:14:26.259348 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-66748df3-0125-4389-9bbd-a412fa4eabc7 admin admin] The token cache is being invalidate because project 63b4129bf8494d19b14e595d741e0343 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81648) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:14:26.259645 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-66748df3-0125-4389-9bbd-a412fa4eabc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:14:26.260267 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-66748df3-0125-4389-9bbd-a412fa4eabc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:14:26.261733 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1200/2399] 10.222.0.49 () {58 vars in 1233 bytes} [Thu Sep 29 02:14:26 2022] DELETE /identity/v3/projects/63b4129bf8494d19b14e595d741e0343 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:14:26.267205 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b57c15-a2c0-4c49-b8be-23a9eb357124 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:14:26.267490 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b57c15-a2c0-4c49-b8be-23a9eb357124 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:14:26.267811 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b57c15-a2c0-4c49-b8be-23a9eb357124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:14:26.287735 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-a9b57c15-a2c0-4c49-b8be-23a9eb357124 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:14:26.288930 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-a9b57c15-a2c0-4c49-b8be-23a9eb357124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:14:26.305368 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:14:26.349031 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1200/2400] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:14:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:14:26.356985 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95ad175-b9d3-4833-9673-7a9d83058a2a None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:14:26.357422 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95ad175-b9d3-4833-9673-7a9d83058a2a None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:14:26.357765 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95ad175-b9d3-4833-9673-7a9d83058a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:14:26.377621 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-f95ad175-b9d3-4833-9673-7a9d83058a2a None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:14:26.378821 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-f95ad175-b9d3-4833-9673-7a9d83058a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:14:26.386548 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1201/2401] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:14:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:14:26.391472 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b57c15-a2c0-4c49-b8be-23a9eb357124 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:14:26.401403 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b57c15-a2c0-4c49-b8be-23a9eb357124 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:14:26.406031 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c7fd95-9b28-4e54-9815-624fe6f856f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:14:26.406622 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c7fd95-9b28-4e54-9815-624fe6f856f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:14:26.406900 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c7fd95-9b28-4e54-9815-624fe6f856f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:14:26.407172 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c7fd95-9b28-4e54-9815-624fe6f856f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:14:26.407813 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c7fd95-9b28-4e54-9815-624fe6f856f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:14:26.408114 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c7fd95-9b28-4e54-9815-624fe6f856f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:14:26.409720 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c7fd95-9b28-4e54-9815-624fe6f856f8 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:14:26.421056 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1201/2402] 10.222.0.49 () {58 vars in 1153 bytes} [Thu Sep 29 02:14:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:14:26.425280 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95ad175-b9d3-4833-9673-7a9d83058a2a None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:14:26.434456 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95ad175-b9d3-4833-9673-7a9d83058a2a None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:14:26.439646 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4bcb22-5fc8-4536-866b-8acfa29640f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:14:26.440234 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4bcb22-5fc8-4536-866b-8acfa29640f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:14:26.440510 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4bcb22-5fc8-4536-866b-8acfa29640f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:14:26.440780 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4bcb22-5fc8-4536-866b-8acfa29640f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:14:26.441487 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4bcb22-5fc8-4536-866b-8acfa29640f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:14:26.443380 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4bcb22-5fc8-4536-866b-8acfa29640f9 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:14:26.470827 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1202/2403] 10.222.0.49 () {60 vars in 1153 bytes} [Thu Sep 29 02:14:26 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:14:26.475022 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c7fd95-9b28-4e54-9815-624fe6f856f8 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:14:26.485053 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c7fd95-9b28-4e54-9815-624fe6f856f8 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:14:26.540373 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d590fc-d0fc-4e3b-8b35-2ae03e132e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:14:26.541020 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d590fc-d0fc-4e3b-8b35-2ae03e132e80 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:14:26.541169 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d590fc-d0fc-4e3b-8b35-2ae03e132e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:14:26.541466 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d590fc-d0fc-4e3b-8b35-2ae03e132e80 admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:14:26.542081 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d590fc-d0fc-4e3b-8b35-2ae03e132e80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:14:26.543982 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d590fc-d0fc-4e3b-8b35-2ae03e132e80 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:14:26.564777 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1202/2404] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 02:14:26 2022] POST /identity/v3/users => generated 286 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:14:26.569016 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4bcb22-5fc8-4536-866b-8acfa29640f9 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:14:26.579913 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4bcb22-5fc8-4536-866b-8acfa29640f9 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:14:26.584665 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a0fd5c-3755-49c6-bdc5-ca54509a132b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:14:26.585256 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a0fd5c-3755-49c6-bdc5-ca54509a132b admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:14:26.585559 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a0fd5c-3755-49c6-bdc5-ca54509a132b admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:14:26.585825 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a0fd5c-3755-49c6-bdc5-ca54509a132b admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:14:26.586460 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a0fd5c-3755-49c6-bdc5-ca54509a132b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:14:26.588037 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a0fd5c-3755-49c6-bdc5-ca54509a132b admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:14:26.598595 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1203/2405] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:14:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:14:26.607490 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d590fc-d0fc-4e3b-8b35-2ae03e132e80 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:14:26.617663 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d590fc-d0fc-4e3b-8b35-2ae03e132e80 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:14:26.622260 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b2b027-2350-4673-ae42-ae5731d638f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:14:26.622845 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2b027-2350-4673-ae42-ae5731d638f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:14:26.623123 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2b027-2350-4673-ae42-ae5731d638f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:14:26.623394 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2b027-2350-4673-ae42-ae5731d638f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:14:26.624025 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b2b027-2350-4673-ae42-ae5731d638f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:14:26.625652 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b2b027-2350-4673-ae42-ae5731d638f5 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:14:26.635867 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1203/2406] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:14:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:14:26.640467 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a0fd5c-3755-49c6-bdc5-ca54509a132b admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:14:26.651439 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a0fd5c-3755-49c6-bdc5-ca54509a132b admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:14:26.657102 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc3431e-e5d6-4b0f-8cd7-0babddf3fbce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:14:26.657791 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc3431e-e5d6-4b0f-8cd7-0babddf3fbce admin admin] REQUEST_METHOD: `PUT` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:14:26.658066 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc3431e-e5d6-4b0f-8cd7-0babddf3fbce admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:14:26.658333 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc3431e-e5d6-4b0f-8cd7-0babddf3fbce admin admin] PATH_INFO: `/v3/projects/37620330b8314a35824b69d7fc983382/users/b222cedcad13488b992445fda7b781f5/roles/f157f905c9c94ccfbfb46e52d443e8f2` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:14:26.673332 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc3431e-e5d6-4b0f-8cd7-0babddf3fbce admin admin] RBAC: Authorizing `identity:create_grant(project_id=37620330b8314a35824b69d7fc983382, user_id=b222cedcad13488b992445fda7b781f5, role_id=f157f905c9c94ccfbfb46e52d443e8f2)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:14:26.675966 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc3431e-e5d6-4b0f-8cd7-0babddf3fbce admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:14:26.692032 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1204/2407] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:14:26 2022] PUT /identity/v3/projects/37620330b8314a35824b69d7fc983382/users/b222cedcad13488b992445fda7b781f5/roles/f157f905c9c94ccfbfb46e52d443e8f2 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:14:26.703504 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e539bcc-306e-42b0-828d-f5d819e7f8cf None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:14:26.703912 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e539bcc-306e-42b0-828d-f5d819e7f8cf None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:14:26.704327 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e539bcc-306e-42b0-828d-f5d819e7f8cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:14:26.735041 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-2e539bcc-306e-42b0-828d-f5d819e7f8cf None None] MFA Rules not processed for user `b222cedcad13488b992445fda7b781f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:14:26.736474 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-2e539bcc-306e-42b0-828d-f5d819e7f8cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:14:26.810587 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1204/2408] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:14:26 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:14:26.823419 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc3431e-e5d6-4b0f-8cd7-0babddf3fbce admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:14:26.825188 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-8fc3431e-e5d6-4b0f-8cd7-0babddf3fbce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:14:26.849905 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:14:26.887648 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc3431e-e5d6-4b0f-8cd7-0babddf3fbce admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:14:26.891726 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8fdc3a-c68f-48bf-b011-c1eeffa25b06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75135b856134ba4b9ccac337886f682', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:14:26.892340 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8fdc3a-c68f-48bf-b011-c1eeffa25b06 service cinder] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:14:26.892622 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8fdc3a-c68f-48bf-b011-c1eeffa25b06 service cinder] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:14:26.892914 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8fdc3a-c68f-48bf-b011-c1eeffa25b06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:14:26.924519 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8fdc3a-c68f-48bf-b011-c1eeffa25b06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:14:26.926007 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8fdc3a-c68f-48bf-b011-c1eeffa25b06 service cinder] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:14:26.935383 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1205/2409] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:14:26 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:14:26.960949 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e539bcc-306e-42b0-828d-f5d819e7f8cf None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:14:26.981469 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:14:27.028074 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e539bcc-306e-42b0-828d-f5d819e7f8cf None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:14:27.033285 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6516aa87-25a5-4049-b8d2-36b3c45d46e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:14:27.033938 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6516aa87-25a5-4049-b8d2-36b3c45d46e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:14:27.034213 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6516aa87-25a5-4049-b8d2-36b3c45d46e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:14:27.034480 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6516aa87-25a5-4049-b8d2-36b3c45d46e5 admin admin] PATH_INFO: `/v3/users/b222cedcad13488b992445fda7b781f5` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:14:27.035636 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6516aa87-25a5-4049-b8d2-36b3c45d46e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b222cedcad13488b992445fda7b781f5)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:14:27.037872 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6516aa87-25a5-4049-b8d2-36b3c45d46e5 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:14:27.086862 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-6516aa87-25a5-4049-b8d2-36b3c45d46e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b222cedcad13488b992445fda7b781f5'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:14:27.087511 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-6516aa87-25a5-4049-b8d2-36b3c45d46e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b222cedcad13488b992445fda7b781f5'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:14:27.100156 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-6516aa87-25a5-4049-b8d2-36b3c45d46e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b222cedcad13488b992445fda7b781f5'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:14:27.107284 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-6516aa87-25a5-4049-b8d2-36b3c45d46e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b222cedcad13488b992445fda7b781f5'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:14:27.107938 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-6516aa87-25a5-4049-b8d2-36b3c45d46e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b222cedcad13488b992445fda7b781f5'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:14:27.120232 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1205/2410] 10.222.0.49 () {58 vars in 1224 bytes} [Thu Sep 29 02:14:26 2022] DELETE /identity/v3/users/b222cedcad13488b992445fda7b781f5 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:14:27.130354 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47becc8c-241f-4cb9-a048-661b01b74e89 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:14:27.130643 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47becc8c-241f-4cb9-a048-661b01b74e89 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:14:27.130917 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47becc8c-241f-4cb9-a048-661b01b74e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:14:27.151754 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-47becc8c-241f-4cb9-a048-661b01b74e89 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:14:27.152955 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-47becc8c-241f-4cb9-a048-661b01b74e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:14:27.209391 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1206/2411] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:14:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:14:27.218988 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6516aa87-25a5-4049-b8d2-36b3c45d46e5 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:14:27.220423 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-6516aa87-25a5-4049-b8d2-36b3c45d46e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:14:27.277679 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6516aa87-25a5-4049-b8d2-36b3c45d46e5 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:14:27.281537 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368ae7e0-8ebd-4aca-ada6-5799153adba1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:14:27.282155 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368ae7e0-8ebd-4aca-ada6-5799153adba1 service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:14:27.282431 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368ae7e0-8ebd-4aca-ada6-5799153adba1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:14:27.282697 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368ae7e0-8ebd-4aca-ada6-5799153adba1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:14:27.291545 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368ae7e0-8ebd-4aca-ada6-5799153adba1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:14:27.292981 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368ae7e0-8ebd-4aca-ada6-5799153adba1 service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:14:27.302870 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1206/2412] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:14:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:14:27.569074 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47becc8c-241f-4cb9-a048-661b01b74e89 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:14:27.570692 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-47becc8c-241f-4cb9-a048-661b01b74e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:14:27.583537 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47becc8c-241f-4cb9-a048-661b01b74e89 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:14:27.588241 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d82909-f084-411b-9d08-e7cbdba3ccce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:14:27.588873 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d82909-f084-411b-9d08-e7cbdba3ccce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:14:27.589153 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d82909-f084-411b-9d08-e7cbdba3ccce admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:14:27.589462 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d82909-f084-411b-9d08-e7cbdba3ccce admin admin] PATH_INFO: `/v3/projects/37620330b8314a35824b69d7fc983382` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:14:27.590594 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d82909-f084-411b-9d08-e7cbdba3ccce admin admin] RBAC: Authorizing `identity:delete_project(project_id=37620330b8314a35824b69d7fc983382)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:14:27.592590 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d82909-f084-411b-9d08-e7cbdba3ccce admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:14:27.639518 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-d9d82909-f084-411b-9d08-e7cbdba3ccce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37620330b8314a35824b69d7fc983382', 'request_id': 'req-d9d82909-f084-411b-9d08-e7cbdba3ccce'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:14:27.646134 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-d9d82909-f084-411b-9d08-e7cbdba3ccce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37620330b8314a35824b69d7fc983382', 'request_id': 'req-d9d82909-f084-411b-9d08-e7cbdba3ccce'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:14:27.655362 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-d9d82909-f084-411b-9d08-e7cbdba3ccce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37620330b8314a35824b69d7fc983382', 'request_id': 'req-d9d82909-f084-411b-9d08-e7cbdba3ccce'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:14:27.666281 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-d9d82909-f084-411b-9d08-e7cbdba3ccce admin admin] The token cache is being invalidate because project 37620330b8314a35824b69d7fc983382 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81648) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:14:27.666565 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-d9d82909-f084-411b-9d08-e7cbdba3ccce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:14:27.667180 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-d9d82909-f084-411b-9d08-e7cbdba3ccce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:14:27.668619 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1207/2413] 10.222.0.49 () {58 vars in 1233 bytes} [Thu Sep 29 02:14:27 2022] DELETE /identity/v3/projects/37620330b8314a35824b69d7fc983382 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:14:27.674035 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fcea00-e84f-46c3-9b42-07e20749a9c3 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:14:27.674512 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fcea00-e84f-46c3-9b42-07e20749a9c3 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:14:27.674626 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fcea00-e84f-46c3-9b42-07e20749a9c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:14:27.693718 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-35fcea00-e84f-46c3-9b42-07e20749a9c3 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:14:27.694921 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-35fcea00-e84f-46c3-9b42-07e20749a9c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:14:27.733143 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:14:27.761192 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1207/2414] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:14:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:14:27.769272 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04efab55-ab4c-44f4-b824-f9427d5dc717 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:14:27.769588 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04efab55-ab4c-44f4-b824-f9427d5dc717 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:14:27.769919 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04efab55-ab4c-44f4-b824-f9427d5dc717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:14:27.789717 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-04efab55-ab4c-44f4-b824-f9427d5dc717 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:14:27.790922 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-04efab55-ab4c-44f4-b824-f9427d5dc717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:14:27.799929 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1208/2415] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:14:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:14:27.804290 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fcea00-e84f-46c3-9b42-07e20749a9c3 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:14:27.814773 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fcea00-e84f-46c3-9b42-07e20749a9c3 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:14:27.819476 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cfea38-1227-45f7-8a66-b8149543169e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:14:27.820017 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cfea38-1227-45f7-8a66-b8149543169e admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:14:27.820295 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cfea38-1227-45f7-8a66-b8149543169e admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:14:27.820565 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cfea38-1227-45f7-8a66-b8149543169e admin admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:14:27.821207 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cfea38-1227-45f7-8a66-b8149543169e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:14:27.821537 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cfea38-1227-45f7-8a66-b8149543169e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:14:27.823117 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cfea38-1227-45f7-8a66-b8149543169e admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:14:27.835568 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1208/2416] 10.222.0.49 () {58 vars in 1153 bytes} [Thu Sep 29 02:14:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:14:27.840178 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04efab55-ab4c-44f4-b824-f9427d5dc717 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:14:27.850391 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04efab55-ab4c-44f4-b824-f9427d5dc717 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:14:27.855168 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e9db00-a5cc-4950-92b5-e5a09e26095c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:14:27.855764 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e9db00-a5cc-4950-92b5-e5a09e26095c admin admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:14:27.856043 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e9db00-a5cc-4950-92b5-e5a09e26095c admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:14:27.856308 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e9db00-a5cc-4950-92b5-e5a09e26095c admin admin] PATH_INFO: `/v3/projects` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:14:27.856960 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e9db00-a5cc-4950-92b5-e5a09e26095c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:14:27.858948 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e9db00-a5cc-4950-92b5-e5a09e26095c admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:14:27.888854 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1209/2417] 10.222.0.49 () {60 vars in 1153 bytes} [Thu Sep 29 02:14:27 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 29 02:14:27.894084 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cfea38-1227-45f7-8a66-b8149543169e admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:14:27.904144 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cfea38-1227-45f7-8a66-b8149543169e admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:14:27.968024 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00eb75e-b731-4caf-acaa-ebd12d52a75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:14:27.968651 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00eb75e-b731-4caf-acaa-ebd12d52a75f admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:14:27.968933 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00eb75e-b731-4caf-acaa-ebd12d52a75f admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:14:27.969206 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00eb75e-b731-4caf-acaa-ebd12d52a75f admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:14:27.969880 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00eb75e-b731-4caf-acaa-ebd12d52a75f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:14:27.971800 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00eb75e-b731-4caf-acaa-ebd12d52a75f admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:14:27.998952 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1209/2418] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 02:14:27 2022] POST /identity/v3/users => generated 292 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 29 02:14:28.000707 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e9db00-a5cc-4950-92b5-e5a09e26095c admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:14:28.011649 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e9db00-a5cc-4950-92b5-e5a09e26095c admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:14:28.016714 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aecf897-4fb6-4ce3-a0e9-229c39d7eae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:14:28.017338 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aecf897-4fb6-4ce3-a0e9-229c39d7eae6 admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:14:28.017632 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aecf897-4fb6-4ce3-a0e9-229c39d7eae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:14:28.017904 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aecf897-4fb6-4ce3-a0e9-229c39d7eae6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:14:28.018804 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aecf897-4fb6-4ce3-a0e9-229c39d7eae6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:14:28.020401 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aecf897-4fb6-4ce3-a0e9-229c39d7eae6 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:14:28.033345 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1210/2419] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:14:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 29 02:14:28.034829 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00eb75e-b731-4caf-acaa-ebd12d52a75f admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:14:28.045259 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00eb75e-b731-4caf-acaa-ebd12d52a75f admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:14:28.051982 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2e0515-c64d-414c-9266-2e8119eef73b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:14:28.052586 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2e0515-c64d-414c-9266-2e8119eef73b admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:14:28.053352 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2e0515-c64d-414c-9266-2e8119eef73b admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:14:28.053636 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2e0515-c64d-414c-9266-2e8119eef73b admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:14:28.054291 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2e0515-c64d-414c-9266-2e8119eef73b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:14:28.055897 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2e0515-c64d-414c-9266-2e8119eef73b admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:14:28.068841 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1210/2420] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:14:28 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 29 02:14:28.073109 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aecf897-4fb6-4ce3-a0e9-229c39d7eae6 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:14:28.083839 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aecf897-4fb6-4ce3-a0e9-229c39d7eae6 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:14:28.089034 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27f6f27-cf77-480b-9fc4-b104eb1ca618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:14:28.089745 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f6f27-cf77-480b-9fc4-b104eb1ca618 admin admin] REQUEST_METHOD: `PUT` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:14:28.090028 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f6f27-cf77-480b-9fc4-b104eb1ca618 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:14:28.090298 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f6f27-cf77-480b-9fc4-b104eb1ca618 admin admin] PATH_INFO: `/v3/projects/342119cedbac4ca9b7ac5c1cd5481823/users/5ffb114119984af78b50f14b9fe3e69a/roles/f157f905c9c94ccfbfb46e52d443e8f2` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:14:28.092684 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:14:28.109876 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27f6f27-cf77-480b-9fc4-b104eb1ca618 admin admin] RBAC: Authorizing `identity:create_grant(project_id=342119cedbac4ca9b7ac5c1cd5481823, user_id=5ffb114119984af78b50f14b9fe3e69a, role_id=f157f905c9c94ccfbfb46e52d443e8f2)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:14:28.112949 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27f6f27-cf77-480b-9fc4-b104eb1ca618 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:14:28.126688 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1211/2421] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:14:28 2022] PUT /identity/v3/projects/342119cedbac4ca9b7ac5c1cd5481823/users/5ffb114119984af78b50f14b9fe3e69a/roles/f157f905c9c94ccfbfb46e52d443e8f2 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:14:28.131887 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89ad534-efff-4fbe-8eb6-18811d054ba7 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:14:28.132173 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89ad534-efff-4fbe-8eb6-18811d054ba7 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:14:28.132443 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89ad534-efff-4fbe-8eb6-18811d054ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:14:28.183162 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-d89ad534-efff-4fbe-8eb6-18811d054ba7 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:14:28.184554 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-d89ad534-efff-4fbe-8eb6-18811d054ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:14:28.283501 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1211/2422] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:14:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:14:28.292383 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27f6f27-cf77-480b-9fc4-b104eb1ca618 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:14:28.295186 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-d27f6f27-cf77-480b-9fc4-b104eb1ca618 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:14:28.360386 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27f6f27-cf77-480b-9fc4-b104eb1ca618 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:14:28.364523 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5f8094-202f-4999-bda1-87026a843e98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:14:28.365260 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f8094-202f-4999-bda1-87026a843e98 service neutron] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:14:28.365563 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f8094-202f-4999-bda1-87026a843e98 service neutron] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:14:28.365828 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f8094-202f-4999-bda1-87026a843e98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:14:28.377351 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5f8094-202f-4999-bda1-87026a843e98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:14:28.378939 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5f8094-202f-4999-bda1-87026a843e98 service neutron] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:14:28.390661 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1212/2423] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:14:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:14:29.117944 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b50e92-2d97-47a4-bc48-4d42a02aff48 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:14:29.118519 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b50e92-2d97-47a4-bc48-4d42a02aff48 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:14:29.118519 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b50e92-2d97-47a4-bc48-4d42a02aff48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:14:29.168197 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-18b50e92-2d97-47a4-bc48-4d42a02aff48 None None] MFA Rules not processed for user `5ffb114119984af78b50f14b9fe3e69a`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:14:29.169498 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-18b50e92-2d97-47a4-bc48-4d42a02aff48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:14:29.205349 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:14:29.244330 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1212/2424] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:14:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:14:29.256643 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5f8094-202f-4999-bda1-87026a843e98 service neutron] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:14:29.259091 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-ea5f8094-202f-4999-bda1-87026a843e98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:14:29.325236 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5f8094-202f-4999-bda1-87026a843e98 service neutron] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:14:29.328894 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24566bc9-dfcd-4d4f-9365-113216791412 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75135b856134ba4b9ccac337886f682', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:14:29.329526 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24566bc9-dfcd-4d4f-9365-113216791412 service cinder] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:14:29.329800 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24566bc9-dfcd-4d4f-9365-113216791412 service cinder] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:14:29.330065 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24566bc9-dfcd-4d4f-9365-113216791412 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:14:29.338786 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24566bc9-dfcd-4d4f-9365-113216791412 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:14:29.340210 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24566bc9-dfcd-4d4f-9365-113216791412 service cinder] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:14:29.349773 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1213/2425] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:14:29 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:14:30.725147 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be60de7-48a5-4dc2-905b-17d5a8070e7e None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:14:30.725693 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be60de7-48a5-4dc2-905b-17d5a8070e7e None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:14:30.725787 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be60de7-48a5-4dc2-905b-17d5a8070e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:14:30.744397 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-5be60de7-48a5-4dc2-905b-17d5a8070e7e None None] MFA Rules not processed for user `5ffb114119984af78b50f14b9fe3e69a`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:14:30.745685 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-5be60de7-48a5-4dc2-905b-17d5a8070e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:14:30.753082 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1213/2426] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:14:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:14:38.611956 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d610dc0-c61b-4130-a595-664aaf4d18e2 None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:14:38.612482 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d610dc0-c61b-4130-a595-664aaf4d18e2 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:14:38.612482 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d610dc0-c61b-4130-a595-664aaf4d18e2 None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:14:38.614231 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1214/2427] 10.222.0.49 () {54 vars in 961 bytes} [Thu Sep 29 02:14:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:14:38.619426 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2a70e0-d21f-4436-9f74-b7dd7c799400 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:14:38.620258 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2a70e0-d21f-4436-9f74-b7dd7c799400 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:14:38.620822 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2a70e0-d21f-4436-9f74-b7dd7c799400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:14:38.662710 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-1d2a70e0-d21f-4436-9f74-b7dd7c799400 None None] MFA Rules not processed for user `3cbb39731a6b42e2a6647d6134b5c7cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:14:38.664156 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-1d2a70e0-d21f-4436-9f74-b7dd7c799400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:14:38.793437 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1214/2428] 10.222.0.49 () {58 vars in 1058 bytes} [Thu Sep 29 02:14:38 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:14:38.802387 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d610dc0-c61b-4130-a595-664aaf4d18e2 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:14:38.817715 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d610dc0-c61b-4130-a595-664aaf4d18e2 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:14:38.823406 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb56989e-0a13-4b1e-965f-1449d92fc765 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cbb39731a6b42e2a6647d6134b5c7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:14:38.824011 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb56989e-0a13-4b1e-965f-1449d92fc765 service placement] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:14:38.824451 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb56989e-0a13-4b1e-965f-1449d92fc765 service placement] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:14:38.824888 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb56989e-0a13-4b1e-965f-1449d92fc765 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:14:38.827003 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-fb56989e-0a13-4b1e-965f-1449d92fc765 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:14:38.856695 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb56989e-0a13-4b1e-965f-1449d92fc765 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:14:38.859881 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb56989e-0a13-4b1e-965f-1449d92fc765 service placement] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:14:38.889018 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1215/2429] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:14:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:14:40.275497 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eda64f-a398-4312-86f6-8d76ddccf4fc None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:14:40.276036 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eda64f-a398-4312-86f6-8d76ddccf4fc None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:14:40.276141 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eda64f-a398-4312-86f6-8d76ddccf4fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:14:40.298681 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-31eda64f-a398-4312-86f6-8d76ddccf4fc None None] MFA Rules not processed for user `0f8f13f302de4701a7f4e0562bca08cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:14:40.299965 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-31eda64f-a398-4312-86f6-8d76ddccf4fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:14:40.356158 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1215/2430] 10.222.0.49 () {58 vars in 1009 bytes} [Thu Sep 29 02:14:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:14:40.379494 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb56989e-0a13-4b1e-965f-1449d92fc765 service placement] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:14:40.380903 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-fb56989e-0a13-4b1e-965f-1449d92fc765 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:14:40.450668 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb56989e-0a13-4b1e-965f-1449d92fc765 service placement] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:14:40.455740 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fab0ea-411c-4854-97b1-9e263d2f5ee9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c88bc0f32600416ca7c6a59f4196e497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:14:40.456336 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fab0ea-411c-4854-97b1-9e263d2f5ee9 service swift] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:14:40.456609 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fab0ea-411c-4854-97b1-9e263d2f5ee9 service swift] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:14:40.456872 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fab0ea-411c-4854-97b1-9e263d2f5ee9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:14:40.464645 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fab0ea-411c-4854-97b1-9e263d2f5ee9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:14:40.466280 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fab0ea-411c-4854-97b1-9e263d2f5ee9 service swift] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:14:40.474730 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1216/2431] 10.222.0.49 () {60 vars in 1384 bytes} [Thu Sep 29 02:14:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 29 02:14:46.631882 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eda64f-a398-4312-86f6-8d76ddccf4fc None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:14:46.635115 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-31eda64f-a398-4312-86f6-8d76ddccf4fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:14:46.652601 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eda64f-a398-4312-86f6-8d76ddccf4fc None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:14:46.658527 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02bffda-2c89-43e6-8400-51af6a6f93ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:14:46.659325 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02bffda-2c89-43e6-8400-51af6a6f93ad service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:14:46.659871 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02bffda-2c89-43e6-8400-51af6a6f93ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:14:46.660427 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02bffda-2c89-43e6-8400-51af6a6f93ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:14:46.662825 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-d02bffda-2c89-43e6-8400-51af6a6f93ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:14:46.749032 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02bffda-2c89-43e6-8400-51af6a6f93ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:14:46.752390 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02bffda-2c89-43e6-8400-51af6a6f93ad service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:14:46.768777 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1216/2432] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:14:46 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:14:50.475202 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=97,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:14:54.859268 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cca761-209b-4110-8c62-d24fa8bb9539 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:14:54.859963 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cca761-209b-4110-8c62-d24fa8bb9539 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:14:54.860729 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cca761-209b-4110-8c62-d24fa8bb9539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:14:54.882449 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-22cca761-209b-4110-8c62-d24fa8bb9539 None None] MFA Rules not processed for user `f68a35fdeeea469f873ec50671fc35f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:14:54.883899 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-22cca761-209b-4110-8c62-d24fa8bb9539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:14:54.964668 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1217/2433] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:14:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 29 02:14:56.761253 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=98 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:15:03.473646 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb7bb7b-d094-4ef2-b760-c1d4689e7f53 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:15:03.474237 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb7bb7b-d094-4ef2-b760-c1d4689e7f53 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:15:03.474237 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb7bb7b-d094-4ef2-b760-c1d4689e7f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:15:03.497067 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-bbb7bb7b-d094-4ef2-b760-c1d4689e7f53 None None] MFA Rules not processed for user `0f8f13f302de4701a7f4e0562bca08cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:15:03.498356 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-bbb7bb7b-d094-4ef2-b760-c1d4689e7f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:15:03.505959 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1217/2434] 10.222.0.49 () {58 vars in 967 bytes} [Thu Sep 29 02:15:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:15:03.519382 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cca761-209b-4110-8c62-d24fa8bb9539 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:15:03.533756 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cca761-209b-4110-8c62-d24fa8bb9539 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:15:03.538847 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b08da7-6819-4605-aad8-5a9504d010be service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c88bc0f32600416ca7c6a59f4196e497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:15:03.539714 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b08da7-6819-4605-aad8-5a9504d010be service swift] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:15:03.540058 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b08da7-6819-4605-aad8-5a9504d010be service swift] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:15:03.540268 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b08da7-6819-4605-aad8-5a9504d010be service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:15:03.549708 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b08da7-6819-4605-aad8-5a9504d010be service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:15:03.551290 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b08da7-6819-4605-aad8-5a9504d010be service swift] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:15:03.559832 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1218/2435] 10.222.0.49 () {60 vars in 1384 bytes} [Thu Sep 29 02:15:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 29 02:15:05.897799 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb7bb7b-d094-4ef2-b760-c1d4689e7f53 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:15:05.899700 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-bbb7bb7b-d094-4ef2-b760-c1d4689e7f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:15:05.928808 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb7bb7b-d094-4ef2-b760-c1d4689e7f53 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:15:05.933455 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba545f60-bb10-4f59-aa35-04df3d7620c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:15:05.934116 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba545f60-bb10-4f59-aa35-04df3d7620c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:15:05.934373 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba545f60-bb10-4f59-aa35-04df3d7620c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:15:05.934686 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba545f60-bb10-4f59-aa35-04df3d7620c6 admin admin] PATH_INFO: `/v3/users/5e482260d1d840b4821122a7896c0a2b` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:15:05.935850 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba545f60-bb10-4f59-aa35-04df3d7620c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e482260d1d840b4821122a7896c0a2b)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:15:05.938374 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba545f60-bb10-4f59-aa35-04df3d7620c6 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:15:05.992346 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-ba545f60-bb10-4f59-aa35-04df3d7620c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e482260d1d840b4821122a7896c0a2b'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:15:05.993056 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-ba545f60-bb10-4f59-aa35-04df3d7620c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e482260d1d840b4821122a7896c0a2b'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:15:06.008003 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-ba545f60-bb10-4f59-aa35-04df3d7620c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e482260d1d840b4821122a7896c0a2b'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:15:06.015048 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-ba545f60-bb10-4f59-aa35-04df3d7620c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e482260d1d840b4821122a7896c0a2b'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:15:06.015757 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-ba545f60-bb10-4f59-aa35-04df3d7620c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e482260d1d840b4821122a7896c0a2b'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:15:06.028863 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1218/2436] 10.222.0.49 () {58 vars in 1224 bytes} [Thu Sep 29 02:15:05 2022] DELETE /identity/v3/users/5e482260d1d840b4821122a7896c0a2b => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:15:06.212730 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b08da7-6819-4605-aad8-5a9504d010be service swift] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:15:06.235719 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b08da7-6819-4605-aad8-5a9504d010be service swift] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:15:06.303360 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d590e1-a0eb-42d8-81ad-46759b3f9a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:15:06.304025 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d590e1-a0eb-42d8-81ad-46759b3f9a6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:15:06.304302 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d590e1-a0eb-42d8-81ad-46759b3f9a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:15:06.304808 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d590e1-a0eb-42d8-81ad-46759b3f9a6f admin admin] PATH_INFO: `/v3/projects/d06e11b31c404d7eaf1701be9001c76d` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:15:06.307013 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d590e1-a0eb-42d8-81ad-46759b3f9a6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d06e11b31c404d7eaf1701be9001c76d)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:15:06.310409 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d590e1-a0eb-42d8-81ad-46759b3f9a6f admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:15:06.372607 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-14d590e1-a0eb-42d8-81ad-46759b3f9a6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd06e11b31c404d7eaf1701be9001c76d', 'request_id': 'req-14d590e1-a0eb-42d8-81ad-46759b3f9a6f'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:15:06.382767 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-14d590e1-a0eb-42d8-81ad-46759b3f9a6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd06e11b31c404d7eaf1701be9001c76d', 'request_id': 'req-14d590e1-a0eb-42d8-81ad-46759b3f9a6f'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:15:06.394154 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-14d590e1-a0eb-42d8-81ad-46759b3f9a6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd06e11b31c404d7eaf1701be9001c76d', 'request_id': 'req-14d590e1-a0eb-42d8-81ad-46759b3f9a6f'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:15:06.405933 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-14d590e1-a0eb-42d8-81ad-46759b3f9a6f admin admin] The token cache is being invalidate because project d06e11b31c404d7eaf1701be9001c76d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81648) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:15:06.406224 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-14d590e1-a0eb-42d8-81ad-46759b3f9a6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:15:06.406867 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-14d590e1-a0eb-42d8-81ad-46759b3f9a6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:15:06.408336 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1219/2437] 10.222.0.49 () {58 vars in 1233 bytes} [Thu Sep 29 02:15:06 2022] DELETE /identity/v3/projects/d06e11b31c404d7eaf1701be9001c76d => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:15:16.024632 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=32,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:15:16.404150 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=82,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:15:19.960167 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c7157-c047-4e78-9f09-ca40d48fde63 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:15:19.960665 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c7157-c047-4e78-9f09-ca40d48fde63 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:15:19.960763 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c7157-c047-4e78-9f09-ca40d48fde63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:15:19.980749 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-e31c7157-c047-4e78-9f09-ca40d48fde63 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:15:19.981989 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-e31c7157-c047-4e78-9f09-ca40d48fde63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:15:20.040434 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1219/2438] 10.222.0.16 () {58 vars in 1016 bytes} [Thu Sep 29 02:15:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:15:20.070685 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d590e1-a0eb-42d8-81ad-46759b3f9a6f admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:15:20.072119 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-14d590e1-a0eb-42d8-81ad-46759b3f9a6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:15:20.149165 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d590e1-a0eb-42d8-81ad-46759b3f9a6f admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:15:20.154756 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57bb505-ebf1-4989-b926-4fd9077c49bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3325a7111d447f4a9cf00c672d5420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:15:20.155353 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57bb505-ebf1-4989-b926-4fd9077c49bf service nova] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:15:20.155627 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57bb505-ebf1-4989-b926-4fd9077c49bf service nova] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:15:20.155895 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57bb505-ebf1-4989-b926-4fd9077c49bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:15:20.164698 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57bb505-ebf1-4989-b926-4fd9077c49bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:15:20.166225 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57bb505-ebf1-4989-b926-4fd9077c49bf service nova] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:15:20.176200 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1220/2439] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:15:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:15:23.315049 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c601a20-8259-4428-b1a7-9faf632cc86f None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:15:23.315561 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c601a20-8259-4428-b1a7-9faf632cc86f None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:15:23.315667 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c601a20-8259-4428-b1a7-9faf632cc86f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:15:23.336357 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-2c601a20-8259-4428-b1a7-9faf632cc86f None None] MFA Rules not processed for user `0f8f13f302de4701a7f4e0562bca08cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:15:23.337669 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-2c601a20-8259-4428-b1a7-9faf632cc86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:15:23.394687 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1220/2440] 10.222.0.49 () {58 vars in 1009 bytes} [Thu Sep 29 02:15:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 29 02:15:23.407937 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57bb505-ebf1-4989-b926-4fd9077c49bf service nova] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:15:23.409623 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-c57bb505-ebf1-4989-b926-4fd9077c49bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:15:23.481953 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57bb505-ebf1-4989-b926-4fd9077c49bf service nova] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:15:23.486851 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95981fad-d124-40b9-adcf-1a19b498602f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c88bc0f32600416ca7c6a59f4196e497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:15:23.487453 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95981fad-d124-40b9-adcf-1a19b498602f service swift] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:15:23.487731 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95981fad-d124-40b9-adcf-1a19b498602f service swift] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:15:23.487999 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95981fad-d124-40b9-adcf-1a19b498602f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:15:23.496644 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95981fad-d124-40b9-adcf-1a19b498602f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:15:23.498249 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95981fad-d124-40b9-adcf-1a19b498602f service swift] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:15:23.508506 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1221/2441] 10.222.0.49 () {60 vars in 1384 bytes} [Thu Sep 29 02:15:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 29 02:15:24.145096 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021d99f5-2016-42fa-8fb3-35eabd801d7b None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:15:24.145402 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021d99f5-2016-42fa-8fb3-35eabd801d7b None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:15:24.145675 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021d99f5-2016-42fa-8fb3-35eabd801d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:15:24.165992 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-021d99f5-2016-42fa-8fb3-35eabd801d7b None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:15:24.167907 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-021d99f5-2016-42fa-8fb3-35eabd801d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:15:24.176187 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1221/2442] 10.222.0.16 () {58 vars in 1016 bytes} [Thu Sep 29 02:15:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:15:24.191241 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95981fad-d124-40b9-adcf-1a19b498602f service swift] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:15:24.192635 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-95981fad-d124-40b9-adcf-1a19b498602f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:15:24.209251 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95981fad-d124-40b9-adcf-1a19b498602f service swift] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:15:24.216064 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e38b8a-3748-498a-9499-8663265290f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3325a7111d447f4a9cf00c672d5420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:15:24.216820 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e38b8a-3748-498a-9499-8663265290f9 service nova] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:15:24.217238 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e38b8a-3748-498a-9499-8663265290f9 service nova] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:15:24.217639 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e38b8a-3748-498a-9499-8663265290f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:15:24.234410 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e38b8a-3748-498a-9499-8663265290f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:15:24.236190 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e38b8a-3748-498a-9499-8663265290f9 service nova] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:15:24.250212 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1222/2443] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:15:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:15:28.502890 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ed4431-04e6-4a46-af95-736109fd3c86 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:15:28.503423 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ed4431-04e6-4a46-af95-736109fd3c86 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:15:28.503423 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ed4431-04e6-4a46-af95-736109fd3c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:15:28.525942 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-52ed4431-04e6-4a46-af95-736109fd3c86 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:15:28.527170 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-52ed4431-04e6-4a46-af95-736109fd3c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:15:28.539494 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1222/2444] 10.222.0.16 () {58 vars in 1016 bytes} [Thu Sep 29 02:15:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:15:28.554170 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e38b8a-3748-498a-9499-8663265290f9 service nova] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:15:28.567746 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e38b8a-3748-498a-9499-8663265290f9 service nova] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:15:28.575178 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8030881c-52e1-4e0d-811d-d0176e82323c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3325a7111d447f4a9cf00c672d5420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:15:28.575933 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8030881c-52e1-4e0d-811d-d0176e82323c service nova] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:15:28.576201 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8030881c-52e1-4e0d-811d-d0176e82323c service nova] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:15:28.576467 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8030881c-52e1-4e0d-811d-d0176e82323c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:15:28.585625 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8030881c-52e1-4e0d-811d-d0176e82323c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:15:28.587262 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8030881c-52e1-4e0d-811d-d0176e82323c service nova] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:15:28.608650 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1223/2445] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:15:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:15:32.594780 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f16e4-ba3a-4ae6-85e1-e26d391ba810 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:15:32.595371 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f16e4-ba3a-4ae6-85e1-e26d391ba810 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:15:32.595371 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f16e4-ba3a-4ae6-85e1-e26d391ba810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:15:32.615657 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-667f16e4-ba3a-4ae6-85e1-e26d391ba810 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:15:32.616940 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-667f16e4-ba3a-4ae6-85e1-e26d391ba810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:15:32.626604 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1223/2446] 10.222.0.16 () {58 vars in 1016 bytes} [Thu Sep 29 02:15:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:15:32.648268 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8030881c-52e1-4e0d-811d-d0176e82323c service nova] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:15:32.660294 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8030881c-52e1-4e0d-811d-d0176e82323c service nova] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:15:32.666215 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c2c51e-f6d8-4fb5-af4a-61ab4ab4c6ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3325a7111d447f4a9cf00c672d5420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:15:32.666657 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c2c51e-f6d8-4fb5-af4a-61ab4ab4c6ba service nova] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:15:32.666962 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c2c51e-f6d8-4fb5-af4a-61ab4ab4c6ba service nova] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:15:32.667234 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c2c51e-f6d8-4fb5-af4a-61ab4ab4c6ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:15:32.677708 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c2c51e-f6d8-4fb5-af4a-61ab4ab4c6ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:15:32.677862 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c2c51e-f6d8-4fb5-af4a-61ab4ab4c6ba service nova] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:15:32.688930 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1224/2447] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:15:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:15:39.244609 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87a2fc-75e3-43e7-8089-65b081036e3a None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:15:39.245996 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87a2fc-75e3-43e7-8089-65b081036e3a None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:15:39.246454 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87a2fc-75e3-43e7-8089-65b081036e3a None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:15:39.247904 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1224/2448] 10.222.0.49 () {54 vars in 921 bytes} [Thu Sep 29 02:15:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 29 02:15:39.253864 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49773771-7902-42f0-ac1f-1b971dbb7dde None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:15:39.254344 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49773771-7902-42f0-ac1f-1b971dbb7dde None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:15:39.254543 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49773771-7902-42f0-ac1f-1b971dbb7dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:15:39.276530 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-49773771-7902-42f0-ac1f-1b971dbb7dde None None] MFA Rules not processed for user `f3325a7111d447f4a9cf00c672d5420f`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:15:39.278176 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-49773771-7902-42f0-ac1f-1b971dbb7dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:15:39.287629 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1225/2449] 10.222.0.49 () {58 vars in 1018 bytes} [Thu Sep 29 02:15:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 29 02:15:39.300027 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a87a2fc-75e3-43e7-8089-65b081036e3a None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:15:39.301778 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-2a87a2fc-75e3-43e7-8089-65b081036e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:15:39.363149 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a87a2fc-75e3-43e7-8089-65b081036e3a None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:15:39.366731 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95ba278-54e5-48b4-b7d4-8f04ea0bcdc4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d36669146554031ba8596cb583cd6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:15:39.367346 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ba278-54e5-48b4-b7d4-8f04ea0bcdc4 service glance] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:15:39.367626 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ba278-54e5-48b4-b7d4-8f04ea0bcdc4 service glance] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:15:39.367900 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ba278-54e5-48b4-b7d4-8f04ea0bcdc4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:15:39.379190 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95ba278-54e5-48b4-b7d4-8f04ea0bcdc4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:15:39.380687 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95ba278-54e5-48b4-b7d4-8f04ea0bcdc4 service glance] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:15:39.392864 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1225/2450] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:15:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:15:39.468340 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea48a03-aa0e-4eef-af39-5bc6c33ba366 None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:15:39.468622 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea48a03-aa0e-4eef-af39-5bc6c33ba366 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:15:39.468891 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea48a03-aa0e-4eef-af39-5bc6c33ba366 None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:15:39.470254 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1226/2451] 10.222.0.49 () {54 vars in 921 bytes} [Thu Sep 29 02:15:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:15:39.474971 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f796fb40-6fbc-4518-a5a2-db1adedf805f None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:15:39.475255 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f796fb40-6fbc-4518-a5a2-db1adedf805f None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:15:39.475551 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f796fb40-6fbc-4518-a5a2-db1adedf805f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:15:39.495212 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-f796fb40-6fbc-4518-a5a2-db1adedf805f None None] MFA Rules not processed for user `2053f823bd3c4098a43c299890c1f733`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:15:39.496402 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-f796fb40-6fbc-4518-a5a2-db1adedf805f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:15:39.520823 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:15:39.549752 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1226/2452] 10.222.0.49 () {58 vars in 1018 bytes} [Thu Sep 29 02:15:39 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:15:39.561572 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea48a03-aa0e-4eef-af39-5bc6c33ba366 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:15:39.563221 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-8ea48a03-aa0e-4eef-af39-5bc6c33ba366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:15:39.577008 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea48a03-aa0e-4eef-af39-5bc6c33ba366 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:15:39.580522 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8ff56c-b043-43db-8bf1-92b40e1cfcec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:15:39.581117 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ff56c-b043-43db-8bf1-92b40e1cfcec service neutron] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:15:39.581409 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ff56c-b043-43db-8bf1-92b40e1cfcec service neutron] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:15:39.581677 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ff56c-b043-43db-8bf1-92b40e1cfcec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:15:39.589030 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8ff56c-b043-43db-8bf1-92b40e1cfcec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:15:39.590537 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8ff56c-b043-43db-8bf1-92b40e1cfcec service neutron] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:15:39.598104 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1227/2453] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:15:39 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:15:39.684921 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960329d9-0f38-42a8-b71f-4cb7fbacebee None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:15:39.685200 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960329d9-0f38-42a8-b71f-4cb7fbacebee None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:15:39.685508 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960329d9-0f38-42a8-b71f-4cb7fbacebee None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:15:39.686825 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1227/2454] 10.222.0.49 () {54 vars in 921 bytes} [Thu Sep 29 02:15:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:15:39.692502 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e8fb0-eeb7-4dd7-b7a3-cf36f3ca985e None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:15:39.692787 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e8fb0-eeb7-4dd7-b7a3-cf36f3ca985e None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:15:39.693060 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e8fb0-eeb7-4dd7-b7a3-cf36f3ca985e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:15:39.713205 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-3a8e8fb0-eeb7-4dd7-b7a3-cf36f3ca985e None None] MFA Rules not processed for user `f3325a7111d447f4a9cf00c672d5420f`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:15:39.714541 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-3a8e8fb0-eeb7-4dd7-b7a3-cf36f3ca985e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:15:39.723620 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1228/2455] 10.222.0.49 () {58 vars in 1018 bytes} [Thu Sep 29 02:15:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:15:39.733987 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960329d9-0f38-42a8-b71f-4cb7fbacebee None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:15:39.735773 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-960329d9-0f38-42a8-b71f-4cb7fbacebee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:15:39.749509 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960329d9-0f38-42a8-b71f-4cb7fbacebee None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:15:39.753573 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1c20c9-146f-4cdc-a30c-9036231f9112 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:15:39.754158 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c20c9-146f-4cdc-a30c-9036231f9112 service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:15:39.754431 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c20c9-146f-4cdc-a30c-9036231f9112 service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:15:39.754697 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c20c9-146f-4cdc-a30c-9036231f9112 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:15:39.765508 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1c20c9-146f-4cdc-a30c-9036231f9112 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:15:39.766900 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1c20c9-146f-4cdc-a30c-9036231f9112 service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:15:39.778126 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1228/2456] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:15:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:15:39.912565 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e687d3f3-7941-4eb0-8964-fd8c90e16449 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:15:39.912854 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e687d3f3-7941-4eb0-8964-fd8c90e16449 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:15:39.913127 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e687d3f3-7941-4eb0-8964-fd8c90e16449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:15:39.933995 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-e687d3f3-7941-4eb0-8964-fd8c90e16449 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:15:39.935550 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-e687d3f3-7941-4eb0-8964-fd8c90e16449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:15:39.943532 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1229/2457] 10.222.0.16 () {58 vars in 1016 bytes} [Thu Sep 29 02:15:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:15:39.958408 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1c20c9-146f-4cdc-a30c-9036231f9112 service neutron] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:15:39.970912 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1c20c9-146f-4cdc-a30c-9036231f9112 service neutron] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:15:39.976489 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23003e2a-f80d-4b16-825c-685193463c12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3325a7111d447f4a9cf00c672d5420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:15:39.977135 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23003e2a-f80d-4b16-825c-685193463c12 service nova] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:15:39.977443 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23003e2a-f80d-4b16-825c-685193463c12 service nova] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:15:39.977721 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23003e2a-f80d-4b16-825c-685193463c12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:15:39.986608 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23003e2a-f80d-4b16-825c-685193463c12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:15:39.988157 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23003e2a-f80d-4b16-825c-685193463c12 service nova] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:15:39.997684 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1229/2458] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:15:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:15:44.091264 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a887adf3-2bd8-4d68-8148-0838b15f9f6b None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:15:44.091794 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a887adf3-2bd8-4d68-8148-0838b15f9f6b None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:15:44.091794 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a887adf3-2bd8-4d68-8148-0838b15f9f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:15:44.099973 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:15:44.113382 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-a887adf3-2bd8-4d68-8148-0838b15f9f6b None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:15:44.114600 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-a887adf3-2bd8-4d68-8148-0838b15f9f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:15:44.123015 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1230/2459] 10.222.0.16 () {58 vars in 1016 bytes} [Thu Sep 29 02:15:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:15:44.140599 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23003e2a-f80d-4b16-825c-685193463c12 service nova] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:15:44.153022 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23003e2a-f80d-4b16-825c-685193463c12 service nova] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:15:44.158626 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f28f77-8ee2-43f8-9433-49ad83be13a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3325a7111d447f4a9cf00c672d5420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:15:44.159256 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f28f77-8ee2-43f8-9433-49ad83be13a8 service nova] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:15:44.159534 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f28f77-8ee2-43f8-9433-49ad83be13a8 service nova] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:15:44.159807 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f28f77-8ee2-43f8-9433-49ad83be13a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:15:44.169259 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f28f77-8ee2-43f8-9433-49ad83be13a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:15:44.170858 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f28f77-8ee2-43f8-9433-49ad83be13a8 service nova] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:15:44.180866 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1230/2460] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:15:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:15:45.332776 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd2e225-2a14-493d-9b36-f75eae9b5496 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:15:45.333257 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd2e225-2a14-493d-9b36-f75eae9b5496 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:15:45.333373 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd2e225-2a14-493d-9b36-f75eae9b5496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:15:45.353987 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-6dd2e225-2a14-493d-9b36-f75eae9b5496 None None] MFA Rules not processed for user `0f8f13f302de4701a7f4e0562bca08cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:15:45.355211 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-6dd2e225-2a14-493d-9b36-f75eae9b5496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:15:45.362461 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1231/2461] 10.222.0.49 () {58 vars in 1009 bytes} [Thu Sep 29 02:15:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:15:45.383725 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f28f77-8ee2-43f8-9433-49ad83be13a8 service nova] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:15:45.396061 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f28f77-8ee2-43f8-9433-49ad83be13a8 service nova] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:15:45.401419 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a54644-ccbe-46ca-a0b0-17af8c4b638e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c88bc0f32600416ca7c6a59f4196e497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:15:45.402011 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a54644-ccbe-46ca-a0b0-17af8c4b638e service swift] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:15:45.402402 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a54644-ccbe-46ca-a0b0-17af8c4b638e service swift] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:15:45.402682 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a54644-ccbe-46ca-a0b0-17af8c4b638e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:15:45.411239 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a54644-ccbe-46ca-a0b0-17af8c4b638e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:15:45.412977 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a54644-ccbe-46ca-a0b0-17af8c4b638e service swift] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:15:45.422149 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1231/2462] 10.222.0.49 () {60 vars in 1384 bytes} [Thu Sep 29 02:15:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 29 02:15:55.348730 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=5 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:15:55.418582 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=34 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:16:15.501105 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b12207-5384-4632-9fb1-9cf04c774aaf None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:16:15.501689 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b12207-5384-4632-9fb1-9cf04c774aaf None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:16:15.501689 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b12207-5384-4632-9fb1-9cf04c774aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:16:15.522305 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-20b12207-5384-4632-9fb1-9cf04c774aaf None None] MFA Rules not processed for user `0f8f13f302de4701a7f4e0562bca08cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:16:15.523513 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-20b12207-5384-4632-9fb1-9cf04c774aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:16:15.531445 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1232/2463] 10.222.0.49 () {58 vars in 967 bytes} [Thu Sep 29 02:16:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:16:15.543653 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a54644-ccbe-46ca-a0b0-17af8c4b638e service swift] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:16:15.558395 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a54644-ccbe-46ca-a0b0-17af8c4b638e service swift] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:16:15.564244 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68da97fd-9abc-400d-94b9-cbd55b32ff69 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c88bc0f32600416ca7c6a59f4196e497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:16:15.564828 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da97fd-9abc-400d-94b9-cbd55b32ff69 service swift] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:16:15.565102 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da97fd-9abc-400d-94b9-cbd55b32ff69 service swift] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:16:15.565423 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da97fd-9abc-400d-94b9-cbd55b32ff69 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:16:15.573474 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68da97fd-9abc-400d-94b9-cbd55b32ff69 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:16:15.575350 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68da97fd-9abc-400d-94b9-cbd55b32ff69 service swift] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:16:15.583572 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1232/2464] 10.222.0.49 () {60 vars in 1384 bytes} [Thu Sep 29 02:16:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 29 02:16:20.148031 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d497a659-9e05-4841-88f0-617a01407472 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:16:20.148604 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d497a659-9e05-4841-88f0-617a01407472 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:16:20.148604 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d497a659-9e05-4841-88f0-617a01407472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:16:20.167238 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-d497a659-9e05-4841-88f0-617a01407472 None None] MFA Rules not processed for user `5ffb114119984af78b50f14b9fe3e69a`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:16:20.168433 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-d497a659-9e05-4841-88f0-617a01407472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:16:20.222320 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1233/2465] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:16:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:16:25.580322 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=6 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:16:30.215930 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=28 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:16:36.566927 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b894b5-3b9f-463e-adb4-03b96d146ac0 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:16:36.567466 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b894b5-3b9f-463e-adb4-03b96d146ac0 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:16:36.567466 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b894b5-3b9f-463e-adb4-03b96d146ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:16:36.586592 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-03b894b5-3b9f-463e-adb4-03b96d146ac0 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:16:36.587801 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-03b894b5-3b9f-463e-adb4-03b96d146ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:16:36.596382 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1233/2466] 10.222.0.16 () {58 vars in 1016 bytes} [Thu Sep 29 02:16:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:16:36.610816 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d497a659-9e05-4841-88f0-617a01407472 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:16:36.623432 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d497a659-9e05-4841-88f0-617a01407472 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:16:36.628927 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fcf271-be4d-400d-9bfd-2a604774e235 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3325a7111d447f4a9cf00c672d5420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:16:36.629557 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fcf271-be4d-400d-9bfd-2a604774e235 service nova] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:16:36.629841 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fcf271-be4d-400d-9bfd-2a604774e235 service nova] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:16:36.630113 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fcf271-be4d-400d-9bfd-2a604774e235 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:16:36.638365 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fcf271-be4d-400d-9bfd-2a604774e235 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:16:36.639944 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fcf271-be4d-400d-9bfd-2a604774e235 service nova] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:16:36.649192 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1234/2467] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:16:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:16:39.786734 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b894b5-3b9f-463e-adb4-03b96d146ac0 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:16:39.788128 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-03b894b5-3b9f-463e-adb4-03b96d146ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:16:39.847036 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b894b5-3b9f-463e-adb4-03b96d146ac0 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:16:39.850655 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba48db52-754e-468f-b72a-dadbbc45e786 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75135b856134ba4b9ccac337886f682', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:16:39.851255 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba48db52-754e-468f-b72a-dadbbc45e786 service cinder] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:16:39.851536 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba48db52-754e-468f-b72a-dadbbc45e786 service cinder] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:16:39.851801 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba48db52-754e-468f-b72a-dadbbc45e786 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:16:39.853616 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-ba48db52-754e-468f-b72a-dadbbc45e786 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:16:39.866806 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba48db52-754e-468f-b72a-dadbbc45e786 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:16:39.868206 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba48db52-754e-468f-b72a-dadbbc45e786 service cinder] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:16:39.878945 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1234/2468] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:16:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:16:40.874058 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2898912d-39d0-4f39-bda2-731f72073b2f None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:16:40.874583 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2898912d-39d0-4f39-bda2-731f72073b2f None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:16:40.874583 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2898912d-39d0-4f39-bda2-731f72073b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:16:40.893780 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-2898912d-39d0-4f39-bda2-731f72073b2f None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:16:40.894990 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-2898912d-39d0-4f39-bda2-731f72073b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:16:40.903087 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1235/2469] 10.222.0.16 () {58 vars in 1016 bytes} [Thu Sep 29 02:16:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:16:40.941065 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba48db52-754e-468f-b72a-dadbbc45e786 service cinder] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:16:40.952794 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba48db52-754e-468f-b72a-dadbbc45e786 service cinder] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:16:40.958289 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6905cc-7756-489c-a22e-dac7f446620a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3325a7111d447f4a9cf00c672d5420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:16:40.958881 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6905cc-7756-489c-a22e-dac7f446620a service nova] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:16:40.959159 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6905cc-7756-489c-a22e-dac7f446620a service nova] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:16:40.959429 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6905cc-7756-489c-a22e-dac7f446620a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:16:40.971494 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6905cc-7756-489c-a22e-dac7f446620a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:16:40.973739 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6905cc-7756-489c-a22e-dac7f446620a service nova] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:16:40.984556 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1235/2470] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:16:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:16:44.720395 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2898912d-39d0-4f39-bda2-731f72073b2f None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:16:44.730431 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2898912d-39d0-4f39-bda2-731f72073b2f None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:16:44.734279 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f36c149-1642-442e-823a-1e273e1f9839 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:16:44.734883 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36c149-1642-442e-823a-1e273e1f9839 service neutron] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:16:44.735160 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36c149-1642-442e-823a-1e273e1f9839 service neutron] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:16:44.735428 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36c149-1642-442e-823a-1e273e1f9839 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:16:44.737144 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-3f36c149-1642-442e-823a-1e273e1f9839 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:16:44.751537 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f36c149-1642-442e-823a-1e273e1f9839 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:16:44.753368 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f36c149-1642-442e-823a-1e273e1f9839 service neutron] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:16:44.767019 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1236/2471] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:16:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:16:44.993702 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c2eb1f-2be3-48dc-a84c-370d023efaa1 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:16:44.994175 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c2eb1f-2be3-48dc-a84c-370d023efaa1 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:16:44.994274 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c2eb1f-2be3-48dc-a84c-370d023efaa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:16:45.015068 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-c9c2eb1f-2be3-48dc-a84c-370d023efaa1 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:16:45.016273 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-c9c2eb1f-2be3-48dc-a84c-370d023efaa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:16:45.024327 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1236/2472] 10.222.0.16 () {58 vars in 1016 bytes} [Thu Sep 29 02:16:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:16:45.040284 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f36c149-1642-442e-823a-1e273e1f9839 service neutron] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:16:45.052197 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f36c149-1642-442e-823a-1e273e1f9839 service neutron] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:16:45.057582 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61e07b5-056a-4be1-90eb-5a5d12759fcc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3325a7111d447f4a9cf00c672d5420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:16:45.058165 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61e07b5-056a-4be1-90eb-5a5d12759fcc service nova] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:16:45.058441 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61e07b5-056a-4be1-90eb-5a5d12759fcc service nova] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:16:45.058707 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61e07b5-056a-4be1-90eb-5a5d12759fcc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:16:45.068667 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61e07b5-056a-4be1-90eb-5a5d12759fcc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:16:45.070951 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61e07b5-056a-4be1-90eb-5a5d12759fcc service nova] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:16:45.082495 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1237/2473] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:16:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:16:49.177296 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c8486-d639-41e3-8463-e7aa5c227943 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:16:49.177829 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c8486-d639-41e3-8463-e7aa5c227943 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:16:49.177937 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c8486-d639-41e3-8463-e7aa5c227943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:16:49.197501 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-a36c8486-d639-41e3-8463-e7aa5c227943 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:16:49.198698 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-a36c8486-d639-41e3-8463-e7aa5c227943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:16:49.207153 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1237/2474] 10.222.0.16 () {58 vars in 1016 bytes} [Thu Sep 29 02:16:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:16:49.226378 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61e07b5-056a-4be1-90eb-5a5d12759fcc service nova] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:16:49.237509 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61e07b5-056a-4be1-90eb-5a5d12759fcc service nova] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:16:49.243192 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db66fc8f-18aa-40af-99e6-9940cc8fda80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3325a7111d447f4a9cf00c672d5420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:16:49.243790 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db66fc8f-18aa-40af-99e6-9940cc8fda80 service nova] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:16:49.244070 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db66fc8f-18aa-40af-99e6-9940cc8fda80 service nova] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:16:49.244342 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db66fc8f-18aa-40af-99e6-9940cc8fda80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:16:49.253458 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db66fc8f-18aa-40af-99e6-9940cc8fda80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:16:49.255031 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db66fc8f-18aa-40af-99e6-9940cc8fda80 service nova] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:16:49.265546 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1238/2475] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:16:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:16:54.401830 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e5774-7be6-4c49-b7e8-1d9ab62621b6 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:16:54.402311 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e5774-7be6-4c49-b7e8-1d9ab62621b6 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:16:54.402916 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e5774-7be6-4c49-b7e8-1d9ab62621b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:16:54.422517 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-713e5774-7be6-4c49-b7e8-1d9ab62621b6 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:16:54.423791 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-713e5774-7be6-4c49-b7e8-1d9ab62621b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:16:54.431871 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1238/2476] 10.222.0.16 () {58 vars in 1016 bytes} [Thu Sep 29 02:16:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:16:54.455348 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db66fc8f-18aa-40af-99e6-9940cc8fda80 service nova] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:16:54.467653 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db66fc8f-18aa-40af-99e6-9940cc8fda80 service nova] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:16:54.473072 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9c3d93-e0d0-4763-aafd-e1e727d36149 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3325a7111d447f4a9cf00c672d5420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:16:54.473689 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c3d93-e0d0-4763-aafd-e1e727d36149 service nova] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:16:54.474053 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c3d93-e0d0-4763-aafd-e1e727d36149 service nova] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:16:54.475240 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c3d93-e0d0-4763-aafd-e1e727d36149 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:16:54.486622 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9c3d93-e0d0-4763-aafd-e1e727d36149 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:16:54.488221 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9c3d93-e0d0-4763-aafd-e1e727d36149 service nova] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:16:54.497553 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1239/2477] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:16:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:16:56.531766 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713e5774-7be6-4c49-b7e8-1d9ab62621b6 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:16:56.544724 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713e5774-7be6-4c49-b7e8-1d9ab62621b6 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:16:56.550407 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abc763d-5353-461f-be92-ee0c67d6683b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3325a7111d447f4a9cf00c672d5420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:16:56.551010 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abc763d-5353-461f-be92-ee0c67d6683b service nova] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:16:56.551288 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abc763d-5353-461f-be92-ee0c67d6683b service nova] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:16:56.551558 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abc763d-5353-461f-be92-ee0c67d6683b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:16:56.553472 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-1abc763d-5353-461f-be92-ee0c67d6683b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:16:56.618683 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abc763d-5353-461f-be92-ee0c67d6683b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:16:56.620361 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abc763d-5353-461f-be92-ee0c67d6683b service nova] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:16:56.630091 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1239/2478] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:16:56 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:17:01.828349 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9c3d93-e0d0-4763-aafd-e1e727d36149 service nova] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:17:01.834162 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=34 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:17:01.841518 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9c3d93-e0d0-4763-aafd-e1e727d36149 service nova] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:17:01.847611 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed25bad-1375-4d3b-8b77-beedb1ccb439 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3325a7111d447f4a9cf00c672d5420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:17:01.848244 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed25bad-1375-4d3b-8b77-beedb1ccb439 service nova] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:17:01.848526 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed25bad-1375-4d3b-8b77-beedb1ccb439 service nova] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:17:01.848790 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed25bad-1375-4d3b-8b77-beedb1ccb439 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:17:01.850506 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-aed25bad-1375-4d3b-8b77-beedb1ccb439 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:17:01.928898 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed25bad-1375-4d3b-8b77-beedb1ccb439 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:17:01.930518 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed25bad-1375-4d3b-8b77-beedb1ccb439 service nova] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:17:01.940427 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1240/2479] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:17:01 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:17:06.625577 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=72 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:17:11.233593 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a1498e-6288-4098-820a-1fbadf710aa2 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:17:11.234205 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a1498e-6288-4098-820a-1fbadf710aa2 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:17:11.234205 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a1498e-6288-4098-820a-1fbadf710aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:17:11.255202 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-c3a1498e-6288-4098-820a-1fbadf710aa2 None None] MFA Rules not processed for user `f167598e4a354a21b89825f2cbe8ff2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:17:11.256563 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-c3a1498e-6288-4098-820a-1fbadf710aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:17:11.265175 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1240/2480] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:17:11 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:17:11.536647 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed25bad-1375-4d3b-8b77-beedb1ccb439 service nova] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:17:11.548499 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed25bad-1375-4d3b-8b77-beedb1ccb439 service nova] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:17:11.552964 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc03e26f-63fb-447a-933a-23b8daaee05e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:17:11.553755 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc03e26f-63fb-447a-933a-23b8daaee05e service neutron] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:17:11.553968 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc03e26f-63fb-447a-933a-23b8daaee05e service neutron] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:17:11.554176 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc03e26f-63fb-447a-933a-23b8daaee05e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:17:11.556255 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-bc03e26f-63fb-447a-933a-23b8daaee05e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:17:11.567392 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc03e26f-63fb-447a-933a-23b8daaee05e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:17:11.569198 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc03e26f-63fb-447a-933a-23b8daaee05e service neutron] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:17:11.579862 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1241/2481] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:17:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:17:19.472351 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a1498e-6288-4098-820a-1fbadf710aa2 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:17:19.487993 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a1498e-6288-4098-820a-1fbadf710aa2 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:17:19.495840 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b92b02a-47ea-4c2e-948a-a66f9b50e2fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3325a7111d447f4a9cf00c672d5420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:17:19.496567 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b92b02a-47ea-4c2e-948a-a66f9b50e2fb service nova] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:17:19.497698 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b92b02a-47ea-4c2e-948a-a66f9b50e2fb service nova] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:17:19.498174 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b92b02a-47ea-4c2e-948a-a66f9b50e2fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:17:19.500626 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-0b92b02a-47ea-4c2e-948a-a66f9b50e2fb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:17:19.508115 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc03e26f-63fb-447a-933a-23b8daaee05e service neutron] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:17:19.519379 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b92b02a-47ea-4c2e-948a-a66f9b50e2fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:17:19.521495 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b92b02a-47ea-4c2e-948a-a66f9b50e2fb service nova] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:17:19.533247 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc03e26f-63fb-447a-933a-23b8daaee05e service neutron] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:17:19.538334 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1241/2482] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:17:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:17:19.562152 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68189a8b-c2be-45de-9b4c-b1bcb2a42026 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3325a7111d447f4a9cf00c672d5420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:17:19.562788 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68189a8b-c2be-45de-9b4c-b1bcb2a42026 service nova] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:17:19.563063 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68189a8b-c2be-45de-9b4c-b1bcb2a42026 service nova] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:17:19.563325 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68189a8b-c2be-45de-9b4c-b1bcb2a42026 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:17:19.569643 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-68189a8b-c2be-45de-9b4c-b1bcb2a42026 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:17:19.612745 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68189a8b-c2be-45de-9b4c-b1bcb2a42026 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:17:19.615026 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68189a8b-c2be-45de-9b4c-b1bcb2a42026 service nova] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:17:19.634007 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1242/2483] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:17:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 29 02:17:22.865002 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a35c47-73a2-46bf-866f-57b537b0b9a0 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:17:22.865533 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a35c47-73a2-46bf-866f-57b537b0b9a0 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:17:22.865647 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a35c47-73a2-46bf-866f-57b537b0b9a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:17:22.885564 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-b6a35c47-73a2-46bf-866f-57b537b0b9a0 None None] MFA Rules not processed for user `f68a35fdeeea469f873ec50671fc35f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:17:22.886771 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-b6a35c47-73a2-46bf-866f-57b537b0b9a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:17:22.893579 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1242/2484] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:17:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:17:23.204858 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68189a8b-c2be-45de-9b4c-b1bcb2a42026 service nova] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:17:23.214938 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68189a8b-c2be-45de-9b4c-b1bcb2a42026 service nova] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:17:23.219018 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33fdcb1-b636-4e18-b87d-79dd88365b15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:17:23.219651 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33fdcb1-b636-4e18-b87d-79dd88365b15 service neutron] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:17:23.219960 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33fdcb1-b636-4e18-b87d-79dd88365b15 service neutron] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:17:23.220239 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33fdcb1-b636-4e18-b87d-79dd88365b15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:17:23.222013 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-a33fdcb1-b636-4e18-b87d-79dd88365b15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:17:23.231882 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33fdcb1-b636-4e18-b87d-79dd88365b15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:17:23.233300 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33fdcb1-b636-4e18-b87d-79dd88365b15 service neutron] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:17:23.241335 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1243/2485] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:17:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:17:23.557925 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a35c47-73a2-46bf-866f-57b537b0b9a0 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:17:23.559346 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-b6a35c47-73a2-46bf-866f-57b537b0b9a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:17:23.631818 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a35c47-73a2-46bf-866f-57b537b0b9a0 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:17:23.637889 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a0ce78-d5e5-48aa-8b32-1918d3b8b676 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cbb39731a6b42e2a6647d6134b5c7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:17:23.638500 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a0ce78-d5e5-48aa-8b32-1918d3b8b676 service placement] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:17:23.638780 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a0ce78-d5e5-48aa-8b32-1918d3b8b676 service placement] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:17:23.639052 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a0ce78-d5e5-48aa-8b32-1918d3b8b676 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:17:23.640875 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-d8a0ce78-d5e5-48aa-8b32-1918d3b8b676 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:17:23.652596 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a0ce78-d5e5-48aa-8b32-1918d3b8b676 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:17:23.654211 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a0ce78-d5e5-48aa-8b32-1918d3b8b676 service placement] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:17:23.665003 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1243/2486] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:17:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:17:32.661520 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33fdcb1-b636-4e18-b87d-79dd88365b15 service neutron] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:17:32.671831 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=46 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:17:32.681077 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33fdcb1-b636-4e18-b87d-79dd88365b15 service neutron] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:17:32.689690 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de6f02f-620d-4882-98c0-0a3ebe56b587 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3325a7111d447f4a9cf00c672d5420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:17:32.690407 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de6f02f-620d-4882-98c0-0a3ebe56b587 service nova] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:17:32.690782 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de6f02f-620d-4882-98c0-0a3ebe56b587 service nova] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:17:32.691110 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de6f02f-620d-4882-98c0-0a3ebe56b587 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:17:32.693064 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-0de6f02f-620d-4882-98c0-0a3ebe56b587 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:17:32.706318 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de6f02f-620d-4882-98c0-0a3ebe56b587 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:17:32.707920 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de6f02f-620d-4882-98c0-0a3ebe56b587 service nova] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:17:32.719708 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1244/2487] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:17:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:17:33.155651 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919173fc-4689-47e8-83fd-8b34448d23cf None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:17:33.156192 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919173fc-4689-47e8-83fd-8b34448d23cf None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:17:33.156192 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919173fc-4689-47e8-83fd-8b34448d23cf None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:17:33.157578 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1244/2488] 10.222.0.49 () {54 vars in 921 bytes} [Thu Sep 29 02:17:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:17:33.206776 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7ce38e-a86f-43cf-bb9d-143271f1f961 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:17:33.207356 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7ce38e-a86f-43cf-bb9d-143271f1f961 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:17:33.207621 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7ce38e-a86f-43cf-bb9d-143271f1f961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:17:33.227537 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-5b7ce38e-a86f-43cf-bb9d-143271f1f961 None None] MFA Rules not processed for user `3cbb39731a6b42e2a6647d6134b5c7cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:17:33.228779 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-5b7ce38e-a86f-43cf-bb9d-143271f1f961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:17:33.239661 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1245/2489] 10.222.0.49 () {58 vars in 1018 bytes} [Thu Sep 29 02:17:33 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:17:33.254545 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919173fc-4689-47e8-83fd-8b34448d23cf None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:17:33.255150 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7ce38e-a86f-43cf-bb9d-143271f1f961 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:17:33.256323 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-919173fc-4689-47e8-83fd-8b34448d23cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:17:33.256657 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-5b7ce38e-a86f-43cf-bb9d-143271f1f961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:17:33.271348 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7ce38e-a86f-43cf-bb9d-143271f1f961 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:17:33.275942 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f637e48a-42b7-4d34-ac6f-da7c5803008b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:17:33.276485 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919173fc-4689-47e8-83fd-8b34448d23cf None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:17:33.276721 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f637e48a-42b7-4d34-ac6f-da7c5803008b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:17:33.276996 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f637e48a-42b7-4d34-ac6f-da7c5803008b admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:17:33.277289 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f637e48a-42b7-4d34-ac6f-da7c5803008b admin admin] PATH_INFO: `/v3/users/5ffb114119984af78b50f14b9fe3e69a` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:17:33.278433 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f637e48a-42b7-4d34-ac6f-da7c5803008b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ffb114119984af78b50f14b9fe3e69a)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:17:33.280310 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f637e48a-42b7-4d34-ac6f-da7c5803008b admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:17:33.281517 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd20df13-cae5-416d-849c-056e9ef9b5db service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cbb39731a6b42e2a6647d6134b5c7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:17:33.282116 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd20df13-cae5-416d-849c-056e9ef9b5db service placement] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:17:33.282460 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd20df13-cae5-416d-849c-056e9ef9b5db service placement] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:17:33.282777 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd20df13-cae5-416d-849c-056e9ef9b5db service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:17:33.292102 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd20df13-cae5-416d-849c-056e9ef9b5db service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:17:33.293717 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd20df13-cae5-416d-849c-056e9ef9b5db service placement] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:17:33.303804 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1245/2490] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:17:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:17:33.329196 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-f637e48a-42b7-4d34-ac6f-da7c5803008b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ffb114119984af78b50f14b9fe3e69a'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:17:33.329880 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-f637e48a-42b7-4d34-ac6f-da7c5803008b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ffb114119984af78b50f14b9fe3e69a'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:17:33.344358 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-f637e48a-42b7-4d34-ac6f-da7c5803008b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ffb114119984af78b50f14b9fe3e69a'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:17:33.351996 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-f637e48a-42b7-4d34-ac6f-da7c5803008b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ffb114119984af78b50f14b9fe3e69a'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:17:33.352789 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-f637e48a-42b7-4d34-ac6f-da7c5803008b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ffb114119984af78b50f14b9fe3e69a'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:17:33.365055 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1246/2491] 10.222.0.49 () {58 vars in 1224 bytes} [Thu Sep 29 02:17:33 2022] DELETE /identity/v3/users/5ffb114119984af78b50f14b9fe3e69a => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:17:33.534496 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd20df13-cae5-416d-849c-056e9ef9b5db service placement] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:17:33.549552 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd20df13-cae5-416d-849c-056e9ef9b5db service placement] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:17:33.607657 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba02b3f-d7bc-42ee-8e72-732ecf6e10b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:17:33.608286 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba02b3f-d7bc-42ee-8e72-732ecf6e10b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:17:33.608566 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba02b3f-d7bc-42ee-8e72-732ecf6e10b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:17:33.608837 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba02b3f-d7bc-42ee-8e72-732ecf6e10b4 admin admin] PATH_INFO: `/v3/projects/342119cedbac4ca9b7ac5c1cd5481823` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:17:33.610050 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba02b3f-d7bc-42ee-8e72-732ecf6e10b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=342119cedbac4ca9b7ac5c1cd5481823)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:17:33.611960 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba02b3f-d7bc-42ee-8e72-732ecf6e10b4 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:17:33.657522 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-bba02b3f-d7bc-42ee-8e72-732ecf6e10b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '342119cedbac4ca9b7ac5c1cd5481823', 'request_id': 'req-bba02b3f-d7bc-42ee-8e72-732ecf6e10b4'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:17:33.659451 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:17:33.664661 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-bba02b3f-d7bc-42ee-8e72-732ecf6e10b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '342119cedbac4ca9b7ac5c1cd5481823', 'request_id': 'req-bba02b3f-d7bc-42ee-8e72-732ecf6e10b4'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:17:33.673301 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-bba02b3f-d7bc-42ee-8e72-732ecf6e10b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '342119cedbac4ca9b7ac5c1cd5481823', 'request_id': 'req-bba02b3f-d7bc-42ee-8e72-732ecf6e10b4'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:17:33.684056 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-bba02b3f-d7bc-42ee-8e72-732ecf6e10b4 admin admin] The token cache is being invalidate because project 342119cedbac4ca9b7ac5c1cd5481823 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81649) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:17:33.684341 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-bba02b3f-d7bc-42ee-8e72-732ecf6e10b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:17:33.684967 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-bba02b3f-d7bc-42ee-8e72-732ecf6e10b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:17:33.686492 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1246/2492] 10.222.0.49 () {58 vars in 1233 bytes} [Thu Sep 29 02:17:33 2022] DELETE /identity/v3/projects/342119cedbac4ca9b7ac5c1cd5481823 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:17:33.691569 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f39285-7d34-4210-a400-264fea00b6d6 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:17:33.692093 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f39285-7d34-4210-a400-264fea00b6d6 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:17:33.692201 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f39285-7d34-4210-a400-264fea00b6d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:17:33.711455 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-02f39285-7d34-4210-a400-264fea00b6d6 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:17:33.712633 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-02f39285-7d34-4210-a400-264fea00b6d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:17:33.770903 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1247/2493] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:17:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:17:33.780306 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db390e92-a946-4919-8495-99e97098ecf0 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:17:33.780592 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db390e92-a946-4919-8495-99e97098ecf0 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:17:33.780867 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db390e92-a946-4919-8495-99e97098ecf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:17:33.802027 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-db390e92-a946-4919-8495-99e97098ecf0 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:17:33.803298 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-db390e92-a946-4919-8495-99e97098ecf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:17:33.811890 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1247/2494] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:17:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:17:33.816448 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f39285-7d34-4210-a400-264fea00b6d6 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:17:33.826111 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f39285-7d34-4210-a400-264fea00b6d6 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:17:33.830590 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ee0ee0-decc-4092-8286-23e5a87735b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:17:33.831179 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee0ee0-decc-4092-8286-23e5a87735b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:17:33.831453 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee0ee0-decc-4092-8286-23e5a87735b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:17:33.831715 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee0ee0-decc-4092-8286-23e5a87735b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:17:33.832350 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ee0ee0-decc-4092-8286-23e5a87735b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:17:33.832642 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ee0ee0-decc-4092-8286-23e5a87735b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:17:33.834271 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ee0ee0-decc-4092-8286-23e5a87735b2 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:17:33.846688 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1248/2495] 10.222.0.49 () {58 vars in 1153 bytes} [Thu Sep 29 02:17:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:17:33.851003 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db390e92-a946-4919-8495-99e97098ecf0 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:17:33.860784 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db390e92-a946-4919-8495-99e97098ecf0 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:17:33.865413 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e133f7cc-2044-43c2-ba5a-c1f94fc3e042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:17:33.866006 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e133f7cc-2044-43c2-ba5a-c1f94fc3e042 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:17:33.866282 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e133f7cc-2044-43c2-ba5a-c1f94fc3e042 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:17:33.866548 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e133f7cc-2044-43c2-ba5a-c1f94fc3e042 admin admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:17:33.867176 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e133f7cc-2044-43c2-ba5a-c1f94fc3e042 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:17:33.869072 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e133f7cc-2044-43c2-ba5a-c1f94fc3e042 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:17:33.894608 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1248/2496] 10.222.0.49 () {60 vars in 1153 bytes} [Thu Sep 29 02:17:33 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:17:33.898799 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ee0ee0-decc-4092-8286-23e5a87735b2 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:17:33.914229 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ee0ee0-decc-4092-8286-23e5a87735b2 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:17:33.954687 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:17:33.973488 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58791f57-97fa-4d65-9be5-ff3289062cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:17:33.974121 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58791f57-97fa-4d65-9be5-ff3289062cd5 admin admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:17:33.974399 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58791f57-97fa-4d65-9be5-ff3289062cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:17:33.974683 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58791f57-97fa-4d65-9be5-ff3289062cd5 admin admin] PATH_INFO: `/v3/users` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:17:33.975525 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58791f57-97fa-4d65-9be5-ff3289062cd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:17:33.977919 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58791f57-97fa-4d65-9be5-ff3289062cd5 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:17:34.003312 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1249/2497] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 02:17:33 2022] POST /identity/v3/users => generated 287 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:17:34.008090 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e133f7cc-2044-43c2-ba5a-c1f94fc3e042 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:17:34.019269 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e133f7cc-2044-43c2-ba5a-c1f94fc3e042 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:17:34.023922 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebb6113-14a3-4315-8dfc-af8e99b54831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:17:34.024518 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebb6113-14a3-4315-8dfc-af8e99b54831 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:17:34.024803 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebb6113-14a3-4315-8dfc-af8e99b54831 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:17:34.025056 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebb6113-14a3-4315-8dfc-af8e99b54831 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:17:34.026221 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebb6113-14a3-4315-8dfc-af8e99b54831 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:17:34.027804 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebb6113-14a3-4315-8dfc-af8e99b54831 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:17:34.038796 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1249/2498] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:17:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 29 02:17:34.043663 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58791f57-97fa-4d65-9be5-ff3289062cd5 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:17:34.053871 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58791f57-97fa-4d65-9be5-ff3289062cd5 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:17:34.059137 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3350d50-258f-427c-ab7a-cd467c563041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:17:34.059748 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3350d50-258f-427c-ab7a-cd467c563041 admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:17:34.060027 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3350d50-258f-427c-ab7a-cd467c563041 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:17:34.060293 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3350d50-258f-427c-ab7a-cd467c563041 admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:17:34.060933 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3350d50-258f-427c-ab7a-cd467c563041 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:17:34.062616 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3350d50-258f-427c-ab7a-cd467c563041 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:17:34.074138 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1250/2499] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:17:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:17:34.078032 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebb6113-14a3-4315-8dfc-af8e99b54831 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:17:34.088832 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebb6113-14a3-4315-8dfc-af8e99b54831 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:17:34.093873 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d582ab74-07fd-4a6f-b195-9e183d909d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:17:34.094516 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d582ab74-07fd-4a6f-b195-9e183d909d05 admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:17:34.094793 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d582ab74-07fd-4a6f-b195-9e183d909d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:17:34.095056 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d582ab74-07fd-4a6f-b195-9e183d909d05 admin admin] PATH_INFO: `/v3/projects/df0405453f304b0091c0d9eda1c17725/users/81b66c402e9b426394c273175f4b5fca/roles/f157f905c9c94ccfbfb46e52d443e8f2` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:17:34.110684 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d582ab74-07fd-4a6f-b195-9e183d909d05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df0405453f304b0091c0d9eda1c17725, user_id=81b66c402e9b426394c273175f4b5fca, role_id=f157f905c9c94ccfbfb46e52d443e8f2)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:17:34.113448 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d582ab74-07fd-4a6f-b195-9e183d909d05 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:17:34.127487 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1250/2500] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:17:34 2022] PUT /identity/v3/projects/df0405453f304b0091c0d9eda1c17725/users/81b66c402e9b426394c273175f4b5fca/roles/f157f905c9c94ccfbfb46e52d443e8f2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:17:34.132469 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de613f1-7245-4df2-a3e8-06793c65a50b None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:17:34.132767 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de613f1-7245-4df2-a3e8-06793c65a50b None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:17:34.133041 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de613f1-7245-4df2-a3e8-06793c65a50b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:17:34.153185 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-4de613f1-7245-4df2-a3e8-06793c65a50b None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:17:34.154426 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-4de613f1-7245-4df2-a3e8-06793c65a50b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:17:34.211588 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1251/2501] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:17:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:17:34.222038 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d582ab74-07fd-4a6f-b195-9e183d909d05 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:17:34.224018 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-d582ab74-07fd-4a6f-b195-9e183d909d05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:17:34.282129 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d582ab74-07fd-4a6f-b195-9e183d909d05 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:17:34.285786 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c66beb-e621-4833-99c8-e8e4d030832a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:17:34.286386 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c66beb-e621-4833-99c8-e8e4d030832a service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:17:34.286660 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c66beb-e621-4833-99c8-e8e4d030832a service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:17:34.286929 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c66beb-e621-4833-99c8-e8e4d030832a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:17:34.295705 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c66beb-e621-4833-99c8-e8e4d030832a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:17:34.297118 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c66beb-e621-4833-99c8-e8e4d030832a service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:17:34.306421 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1251/2502] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:17:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:17:35.740880 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de613f1-7245-4df2-a3e8-06793c65a50b None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:17:35.743596 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-4de613f1-7245-4df2-a3e8-06793c65a50b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:17:35.864825 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de613f1-7245-4df2-a3e8-06793c65a50b None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:17:35.875736 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efad7c1-add4-409f-896e-cd01c1925de4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3325a7111d447f4a9cf00c672d5420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:17:35.876589 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efad7c1-add4-409f-896e-cd01c1925de4 service nova] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:17:35.876867 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efad7c1-add4-409f-896e-cd01c1925de4 service nova] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:17:35.877136 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efad7c1-add4-409f-896e-cd01c1925de4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:17:35.878929 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-5efad7c1-add4-409f-896e-cd01c1925de4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:17:35.945848 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efad7c1-add4-409f-896e-cd01c1925de4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:17:35.948401 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efad7c1-add4-409f-896e-cd01c1925de4 service nova] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:17:35.952148 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:17:35.965525 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1252/2503] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:17:35 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:17:38.830823 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424907fd-1ed9-4dc9-89ae-384aabb8bce5 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:17:38.832768 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424907fd-1ed9-4dc9-89ae-384aabb8bce5 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:17:38.833202 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424907fd-1ed9-4dc9-89ae-384aabb8bce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:17:38.866818 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-424907fd-1ed9-4dc9-89ae-384aabb8bce5 None None] MFA Rules not processed for user `81b66c402e9b426394c273175f4b5fca`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:17:38.868126 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-424907fd-1ed9-4dc9-89ae-384aabb8bce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:17:38.943932 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1252/2504] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:17:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:17:38.949224 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efad7c1-add4-409f-896e-cd01c1925de4 service nova] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:17:38.972918 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efad7c1-add4-409f-896e-cd01c1925de4 service nova] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:17:38.985418 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b36718-d9ca-4619-8873-024a5590392d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:17:38.986044 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b36718-d9ca-4619-8873-024a5590392d admin admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:17:38.986324 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b36718-d9ca-4619-8873-024a5590392d admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:17:38.986597 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b36718-d9ca-4619-8873-024a5590392d admin admin] PATH_INFO: `/v3/projects` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:17:38.987241 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b36718-d9ca-4619-8873-024a5590392d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:17:38.989147 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b36718-d9ca-4619-8873-024a5590392d admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:17:39.043749 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424907fd-1ed9-4dc9-89ae-384aabb8bce5 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:17:39.051243 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1253/2505] 10.222.0.49 () {60 vars in 1153 bytes} [Thu Sep 29 02:17:38 2022] POST /identity/v3/projects => generated 369 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:17:39.057621 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424907fd-1ed9-4dc9-89ae-384aabb8bce5 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:17:39.065007 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:17:39.147184 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e1fb81-af93-44a0-95a3-e1f0bbb4a926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:17:39.148177 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e1fb81-af93-44a0-95a3-e1f0bbb4a926 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:17:39.148459 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e1fb81-af93-44a0-95a3-e1f0bbb4a926 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:17:39.148732 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e1fb81-af93-44a0-95a3-e1f0bbb4a926 admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:17:39.154086 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e1fb81-af93-44a0-95a3-e1f0bbb4a926 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:17:39.156490 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e1fb81-af93-44a0-95a3-e1f0bbb4a926 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:17:39.191313 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1253/2506] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 02:17:39 2022] POST /identity/v3/users => generated 291 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 29 02:17:39.192591 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b36718-d9ca-4619-8873-024a5590392d admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:17:39.215688 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b36718-d9ca-4619-8873-024a5590392d admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:17:39.221432 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43445c51-43ca-4a18-a307-eb425d6c53cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:17:39.222247 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43445c51-43ca-4a18-a307-eb425d6c53cc admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:17:39.223214 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43445c51-43ca-4a18-a307-eb425d6c53cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:17:39.223650 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43445c51-43ca-4a18-a307-eb425d6c53cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:17:39.224505 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43445c51-43ca-4a18-a307-eb425d6c53cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:17:39.226330 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43445c51-43ca-4a18-a307-eb425d6c53cc admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:17:39.246303 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1254/2507] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:17:39 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:17:39.250156 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e1fb81-af93-44a0-95a3-e1f0bbb4a926 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:17:39.265382 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e1fb81-af93-44a0-95a3-e1f0bbb4a926 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:17:39.271156 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90c3a17-7e1a-4e02-a3a0-b358b3417bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:17:39.272756 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c3a17-7e1a-4e02-a3a0-b358b3417bbd admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:17:39.272999 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c3a17-7e1a-4e02-a3a0-b358b3417bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:17:39.273389 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c3a17-7e1a-4e02-a3a0-b358b3417bbd admin admin] PATH_INFO: `/v3/projects/f024de3be4b546368070c6bde987fcb3/users/9f4418744cfb4628816d23bf5856695e/roles/fe9bbc67742f4f5893f39b18eb31d59a` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:17:39.302671 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90c3a17-7e1a-4e02-a3a0-b358b3417bbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=f024de3be4b546368070c6bde987fcb3, user_id=9f4418744cfb4628816d23bf5856695e, role_id=fe9bbc67742f4f5893f39b18eb31d59a)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:17:39.305427 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90c3a17-7e1a-4e02-a3a0-b358b3417bbd admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:17:39.332156 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1254/2508] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:17:39 2022] PUT /identity/v3/projects/f024de3be4b546368070c6bde987fcb3/users/9f4418744cfb4628816d23bf5856695e/roles/fe9bbc67742f4f5893f39b18eb31d59a => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:17:39.334285 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43445c51-43ca-4a18-a307-eb425d6c53cc admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:17:39.345047 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43445c51-43ca-4a18-a307-eb425d6c53cc admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:17:39.417773 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6938ec-87c8-4745-9446-622c53fb88c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:17:39.418720 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6938ec-87c8-4745-9446-622c53fb88c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:17:39.418998 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6938ec-87c8-4745-9446-622c53fb88c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:17:39.419270 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6938ec-87c8-4745-9446-622c53fb88c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:17:39.419955 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6938ec-87c8-4745-9446-622c53fb88c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:17:39.421665 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6938ec-87c8-4745-9446-622c53fb88c4 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:17:39.433340 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1255/2509] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:17:39 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:17:39.437075 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90c3a17-7e1a-4e02-a3a0-b358b3417bbd admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:17:39.452284 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90c3a17-7e1a-4e02-a3a0-b358b3417bbd admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:17:39.458156 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddd14ff-abce-4d0c-be71-bd15245dedb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:17:39.458855 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd14ff-abce-4d0c-be71-bd15245dedb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:17:39.459099 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd14ff-abce-4d0c-be71-bd15245dedb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:17:39.459369 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd14ff-abce-4d0c-be71-bd15245dedb8 admin admin] PATH_INFO: `/v3/projects/f024de3be4b546368070c6bde987fcb3/users/9f4418744cfb4628816d23bf5856695e/roles/fe9bbc67742f4f5893f39b18eb31d59a` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:17:39.461413 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddd14ff-abce-4d0c-be71-bd15245dedb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f024de3be4b546368070c6bde987fcb3, user_id=9f4418744cfb4628816d23bf5856695e, role_id=fe9bbc67742f4f5893f39b18eb31d59a)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:17:39.464295 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddd14ff-abce-4d0c-be71-bd15245dedb8 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:17:39.476835 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1255/2510] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:17:39 2022] PUT /identity/v3/projects/f024de3be4b546368070c6bde987fcb3/users/9f4418744cfb4628816d23bf5856695e/roles/fe9bbc67742f4f5893f39b18eb31d59a => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:17:44.517050 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d1192-16af-46d4-a4f5-e71f272077a2 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:17:44.517554 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d1192-16af-46d4-a4f5-e71f272077a2 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:17:44.517653 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d1192-16af-46d4-a4f5-e71f272077a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:17:44.574132 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-594d1192-16af-46d4-a4f5-e71f272077a2 None None] MFA Rules not processed for user `9f4418744cfb4628816d23bf5856695e`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:17:44.580385 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-594d1192-16af-46d4-a4f5-e71f272077a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:17:44.698309 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1256/2511] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:17:44 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:17:44.713303 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddd14ff-abce-4d0c-be71-bd15245dedb8 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:17:44.831693 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddd14ff-abce-4d0c-be71-bd15245dedb8 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:17:44.839181 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbe7405-59b8-4510-989d-53c832e43506 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3325a7111d447f4a9cf00c672d5420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:17:44.839966 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe7405-59b8-4510-989d-53c832e43506 service nova] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:17:44.840349 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe7405-59b8-4510-989d-53c832e43506 service nova] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:17:44.840725 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe7405-59b8-4510-989d-53c832e43506 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:17:44.967589 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbe7405-59b8-4510-989d-53c832e43506 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:17:44.969330 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbe7405-59b8-4510-989d-53c832e43506 service nova] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:17:44.976976 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:17:44.989122 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1256/2512] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:17:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:17:45.890600 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d086f1-203b-47b1-85e3-66f021b8f60b None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:17:45.891158 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d086f1-203b-47b1-85e3-66f021b8f60b None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:17:45.891158 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d086f1-203b-47b1-85e3-66f021b8f60b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:17:45.916232 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-b3d086f1-203b-47b1-85e3-66f021b8f60b None None] MFA Rules not processed for user `3a68abb5f8ab421cb6044c9a9f579ba6`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:17:45.918454 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-b3d086f1-203b-47b1-85e3-66f021b8f60b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:17:45.973120 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:17:45.991017 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1257/2513] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:17:45 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:17:46.500552 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbe7405-59b8-4510-989d-53c832e43506 service nova] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:17:46.502359 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-1bbe7405-59b8-4510-989d-53c832e43506 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:17:46.590110 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0391009-3c77-4176-a827-36671fb74182 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:17:46.591889 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0391009-3c77-4176-a827-36671fb74182 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:17:46.592387 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0391009-3c77-4176-a827-36671fb74182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:17:46.612286 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbe7405-59b8-4510-989d-53c832e43506 service nova] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:17:46.627301 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-b0391009-3c77-4176-a827-36671fb74182 None None] MFA Rules not processed for user `81b66c402e9b426394c273175f4b5fca`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:17:46.627456 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d92b1d4-0691-4175-a73d-d6b7e47a4e8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:17:46.628745 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d92b1d4-0691-4175-a73d-d6b7e47a4e8d service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:17:46.628871 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-b0391009-3c77-4176-a827-36671fb74182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:17:46.629366 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d92b1d4-0691-4175-a73d-d6b7e47a4e8d service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:17:46.629787 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d92b1d4-0691-4175-a73d-d6b7e47a4e8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:17:46.633146 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-4d92b1d4-0691-4175-a73d-d6b7e47a4e8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:17:46.646152 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1258/2514] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:17:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:17:46.646945 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d92b1d4-0691-4175-a73d-d6b7e47a4e8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:17:46.648432 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d92b1d4-0691-4175-a73d-d6b7e47a4e8d service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:17:46.658339 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1257/2515] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:17:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:17:56.629650 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=7 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:17:56.654579 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=27 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:18:39.660544 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e75798a-349b-481c-bc57-034cff6d4aa9 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:39.661087 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e75798a-349b-481c-bc57-034cff6d4aa9 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:39.661490 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e75798a-349b-481c-bc57-034cff6d4aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:39.682595 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-1e75798a-349b-481c-bc57-034cff6d4aa9 None None] MFA Rules not processed for user `0f8f13f302de4701a7f4e0562bca08cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:18:39.683723 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-1e75798a-349b-481c-bc57-034cff6d4aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:18:39.738134 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1259/2516] 10.222.0.49 () {58 vars in 967 bytes} [Thu Sep 29 02:18:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:18:39.785058 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d92b1d4-0691-4175-a73d-d6b7e47a4e8d service neutron] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:39.786797 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-4d92b1d4-0691-4175-a73d-d6b7e47a4e8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:18:39.861520 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d92b1d4-0691-4175-a73d-d6b7e47a4e8d service neutron] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:39.867317 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b594e3-a978-4633-b22e-7980798a0f04 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c88bc0f32600416ca7c6a59f4196e497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:39.868127 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b594e3-a978-4633-b22e-7980798a0f04 service swift] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:39.868474 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b594e3-a978-4633-b22e-7980798a0f04 service swift] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:39.868900 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b594e3-a978-4633-b22e-7980798a0f04 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:39.878402 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b594e3-a978-4633-b22e-7980798a0f04 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:39.880756 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b594e3-a978-4633-b22e-7980798a0f04 service swift] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:39.889940 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1258/2517] 10.222.0.49 () {60 vars in 1384 bytes} [Thu Sep 29 02:18:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 29 02:18:40.240298 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e75798a-349b-481c-bc57-034cff6d4aa9 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:40.249618 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e75798a-349b-481c-bc57-034cff6d4aa9 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:40.253121 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e5ca61-99c6-49b5-8ce9-99cb071cb304 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:40.253756 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e5ca61-99c6-49b5-8ce9-99cb071cb304 service neutron] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:40.254031 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e5ca61-99c6-49b5-8ce9-99cb071cb304 service neutron] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:40.254297 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e5ca61-99c6-49b5-8ce9-99cb071cb304 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:40.256591 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-d1e5ca61-99c6-49b5-8ce9-99cb071cb304 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:18:40.323710 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e5ca61-99c6-49b5-8ce9-99cb071cb304 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:40.325819 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e5ca61-99c6-49b5-8ce9-99cb071cb304 service neutron] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:40.337360 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1260/2518] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:18:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:18:48.679045 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b594e3-a978-4633-b22e-7980798a0f04 service swift] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:48.681115 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-18b594e3-a978-4633-b22e-7980798a0f04 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:18:48.753479 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e5ca61-99c6-49b5-8ce9-99cb071cb304 service neutron] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:48.757236 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-d1e5ca61-99c6-49b5-8ce9-99cb071cb304 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:18:48.770322 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e5ca61-99c6-49b5-8ce9-99cb071cb304 service neutron] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:48.774988 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b594e3-a978-4633-b22e-7980798a0f04 service swift] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:48.775451 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85f7432-2d47-40f8-be89-eced8dc3f1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:48.776242 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85f7432-2d47-40f8-be89-eced8dc3f1eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:48.776632 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85f7432-2d47-40f8-be89-eced8dc3f1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:48.776902 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85f7432-2d47-40f8-be89-eced8dc3f1eb admin admin] PATH_INFO: `/v3/users/bcd3fa0a082144c3892221602eeeb4d9` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:48.778264 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85f7432-2d47-40f8-be89-eced8dc3f1eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcd3fa0a082144c3892221602eeeb4d9)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:48.780271 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85f7432-2d47-40f8-be89-eced8dc3f1eb admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:48.780402 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bde88d-07b0-4b05-9119-61764ce13655 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cbb39731a6b42e2a6647d6134b5c7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:48.781008 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bde88d-07b0-4b05-9119-61764ce13655 service placement] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:48.781281 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bde88d-07b0-4b05-9119-61764ce13655 service placement] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:48.781575 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bde88d-07b0-4b05-9119-61764ce13655 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:48.783304 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-49bde88d-07b0-4b05-9119-61764ce13655 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:18:48.797519 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bde88d-07b0-4b05-9119-61764ce13655 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:48.800285 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bde88d-07b0-4b05-9119-61764ce13655 service placement] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:48.819320 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1259/2519] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:18:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:18:48.849906 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-c85f7432-2d47-40f8-be89-eced8dc3f1eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcd3fa0a082144c3892221602eeeb4d9'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:48.850931 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-c85f7432-2d47-40f8-be89-eced8dc3f1eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcd3fa0a082144c3892221602eeeb4d9'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:48.873639 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-c85f7432-2d47-40f8-be89-eced8dc3f1eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcd3fa0a082144c3892221602eeeb4d9'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:48.884246 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-c85f7432-2d47-40f8-be89-eced8dc3f1eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcd3fa0a082144c3892221602eeeb4d9'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:48.885449 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-c85f7432-2d47-40f8-be89-eced8dc3f1eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcd3fa0a082144c3892221602eeeb4d9'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:48.905827 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1261/2520] 10.222.0.49 () {58 vars in 1224 bytes} [Thu Sep 29 02:18:48 2022] DELETE /identity/v3/users/bcd3fa0a082144c3892221602eeeb4d9 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:18:49.090407 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bde88d-07b0-4b05-9119-61764ce13655 service placement] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:49.102944 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bde88d-07b0-4b05-9119-61764ce13655 service placement] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:49.163964 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ff7116-1eae-42c1-8caa-b9b9fbdcd7c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:49.164592 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff7116-1eae-42c1-8caa-b9b9fbdcd7c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:49.164866 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff7116-1eae-42c1-8caa-b9b9fbdcd7c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:49.165134 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff7116-1eae-42c1-8caa-b9b9fbdcd7c2 admin admin] PATH_INFO: `/v3/projects/7d0ac285a6454f88bd1ea0382844f6bf` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:49.166259 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ff7116-1eae-42c1-8caa-b9b9fbdcd7c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d0ac285a6454f88bd1ea0382844f6bf)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:49.168133 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ff7116-1eae-42c1-8caa-b9b9fbdcd7c2 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:49.193061 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:18:49.218484 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-81ff7116-1eae-42c1-8caa-b9b9fbdcd7c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d0ac285a6454f88bd1ea0382844f6bf', 'request_id': 'req-81ff7116-1eae-42c1-8caa-b9b9fbdcd7c2'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:49.224829 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-81ff7116-1eae-42c1-8caa-b9b9fbdcd7c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d0ac285a6454f88bd1ea0382844f6bf', 'request_id': 'req-81ff7116-1eae-42c1-8caa-b9b9fbdcd7c2'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:49.232873 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-81ff7116-1eae-42c1-8caa-b9b9fbdcd7c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d0ac285a6454f88bd1ea0382844f6bf', 'request_id': 'req-81ff7116-1eae-42c1-8caa-b9b9fbdcd7c2'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:49.243849 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-81ff7116-1eae-42c1-8caa-b9b9fbdcd7c2 admin admin] The token cache is being invalidate because project 7d0ac285a6454f88bd1ea0382844f6bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81649) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:18:49.244138 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-81ff7116-1eae-42c1-8caa-b9b9fbdcd7c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:49.244771 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-81ff7116-1eae-42c1-8caa-b9b9fbdcd7c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:49.246276 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1260/2521] 10.222.0.49 () {58 vars in 1233 bytes} [Thu Sep 29 02:18:49 2022] DELETE /identity/v3/projects/7d0ac285a6454f88bd1ea0382844f6bf => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:18:49.250682 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85f7432-2d47-40f8-be89-eced8dc3f1eb admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:49.252968 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-c85f7432-2d47-40f8-be89-eced8dc3f1eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:18:49.267391 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85f7432-2d47-40f8-be89-eced8dc3f1eb admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:49.275847 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:18:49.333846 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0f0d77-6266-4ee7-8b7e-80c1c84f44b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:49.334480 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f0d77-6266-4ee7-8b7e-80c1c84f44b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:49.334761 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f0d77-6266-4ee7-8b7e-80c1c84f44b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:49.335033 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f0d77-6266-4ee7-8b7e-80c1c84f44b9 admin admin] PATH_INFO: `/v3/users/f8fe6445d56b4fc18ff2bcdb3abd76a2` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:49.336183 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0f0d77-6266-4ee7-8b7e-80c1c84f44b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8fe6445d56b4fc18ff2bcdb3abd76a2)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:49.338237 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0f0d77-6266-4ee7-8b7e-80c1c84f44b9 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:49.388558 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-ad0f0d77-6266-4ee7-8b7e-80c1c84f44b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8fe6445d56b4fc18ff2bcdb3abd76a2'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:49.389524 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-ad0f0d77-6266-4ee7-8b7e-80c1c84f44b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8fe6445d56b4fc18ff2bcdb3abd76a2'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:49.402544 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-ad0f0d77-6266-4ee7-8b7e-80c1c84f44b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8fe6445d56b4fc18ff2bcdb3abd76a2'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:49.411140 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-ad0f0d77-6266-4ee7-8b7e-80c1c84f44b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8fe6445d56b4fc18ff2bcdb3abd76a2'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:49.411841 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-ad0f0d77-6266-4ee7-8b7e-80c1c84f44b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8fe6445d56b4fc18ff2bcdb3abd76a2'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:49.424079 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1262/2522] 10.222.0.49 () {58 vars in 1224 bytes} [Thu Sep 29 02:18:49 2022] DELETE /identity/v3/users/f8fe6445d56b4fc18ff2bcdb3abd76a2 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:18:49.594048 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ff7116-1eae-42c1-8caa-b9b9fbdcd7c2 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:49.595608 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-81ff7116-1eae-42c1-8caa-b9b9fbdcd7c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:18:49.615502 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ff7116-1eae-42c1-8caa-b9b9fbdcd7c2 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:49.682691 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6e36da-de6f-41b4-80e7-73c0170c0e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:49.683353 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e36da-de6f-41b4-80e7-73c0170c0e79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:49.683578 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e36da-de6f-41b4-80e7-73c0170c0e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:49.683844 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e36da-de6f-41b4-80e7-73c0170c0e79 admin admin] PATH_INFO: `/v3/projects/a0f6cd46c1dc4a8db7c523f4baa60fa4` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:49.684983 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6e36da-de6f-41b4-80e7-73c0170c0e79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0f6cd46c1dc4a8db7c523f4baa60fa4)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:49.686918 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6e36da-de6f-41b4-80e7-73c0170c0e79 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:49.732924 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-4f6e36da-de6f-41b4-80e7-73c0170c0e79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0f6cd46c1dc4a8db7c523f4baa60fa4', 'request_id': 'req-4f6e36da-de6f-41b4-80e7-73c0170c0e79'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:49.739619 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-4f6e36da-de6f-41b4-80e7-73c0170c0e79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0f6cd46c1dc4a8db7c523f4baa60fa4', 'request_id': 'req-4f6e36da-de6f-41b4-80e7-73c0170c0e79'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:49.746780 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-4f6e36da-de6f-41b4-80e7-73c0170c0e79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0f6cd46c1dc4a8db7c523f4baa60fa4', 'request_id': 'req-4f6e36da-de6f-41b4-80e7-73c0170c0e79'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:49.758039 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-4f6e36da-de6f-41b4-80e7-73c0170c0e79 admin admin] The token cache is being invalidate because project a0f6cd46c1dc4a8db7c523f4baa60fa4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81649) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:18:49.758325 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-4f6e36da-de6f-41b4-80e7-73c0170c0e79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:49.758951 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-4f6e36da-de6f-41b4-80e7-73c0170c0e79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:49.760441 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1261/2523] 10.222.0.49 () {58 vars in 1233 bytes} [Thu Sep 29 02:18:49 2022] DELETE /identity/v3/projects/a0f6cd46c1dc4a8db7c523f4baa60fa4 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:18:51.814886 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0f0d77-6266-4ee7-8b7e-80c1c84f44b9 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:51.817047 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-ad0f0d77-6266-4ee7-8b7e-80c1c84f44b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:18:51.878134 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0f0d77-6266-4ee7-8b7e-80c1c84f44b9 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:51.935034 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:18:51.942531 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e640f1-0782-4204-89d6-8a4d61c3d46d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:51.943188 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e640f1-0782-4204-89d6-8a4d61c3d46d service neutron] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:51.943462 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e640f1-0782-4204-89d6-8a4d61c3d46d service neutron] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:51.943789 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e640f1-0782-4204-89d6-8a4d61c3d46d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:51.946318 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-00e640f1-0782-4204-89d6-8a4d61c3d46d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:18:52.013285 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e640f1-0782-4204-89d6-8a4d61c3d46d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:52.014915 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e640f1-0782-4204-89d6-8a4d61c3d46d service neutron] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:52.025073 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1263/2524] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:18:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:18:55.151691 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6e36da-de6f-41b4-80e7-73c0170c0e79 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:55.153417 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-4f6e36da-de6f-41b4-80e7-73c0170c0e79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:18:55.175798 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6e36da-de6f-41b4-80e7-73c0170c0e79 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:55.180362 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07a1eed-a4dc-42ab-b078-06284f8dc53d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:55.180990 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a1eed-a4dc-42ab-b078-06284f8dc53d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:55.181262 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a1eed-a4dc-42ab-b078-06284f8dc53d admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:55.181573 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a1eed-a4dc-42ab-b078-06284f8dc53d admin admin] PATH_INFO: `/v3/users/f167598e4a354a21b89825f2cbe8ff2d` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:55.182700 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07a1eed-a4dc-42ab-b078-06284f8dc53d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f167598e4a354a21b89825f2cbe8ff2d)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:55.184615 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07a1eed-a4dc-42ab-b078-06284f8dc53d admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:55.224337 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:DELETE=19,keystone:SELECT=79,keystone:INSERT=2 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:18:55.234811 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-c07a1eed-a4dc-42ab-b078-06284f8dc53d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f167598e4a354a21b89825f2cbe8ff2d'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:55.235401 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-c07a1eed-a4dc-42ab-b078-06284f8dc53d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f167598e4a354a21b89825f2cbe8ff2d'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:55.247957 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-c07a1eed-a4dc-42ab-b078-06284f8dc53d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f167598e4a354a21b89825f2cbe8ff2d'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:55.256632 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-c07a1eed-a4dc-42ab-b078-06284f8dc53d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f167598e4a354a21b89825f2cbe8ff2d'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:55.257757 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-c07a1eed-a4dc-42ab-b078-06284f8dc53d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f167598e4a354a21b89825f2cbe8ff2d'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:55.276143 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1262/2525] 10.222.0.49 () {58 vars in 1224 bytes} [Thu Sep 29 02:18:55 2022] DELETE /identity/v3/users/f167598e4a354a21b89825f2cbe8ff2d => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:18:55.451904 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e640f1-0782-4204-89d6-8a4d61c3d46d service neutron] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:55.464865 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e640f1-0782-4204-89d6-8a4d61c3d46d service neutron] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:55.522436 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1d710e-e01b-41dc-a924-1cb57f8c2aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:55.522976 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d710e-e01b-41dc-a924-1cb57f8c2aca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:55.523254 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d710e-e01b-41dc-a924-1cb57f8c2aca admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:55.523517 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d710e-e01b-41dc-a924-1cb57f8c2aca admin admin] PATH_INFO: `/v3/projects/b407de2089554e13839d51f270c3adf1` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:55.524603 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1d710e-e01b-41dc-a924-1cb57f8c2aca admin admin] RBAC: Authorizing `identity:delete_project(project_id=b407de2089554e13839d51f270c3adf1)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:55.526511 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1d710e-e01b-41dc-a924-1cb57f8c2aca admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:55.571409 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-4e1d710e-e01b-41dc-a924-1cb57f8c2aca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b407de2089554e13839d51f270c3adf1', 'request_id': 'req-4e1d710e-e01b-41dc-a924-1cb57f8c2aca'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:55.577641 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-4e1d710e-e01b-41dc-a924-1cb57f8c2aca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b407de2089554e13839d51f270c3adf1', 'request_id': 'req-4e1d710e-e01b-41dc-a924-1cb57f8c2aca'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:55.585547 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-4e1d710e-e01b-41dc-a924-1cb57f8c2aca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b407de2089554e13839d51f270c3adf1', 'request_id': 'req-4e1d710e-e01b-41dc-a924-1cb57f8c2aca'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:55.596931 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-4e1d710e-e01b-41dc-a924-1cb57f8c2aca admin admin] The token cache is being invalidate because project b407de2089554e13839d51f270c3adf1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81648) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:18:55.597821 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-4e1d710e-e01b-41dc-a924-1cb57f8c2aca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:55.598605 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-4e1d710e-e01b-41dc-a924-1cb57f8c2aca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:55.600130 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1264/2526] 10.222.0.49 () {58 vars in 1233 bytes} [Thu Sep 29 02:18:55 2022] DELETE /identity/v3/projects/b407de2089554e13839d51f270c3adf1 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:18:55.610325 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0757ce0-a970-4b7d-b704-0efdf69dc3da None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:55.610608 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0757ce0-a970-4b7d-b704-0efdf69dc3da None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:55.610876 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0757ce0-a970-4b7d-b704-0efdf69dc3da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:55.630311 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-f0757ce0-a970-4b7d-b704-0efdf69dc3da None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:18:55.631498 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-f0757ce0-a970-4b7d-b704-0efdf69dc3da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:18:55.690715 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1263/2527] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:18:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:18:55.698571 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637dfce6-2ed5-4a2f-8fe0-2c5c1197eb2f None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:55.698855 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637dfce6-2ed5-4a2f-8fe0-2c5c1197eb2f None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:55.699125 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637dfce6-2ed5-4a2f-8fe0-2c5c1197eb2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:55.719266 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-637dfce6-2ed5-4a2f-8fe0-2c5c1197eb2f None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:18:55.720474 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-637dfce6-2ed5-4a2f-8fe0-2c5c1197eb2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:18:55.729227 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1265/2528] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:18:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:18:55.733608 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0757ce0-a970-4b7d-b704-0efdf69dc3da None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:55.744355 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0757ce0-a970-4b7d-b704-0efdf69dc3da None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:55.748840 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ab8ae8-499d-444f-a686-541982a2d84d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:55.749468 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ab8ae8-499d-444f-a686-541982a2d84d admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:55.749742 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ab8ae8-499d-444f-a686-541982a2d84d admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:55.750008 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ab8ae8-499d-444f-a686-541982a2d84d admin admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:55.750649 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ab8ae8-499d-444f-a686-541982a2d84d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:18:55.750943 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ab8ae8-499d-444f-a686-541982a2d84d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:55.752519 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ab8ae8-499d-444f-a686-541982a2d84d admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:55.764905 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1264/2529] 10.222.0.49 () {58 vars in 1153 bytes} [Thu Sep 29 02:18:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:18:55.769425 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637dfce6-2ed5-4a2f-8fe0-2c5c1197eb2f None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:55.778746 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637dfce6-2ed5-4a2f-8fe0-2c5c1197eb2f None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:55.783326 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852e149d-2ff8-4335-a5f4-3dd6f874efb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:55.783912 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852e149d-2ff8-4335-a5f4-3dd6f874efb2 admin admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:55.784190 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852e149d-2ff8-4335-a5f4-3dd6f874efb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:55.784458 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852e149d-2ff8-4335-a5f4-3dd6f874efb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:55.785160 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852e149d-2ff8-4335-a5f4-3dd6f874efb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:55.787087 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852e149d-2ff8-4335-a5f4-3dd6f874efb2 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:55.807725 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:18:55.816744 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1266/2530] 10.222.0.49 () {60 vars in 1153 bytes} [Thu Sep 29 02:18:55 2022] POST /identity/v3/projects => generated 403 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:18:55.820942 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ab8ae8-499d-444f-a686-541982a2d84d admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:55.830829 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ab8ae8-499d-444f-a686-541982a2d84d admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:55.886685 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54d0c51-61e1-4deb-8262-f5f418edfe21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:55.887281 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d0c51-61e1-4deb-8262-f5f418edfe21 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:55.887555 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d0c51-61e1-4deb-8262-f5f418edfe21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:55.887821 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d0c51-61e1-4deb-8262-f5f418edfe21 admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:55.888448 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54d0c51-61e1-4deb-8262-f5f418edfe21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:55.890369 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54d0c51-61e1-4deb-8262-f5f418edfe21 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:55.915043 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1265/2531] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 02:18:55 2022] POST /identity/v3/users => generated 302 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 29 02:18:55.919055 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852e149d-2ff8-4335-a5f4-3dd6f874efb2 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:55.930224 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852e149d-2ff8-4335-a5f4-3dd6f874efb2 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:55.934813 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34933a1b-7f5c-4de2-899c-ceb93f6b6b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:55.935434 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34933a1b-7f5c-4de2-899c-ceb93f6b6b69 admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:55.935714 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34933a1b-7f5c-4de2-899c-ceb93f6b6b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:55.935985 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34933a1b-7f5c-4de2-899c-ceb93f6b6b69 admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:55.936650 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34933a1b-7f5c-4de2-899c-ceb93f6b6b69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:55.938267 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34933a1b-7f5c-4de2-899c-ceb93f6b6b69 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:55.948056 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1267/2532] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:18:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:18:55.952516 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54d0c51-61e1-4deb-8262-f5f418edfe21 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:55.962501 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54d0c51-61e1-4deb-8262-f5f418edfe21 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:55.967105 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81ccbaa-319d-499f-b985-89bf81fa967f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:55.967686 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ccbaa-319d-499f-b985-89bf81fa967f admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:55.967962 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ccbaa-319d-499f-b985-89bf81fa967f admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:55.968229 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ccbaa-319d-499f-b985-89bf81fa967f admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:55.968859 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81ccbaa-319d-499f-b985-89bf81fa967f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:55.970473 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81ccbaa-319d-499f-b985-89bf81fa967f admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:55.981548 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1266/2533] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:18:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 29 02:18:55.985456 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34933a1b-7f5c-4de2-899c-ceb93f6b6b69 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:55.995873 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34933a1b-7f5c-4de2-899c-ceb93f6b6b69 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:56.000355 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8fecb1-cd6c-4372-8c49-4e4d1038902f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:56.000982 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8fecb1-cd6c-4372-8c49-4e4d1038902f admin admin] REQUEST_METHOD: `PUT` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:56.001255 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8fecb1-cd6c-4372-8c49-4e4d1038902f admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:56.001556 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8fecb1-cd6c-4372-8c49-4e4d1038902f admin admin] PATH_INFO: `/v3/projects/7198744ca5dc422e86c6386333609fad/users/3aeeb9ec93be4e24b6765b70bc056106/roles/f157f905c9c94ccfbfb46e52d443e8f2` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:56.015980 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8fecb1-cd6c-4372-8c49-4e4d1038902f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7198744ca5dc422e86c6386333609fad, user_id=3aeeb9ec93be4e24b6765b70bc056106, role_id=f157f905c9c94ccfbfb46e52d443e8f2)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:56.018605 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8fecb1-cd6c-4372-8c49-4e4d1038902f admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:56.032085 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1268/2534] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:18:55 2022] PUT /identity/v3/projects/7198744ca5dc422e86c6386333609fad/users/3aeeb9ec93be4e24b6765b70bc056106/roles/f157f905c9c94ccfbfb46e52d443e8f2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:18:56.043781 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580bc034-9d19-4407-b3c7-d176f25209da None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:56.044083 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580bc034-9d19-4407-b3c7-d176f25209da None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:56.044358 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580bc034-9d19-4407-b3c7-d176f25209da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:56.072018 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-580bc034-9d19-4407-b3c7-d176f25209da None None] MFA Rules not processed for user `3aeeb9ec93be4e24b6765b70bc056106`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:18:56.073247 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-580bc034-9d19-4407-b3c7-d176f25209da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:18:56.078156 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:18:56.140672 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1267/2535] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:18:56 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:18:56.145939 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8fecb1-cd6c-4372-8c49-4e4d1038902f admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:56.207382 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8fecb1-cd6c-4372-8c49-4e4d1038902f admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:56.212118 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c52db98-6f63-4fb0-83cc-f6e7f33c58e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:56.212715 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c52db98-6f63-4fb0-83cc-f6e7f33c58e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:56.212995 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c52db98-6f63-4fb0-83cc-f6e7f33c58e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:56.213268 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c52db98-6f63-4fb0-83cc-f6e7f33c58e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:56.213928 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c52db98-6f63-4fb0-83cc-f6e7f33c58e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:56.215813 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c52db98-6f63-4fb0-83cc-f6e7f33c58e8 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:56.242332 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1269/2536] 10.222.0.49 () {60 vars in 1153 bytes} [Thu Sep 29 02:18:56 2022] POST /identity/v3/projects => generated 405 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:18:56.246448 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580bc034-9d19-4407-b3c7-d176f25209da None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:56.257758 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580bc034-9d19-4407-b3c7-d176f25209da None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:56.314405 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01645cfe-0689-4726-8f89-abb803ec9a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:56.315006 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01645cfe-0689-4726-8f89-abb803ec9a13 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:56.315284 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01645cfe-0689-4726-8f89-abb803ec9a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:56.315555 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01645cfe-0689-4726-8f89-abb803ec9a13 admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:56.316175 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01645cfe-0689-4726-8f89-abb803ec9a13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:56.318122 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01645cfe-0689-4726-8f89-abb803ec9a13 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:56.339310 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1268/2537] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 02:18:56 2022] POST /identity/v3/users => generated 309 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:18:56.343476 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c52db98-6f63-4fb0-83cc-f6e7f33c58e8 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:56.354015 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c52db98-6f63-4fb0-83cc-f6e7f33c58e8 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:56.358842 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c8c7bd-9977-4736-b94e-7927e661f2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:56.359467 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c8c7bd-9977-4736-b94e-7927e661f2f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:56.359744 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c8c7bd-9977-4736-b94e-7927e661f2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:56.360015 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c8c7bd-9977-4736-b94e-7927e661f2f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:56.360684 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c8c7bd-9977-4736-b94e-7927e661f2f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:56.362314 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c8c7bd-9977-4736-b94e-7927e661f2f2 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:56.373526 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1270/2538] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:18:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 29 02:18:56.377497 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01645cfe-0689-4726-8f89-abb803ec9a13 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:56.388181 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01645cfe-0689-4726-8f89-abb803ec9a13 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:56.392736 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae442229-1f2c-46ff-ab3b-7702d3a86675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:56.393413 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae442229-1f2c-46ff-ab3b-7702d3a86675 admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:56.393692 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae442229-1f2c-46ff-ab3b-7702d3a86675 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:56.393988 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae442229-1f2c-46ff-ab3b-7702d3a86675 admin admin] PATH_INFO: `/v3/projects/3e502e64263941bea9844987d10bb352/users/8d93d2419bc24a77b856f1a5f24b3997/roles/fe9bbc67742f4f5893f39b18eb31d59a` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:56.408250 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae442229-1f2c-46ff-ab3b-7702d3a86675 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e502e64263941bea9844987d10bb352, user_id=8d93d2419bc24a77b856f1a5f24b3997, role_id=fe9bbc67742f4f5893f39b18eb31d59a)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:56.410950 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae442229-1f2c-46ff-ab3b-7702d3a86675 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:56.426024 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1269/2539] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:18:56 2022] PUT /identity/v3/projects/3e502e64263941bea9844987d10bb352/users/8d93d2419bc24a77b856f1a5f24b3997/roles/fe9bbc67742f4f5893f39b18eb31d59a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:18:56.430022 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c8c7bd-9977-4736-b94e-7927e661f2f2 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:56.440104 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c8c7bd-9977-4736-b94e-7927e661f2f2 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:56.500466 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2206e5c9-0883-4c25-a492-4b59bba7772b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:56.501111 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2206e5c9-0883-4c25-a492-4b59bba7772b admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:56.501373 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2206e5c9-0883-4c25-a492-4b59bba7772b admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:56.501649 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2206e5c9-0883-4c25-a492-4b59bba7772b admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:56.502289 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2206e5c9-0883-4c25-a492-4b59bba7772b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:56.504754 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2206e5c9-0883-4c25-a492-4b59bba7772b admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:56.515543 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1271/2540] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:18:56 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:18:56.521029 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae442229-1f2c-46ff-ab3b-7702d3a86675 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:56.531581 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae442229-1f2c-46ff-ab3b-7702d3a86675 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:56.536288 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee3b871-20cb-41e5-b55f-1e2593813daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:56.536933 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee3b871-20cb-41e5-b55f-1e2593813daf admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:56.537213 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee3b871-20cb-41e5-b55f-1e2593813daf admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:56.537524 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee3b871-20cb-41e5-b55f-1e2593813daf admin admin] PATH_INFO: `/v3/projects/3e502e64263941bea9844987d10bb352/users/8d93d2419bc24a77b856f1a5f24b3997/roles/fe9bbc67742f4f5893f39b18eb31d59a` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:56.539443 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee3b871-20cb-41e5-b55f-1e2593813daf admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e502e64263941bea9844987d10bb352, user_id=8d93d2419bc24a77b856f1a5f24b3997, role_id=fe9bbc67742f4f5893f39b18eb31d59a)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:56.542433 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee3b871-20cb-41e5-b55f-1e2593813daf admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:56.553187 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1270/2541] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:18:56 2022] PUT /identity/v3/projects/3e502e64263941bea9844987d10bb352/users/8d93d2419bc24a77b856f1a5f24b3997/roles/fe9bbc67742f4f5893f39b18eb31d59a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:18:56.563151 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdddbdb-baed-41a2-bc60-312383f1f3da None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:56.563438 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdddbdb-baed-41a2-bc60-312383f1f3da None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:56.563713 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdddbdb-baed-41a2-bc60-312383f1f3da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:56.591711 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-0bdddbdb-baed-41a2-bc60-312383f1f3da None None] MFA Rules not processed for user `8d93d2419bc24a77b856f1a5f24b3997`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:18:56.592859 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-0bdddbdb-baed-41a2-bc60-312383f1f3da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:18:56.614061 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:18:56.661875 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1272/2542] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:18:56 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:18:56.673685 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee3b871-20cb-41e5-b55f-1e2593813daf admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:56.676125 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-2ee3b871-20cb-41e5-b55f-1e2593813daf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:18:56.734005 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee3b871-20cb-41e5-b55f-1e2593813daf admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:56.738592 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ac225f-2e55-479c-8a97-3de9ed9206d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75135b856134ba4b9ccac337886f682', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:56.739217 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac225f-2e55-479c-8a97-3de9ed9206d9 service cinder] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:56.739534 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac225f-2e55-479c-8a97-3de9ed9206d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:56.739805 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac225f-2e55-479c-8a97-3de9ed9206d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:56.748661 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ac225f-2e55-479c-8a97-3de9ed9206d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:56.750090 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ac225f-2e55-479c-8a97-3de9ed9206d9 service cinder] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:56.759675 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1271/2543] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:18:56 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:18:56.901280 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdddbdb-baed-41a2-bc60-312383f1f3da None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:56.966360 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdddbdb-baed-41a2-bc60-312383f1f3da None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:56.970827 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2eba44-bd4b-4e39-b90e-50546e69bbf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:56.971453 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2eba44-bd4b-4e39-b90e-50546e69bbf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:56.971731 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2eba44-bd4b-4e39-b90e-50546e69bbf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:56.972004 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2eba44-bd4b-4e39-b90e-50546e69bbf6 admin admin] PATH_INFO: `/v3/users/3aeeb9ec93be4e24b6765b70bc056106` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:56.973448 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2eba44-bd4b-4e39-b90e-50546e69bbf6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3aeeb9ec93be4e24b6765b70bc056106)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:56.975368 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2eba44-bd4b-4e39-b90e-50546e69bbf6 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:57.023407 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-6b2eba44-bd4b-4e39-b90e-50546e69bbf6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3aeeb9ec93be4e24b6765b70bc056106'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:57.024059 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-6b2eba44-bd4b-4e39-b90e-50546e69bbf6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3aeeb9ec93be4e24b6765b70bc056106'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:57.035954 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-6b2eba44-bd4b-4e39-b90e-50546e69bbf6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3aeeb9ec93be4e24b6765b70bc056106'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:57.043278 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-6b2eba44-bd4b-4e39-b90e-50546e69bbf6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3aeeb9ec93be4e24b6765b70bc056106'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:57.043881 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-6b2eba44-bd4b-4e39-b90e-50546e69bbf6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3aeeb9ec93be4e24b6765b70bc056106'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:57.056982 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1273/2544] 10.222.0.49 () {58 vars in 1224 bytes} [Thu Sep 29 02:18:56 2022] DELETE /identity/v3/users/3aeeb9ec93be4e24b6765b70bc056106 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:18:57.061528 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f7c936-c3d8-4644-a570-e8729cf30c79 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:57.061815 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f7c936-c3d8-4644-a570-e8729cf30c79 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:57.062086 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f7c936-c3d8-4644-a570-e8729cf30c79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:57.070285 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:18:57.083729 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-42f7c936-c3d8-4644-a570-e8729cf30c79 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:18:57.084927 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-42f7c936-c3d8-4644-a570-e8729cf30c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:18:57.142677 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1272/2545] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:18:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:18:57.152286 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2eba44-bd4b-4e39-b90e-50546e69bbf6 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:57.153713 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-6b2eba44-bd4b-4e39-b90e-50546e69bbf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:18:57.195816 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:18:57.212039 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2eba44-bd4b-4e39-b90e-50546e69bbf6 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:57.215597 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdaa1f1-ddd6-4443-afbf-ea6ca61eb7e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:57.216195 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdaa1f1-ddd6-4443-afbf-ea6ca61eb7e4 service neutron] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:57.216473 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdaa1f1-ddd6-4443-afbf-ea6ca61eb7e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:57.216741 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdaa1f1-ddd6-4443-afbf-ea6ca61eb7e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:57.225366 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdaa1f1-ddd6-4443-afbf-ea6ca61eb7e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:57.226774 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdaa1f1-ddd6-4443-afbf-ea6ca61eb7e4 service neutron] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:57.235892 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1274/2546] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:18:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:18:57.497484 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f7c936-c3d8-4644-a570-e8729cf30c79 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:57.498939 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-42f7c936-c3d8-4644-a570-e8729cf30c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:18:57.513293 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f7c936-c3d8-4644-a570-e8729cf30c79 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:57.517985 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c6c8ef-1f4a-4e52-9f0f-8d4bb0df1b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:57.518633 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c6c8ef-1f4a-4e52-9f0f-8d4bb0df1b1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:57.519467 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c6c8ef-1f4a-4e52-9f0f-8d4bb0df1b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:57.519830 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c6c8ef-1f4a-4e52-9f0f-8d4bb0df1b1a admin admin] PATH_INFO: `/v3/projects/7198744ca5dc422e86c6386333609fad` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:57.521001 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c6c8ef-1f4a-4e52-9f0f-8d4bb0df1b1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7198744ca5dc422e86c6386333609fad)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:57.522919 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c6c8ef-1f4a-4e52-9f0f-8d4bb0df1b1a admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:57.568606 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-56c6c8ef-1f4a-4e52-9f0f-8d4bb0df1b1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7198744ca5dc422e86c6386333609fad', 'request_id': 'req-56c6c8ef-1f4a-4e52-9f0f-8d4bb0df1b1a'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:57.574782 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-56c6c8ef-1f4a-4e52-9f0f-8d4bb0df1b1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7198744ca5dc422e86c6386333609fad', 'request_id': 'req-56c6c8ef-1f4a-4e52-9f0f-8d4bb0df1b1a'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:57.582148 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-56c6c8ef-1f4a-4e52-9f0f-8d4bb0df1b1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7198744ca5dc422e86c6386333609fad', 'request_id': 'req-56c6c8ef-1f4a-4e52-9f0f-8d4bb0df1b1a'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:57.592294 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-56c6c8ef-1f4a-4e52-9f0f-8d4bb0df1b1a admin admin] The token cache is being invalidate because project 7198744ca5dc422e86c6386333609fad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81649) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:18:57.592602 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-56c6c8ef-1f4a-4e52-9f0f-8d4bb0df1b1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:57.593213 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-56c6c8ef-1f4a-4e52-9f0f-8d4bb0df1b1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:57.594719 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1273/2547] 10.222.0.49 () {58 vars in 1233 bytes} [Thu Sep 29 02:18:57 2022] DELETE /identity/v3/projects/7198744ca5dc422e86c6386333609fad => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:18:57.598875 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdaa1f1-ddd6-4443-afbf-ea6ca61eb7e4 service neutron] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:57.608443 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdaa1f1-ddd6-4443-afbf-ea6ca61eb7e4 service neutron] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:57.665043 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5985fc-c5b4-418c-9097-3cc41b96b93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:57.665683 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5985fc-c5b4-418c-9097-3cc41b96b93b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:57.665960 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5985fc-c5b4-418c-9097-3cc41b96b93b admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:57.666251 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5985fc-c5b4-418c-9097-3cc41b96b93b admin admin] PATH_INFO: `/v3/users/8d93d2419bc24a77b856f1a5f24b3997` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:57.667348 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5985fc-c5b4-418c-9097-3cc41b96b93b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d93d2419bc24a77b856f1a5f24b3997)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:57.670080 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5985fc-c5b4-418c-9097-3cc41b96b93b admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:57.716196 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-ee5985fc-c5b4-418c-9097-3cc41b96b93b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d93d2419bc24a77b856f1a5f24b3997'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:57.716752 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-ee5985fc-c5b4-418c-9097-3cc41b96b93b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d93d2419bc24a77b856f1a5f24b3997'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:57.728654 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-ee5985fc-c5b4-418c-9097-3cc41b96b93b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d93d2419bc24a77b856f1a5f24b3997'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:57.735819 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-ee5985fc-c5b4-418c-9097-3cc41b96b93b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d93d2419bc24a77b856f1a5f24b3997'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:57.736471 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-ee5985fc-c5b4-418c-9097-3cc41b96b93b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d93d2419bc24a77b856f1a5f24b3997'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:57.750733 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1275/2548] 10.222.0.49 () {58 vars in 1224 bytes} [Thu Sep 29 02:18:57 2022] DELETE /identity/v3/users/8d93d2419bc24a77b856f1a5f24b3997 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:18:58.021376 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c6c8ef-1f4a-4e52-9f0f-8d4bb0df1b1a admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:58.022878 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-56c6c8ef-1f4a-4e52-9f0f-8d4bb0df1b1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:18:58.036134 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c6c8ef-1f4a-4e52-9f0f-8d4bb0df1b1a admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:58.093742 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600ed97c-f1c6-4a02-aef4-26311209fb27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:58.094377 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ed97c-f1c6-4a02-aef4-26311209fb27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:58.094656 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ed97c-f1c6-4a02-aef4-26311209fb27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:58.094930 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ed97c-f1c6-4a02-aef4-26311209fb27 admin admin] PATH_INFO: `/v3/projects/3e502e64263941bea9844987d10bb352` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:58.096046 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600ed97c-f1c6-4a02-aef4-26311209fb27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e502e64263941bea9844987d10bb352)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:58.098849 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600ed97c-f1c6-4a02-aef4-26311209fb27 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:58.132074 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:18:58.148163 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-600ed97c-f1c6-4a02-aef4-26311209fb27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e502e64263941bea9844987d10bb352', 'request_id': 'req-600ed97c-f1c6-4a02-aef4-26311209fb27'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:58.155460 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-600ed97c-f1c6-4a02-aef4-26311209fb27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e502e64263941bea9844987d10bb352', 'request_id': 'req-600ed97c-f1c6-4a02-aef4-26311209fb27'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:58.163431 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-600ed97c-f1c6-4a02-aef4-26311209fb27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e502e64263941bea9844987d10bb352', 'request_id': 'req-600ed97c-f1c6-4a02-aef4-26311209fb27'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:58.174247 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-600ed97c-f1c6-4a02-aef4-26311209fb27 admin admin] The token cache is being invalidate because project 3e502e64263941bea9844987d10bb352 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81649) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:18:58.174535 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-600ed97c-f1c6-4a02-aef4-26311209fb27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:58.175828 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-600ed97c-f1c6-4a02-aef4-26311209fb27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:18:58.177455 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1274/2549] 10.222.0.49 () {58 vars in 1233 bytes} [Thu Sep 29 02:18:58 2022] DELETE /identity/v3/projects/3e502e64263941bea9844987d10bb352 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:18:58.182396 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa367e9-eb5f-4093-929e-8d811ee4b7cd None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:58.182681 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa367e9-eb5f-4093-929e-8d811ee4b7cd None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:58.182952 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa367e9-eb5f-4093-929e-8d811ee4b7cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:58.202405 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-caa367e9-eb5f-4093-929e-8d811ee4b7cd None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:18:58.203615 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-caa367e9-eb5f-4093-929e-8d811ee4b7cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:18:58.253641 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:18:58.264063 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1276/2550] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:18:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:18:58.272237 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca260e-a66b-40a5-be2c-68bd7ef36748 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:58.272523 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca260e-a66b-40a5-be2c-68bd7ef36748 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:58.272794 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca260e-a66b-40a5-be2c-68bd7ef36748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:58.292131 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-25ca260e-a66b-40a5-be2c-68bd7ef36748 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:18:58.293343 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-25ca260e-a66b-40a5-be2c-68bd7ef36748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:18:58.301123 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1275/2551] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:18:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:18:58.305341 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa367e9-eb5f-4093-929e-8d811ee4b7cd None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:58.315149 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa367e9-eb5f-4093-929e-8d811ee4b7cd None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:58.320249 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf09c8a2-9236-491f-b7bb-89ed3e89033f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:58.320843 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf09c8a2-9236-491f-b7bb-89ed3e89033f admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:58.321123 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf09c8a2-9236-491f-b7bb-89ed3e89033f admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:58.321432 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf09c8a2-9236-491f-b7bb-89ed3e89033f admin admin] PATH_INFO: `/v3/domains` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:58.322107 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf09c8a2-9236-491f-b7bb-89ed3e89033f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:18:58.322417 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf09c8a2-9236-491f-b7bb-89ed3e89033f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:58.324020 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf09c8a2-9236-491f-b7bb-89ed3e89033f admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:58.336063 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1277/2552] 10.222.0.49 () {58 vars in 1153 bytes} [Thu Sep 29 02:18:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:18:58.340252 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca260e-a66b-40a5-be2c-68bd7ef36748 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:58.349612 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca260e-a66b-40a5-be2c-68bd7ef36748 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:58.354193 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fed08ad-3fa8-4886-bdaa-c04ceae52b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:58.354777 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed08ad-3fa8-4886-bdaa-c04ceae52b75 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:58.355049 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed08ad-3fa8-4886-bdaa-c04ceae52b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:58.355313 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed08ad-3fa8-4886-bdaa-c04ceae52b75 admin admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:58.355940 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fed08ad-3fa8-4886-bdaa-c04ceae52b75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:58.357838 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fed08ad-3fa8-4886-bdaa-c04ceae52b75 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:58.384803 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1276/2553] 10.222.0.49 () {60 vars in 1153 bytes} [Thu Sep 29 02:18:58 2022] POST /identity/v3/projects => generated 369 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:18:58.389058 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf09c8a2-9236-491f-b7bb-89ed3e89033f admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:58.399601 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf09c8a2-9236-491f-b7bb-89ed3e89033f admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:58.461023 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa388f03-b3f7-49cf-9b97-5a1b95f84f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:58.461663 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa388f03-b3f7-49cf-9b97-5a1b95f84f38 admin admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:58.461942 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa388f03-b3f7-49cf-9b97-5a1b95f84f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:58.462212 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa388f03-b3f7-49cf-9b97-5a1b95f84f38 admin admin] PATH_INFO: `/v3/users` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:58.462852 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa388f03-b3f7-49cf-9b97-5a1b95f84f38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:58.464782 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa388f03-b3f7-49cf-9b97-5a1b95f84f38 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:58.488770 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1278/2554] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 02:18:58 2022] POST /identity/v3/users => generated 285 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:18:58.492010 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fed08ad-3fa8-4886-bdaa-c04ceae52b75 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:58.502231 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fed08ad-3fa8-4886-bdaa-c04ceae52b75 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:58.508015 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67022c1b-9b52-4002-aa4a-aa2ef1b10cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:58.508544 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67022c1b-9b52-4002-aa4a-aa2ef1b10cd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:58.508817 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67022c1b-9b52-4002-aa4a-aa2ef1b10cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:58.509079 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67022c1b-9b52-4002-aa4a-aa2ef1b10cd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:58.509746 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67022c1b-9b52-4002-aa4a-aa2ef1b10cd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:58.511315 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67022c1b-9b52-4002-aa4a-aa2ef1b10cd6 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:58.521479 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1277/2555] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:18:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:18:58.525539 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa388f03-b3f7-49cf-9b97-5a1b95f84f38 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:58.535288 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa388f03-b3f7-49cf-9b97-5a1b95f84f38 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:58.539785 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1644b591-552d-437c-b962-116710ebdf0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:58.540368 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1644b591-552d-437c-b962-116710ebdf0b admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:58.540644 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1644b591-552d-437c-b962-116710ebdf0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:58.540912 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1644b591-552d-437c-b962-116710ebdf0b admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:58.541582 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1644b591-552d-437c-b962-116710ebdf0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:58.543149 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1644b591-552d-437c-b962-116710ebdf0b admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:58.553469 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1279/2556] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:18:58 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:18:58.557773 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67022c1b-9b52-4002-aa4a-aa2ef1b10cd6 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:58.568945 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67022c1b-9b52-4002-aa4a-aa2ef1b10cd6 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:58.573496 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68feadf-ccc2-4455-bfa6-419996221bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:58.574127 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68feadf-ccc2-4455-bfa6-419996221bab admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:58.574404 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68feadf-ccc2-4455-bfa6-419996221bab admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:58.574673 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68feadf-ccc2-4455-bfa6-419996221bab admin admin] PATH_INFO: `/v3/projects/3c4c4ff258c042999742fcb68386a2ea/users/a159184c5ce740b3818bcbf85d2747d7/roles/f157f905c9c94ccfbfb46e52d443e8f2` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:58.590286 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68feadf-ccc2-4455-bfa6-419996221bab admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c4c4ff258c042999742fcb68386a2ea, user_id=a159184c5ce740b3818bcbf85d2747d7, role_id=f157f905c9c94ccfbfb46e52d443e8f2)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:58.592883 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68feadf-ccc2-4455-bfa6-419996221bab admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:58.605911 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1278/2557] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:18:58 2022] PUT /identity/v3/projects/3c4c4ff258c042999742fcb68386a2ea/users/a159184c5ce740b3818bcbf85d2747d7/roles/f157f905c9c94ccfbfb46e52d443e8f2 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:18:58.617657 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642611d1-e60b-4460-b8fb-b321534b550a None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:58.618137 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642611d1-e60b-4460-b8fb-b321534b550a None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:58.618268 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642611d1-e60b-4460-b8fb-b321534b550a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:58.647735 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-642611d1-e60b-4460-b8fb-b321534b550a None None] MFA Rules not processed for user `a159184c5ce740b3818bcbf85d2747d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:18:58.648929 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-642611d1-e60b-4460-b8fb-b321534b550a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:18:58.712687 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1280/2558] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:18:58 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:18:58.717083 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68feadf-ccc2-4455-bfa6-419996221bab admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:58.779136 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68feadf-ccc2-4455-bfa6-419996221bab admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:58.783660 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf973ff-9d0c-4ca4-8393-87cf1bde325d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:58.784257 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf973ff-9d0c-4ca4-8393-87cf1bde325d admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:58.784631 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf973ff-9d0c-4ca4-8393-87cf1bde325d admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:58.784904 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf973ff-9d0c-4ca4-8393-87cf1bde325d admin admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:58.785658 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf973ff-9d0c-4ca4-8393-87cf1bde325d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:58.787519 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf973ff-9d0c-4ca4-8393-87cf1bde325d admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:58.815227 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1279/2559] 10.222.0.49 () {60 vars in 1153 bytes} [Thu Sep 29 02:18:58 2022] POST /identity/v3/projects => generated 373 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:18:58.819899 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642611d1-e60b-4460-b8fb-b321534b550a None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:58.836099 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642611d1-e60b-4460-b8fb-b321534b550a None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:58.886084 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:18:58.894168 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa264ac1-e992-476f-84ae-f2302362d19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:58.894940 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa264ac1-e992-476f-84ae-f2302362d19a admin admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:58.895217 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa264ac1-e992-476f-84ae-f2302362d19a admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:58.895510 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa264ac1-e992-476f-84ae-f2302362d19a admin admin] PATH_INFO: `/v3/users` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:58.896137 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa264ac1-e992-476f-84ae-f2302362d19a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:58.898127 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa264ac1-e992-476f-84ae-f2302362d19a admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:58.920666 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1281/2560] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 02:18:58 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:18:58.924912 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf973ff-9d0c-4ca4-8393-87cf1bde325d admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:58.935802 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf973ff-9d0c-4ca4-8393-87cf1bde325d admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:58.940413 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba78a690-b6a5-4e2f-9335-4c9f8b5b0d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:58.941054 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba78a690-b6a5-4e2f-9335-4c9f8b5b0d87 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:58.941354 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba78a690-b6a5-4e2f-9335-4c9f8b5b0d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:58.941634 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba78a690-b6a5-4e2f-9335-4c9f8b5b0d87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:58.942277 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba78a690-b6a5-4e2f-9335-4c9f8b5b0d87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:58.943874 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba78a690-b6a5-4e2f-9335-4c9f8b5b0d87 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:58.954153 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1280/2561] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:18:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:18:58.958213 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa264ac1-e992-476f-84ae-f2302362d19a admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:58.968446 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa264ac1-e992-476f-84ae-f2302362d19a admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:58.973771 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f75747-8144-4abf-ba12-3f3083a56afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:58.974412 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f75747-8144-4abf-ba12-3f3083a56afd admin admin] REQUEST_METHOD: `PUT` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:58.974688 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f75747-8144-4abf-ba12-3f3083a56afd admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:58.974958 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f75747-8144-4abf-ba12-3f3083a56afd admin admin] PATH_INFO: `/v3/projects/b585d5d822e3494c8b3cce249748867e/users/05b28f05bf2347ee875af56419b3b359/roles/fe9bbc67742f4f5893f39b18eb31d59a` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:58.990400 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f75747-8144-4abf-ba12-3f3083a56afd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b585d5d822e3494c8b3cce249748867e, user_id=05b28f05bf2347ee875af56419b3b359, role_id=fe9bbc67742f4f5893f39b18eb31d59a)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:58.993005 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f75747-8144-4abf-ba12-3f3083a56afd admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:59.006828 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1282/2562] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:18:58 2022] PUT /identity/v3/projects/b585d5d822e3494c8b3cce249748867e/users/05b28f05bf2347ee875af56419b3b359/roles/fe9bbc67742f4f5893f39b18eb31d59a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:18:59.010760 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba78a690-b6a5-4e2f-9335-4c9f8b5b0d87 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:59.020551 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba78a690-b6a5-4e2f-9335-4c9f8b5b0d87 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:59.053321 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:18:59.087769 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa25389-b396-44bc-b25f-57d7357d861c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:59.088451 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa25389-b396-44bc-b25f-57d7357d861c admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:59.088731 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa25389-b396-44bc-b25f-57d7357d861c admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:59.089025 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa25389-b396-44bc-b25f-57d7357d861c admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:59.089699 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa25389-b396-44bc-b25f-57d7357d861c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:59.091279 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa25389-b396-44bc-b25f-57d7357d861c admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:59.101420 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1281/2563] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:18:59 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:18:59.105628 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f75747-8144-4abf-ba12-3f3083a56afd admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:59.116349 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f75747-8144-4abf-ba12-3f3083a56afd admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:59.120836 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a6d063-af19-4c8f-9985-cb4da844c05c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:59.121517 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a6d063-af19-4c8f-9985-cb4da844c05c admin admin] REQUEST_METHOD: `PUT` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:59.121793 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a6d063-af19-4c8f-9985-cb4da844c05c admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:59.122062 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a6d063-af19-4c8f-9985-cb4da844c05c admin admin] PATH_INFO: `/v3/projects/b585d5d822e3494c8b3cce249748867e/users/05b28f05bf2347ee875af56419b3b359/roles/fe9bbc67742f4f5893f39b18eb31d59a` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:59.123974 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a6d063-af19-4c8f-9985-cb4da844c05c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b585d5d822e3494c8b3cce249748867e, user_id=05b28f05bf2347ee875af56419b3b359, role_id=fe9bbc67742f4f5893f39b18eb31d59a)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:59.126638 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a6d063-af19-4c8f-9985-cb4da844c05c admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:59.138795 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1283/2564] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:18:59 2022] PUT /identity/v3/projects/b585d5d822e3494c8b3cce249748867e/users/05b28f05bf2347ee875af56419b3b359/roles/fe9bbc67742f4f5893f39b18eb31d59a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:18:59.150044 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3dadb4-5bc3-431c-b62b-570cbf349a01 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:59.150334 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3dadb4-5bc3-431c-b62b-570cbf349a01 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:59.150606 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3dadb4-5bc3-431c-b62b-570cbf349a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:59.178648 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-dd3dadb4-5bc3-431c-b62b-570cbf349a01 None None] MFA Rules not processed for user `05b28f05bf2347ee875af56419b3b359`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:18:59.179887 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-dd3dadb4-5bc3-431c-b62b-570cbf349a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:18:59.246105 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1282/2565] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:18:59 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:18:59.258762 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a6d063-af19-4c8f-9985-cb4da844c05c admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:59.260460 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-b6a6d063-af19-4c8f-9985-cb4da844c05c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:18:59.317455 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a6d063-af19-4c8f-9985-cb4da844c05c admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:59.320960 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aa1139-f380-45f2-a1a7-4a267ac135ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75135b856134ba4b9ccac337886f682', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:59.321608 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa1139-f380-45f2-a1a7-4a267ac135ce service cinder] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:59.321886 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa1139-f380-45f2-a1a7-4a267ac135ce service cinder] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:59.322157 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa1139-f380-45f2-a1a7-4a267ac135ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:59.331061 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aa1139-f380-45f2-a1a7-4a267ac135ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:59.332711 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aa1139-f380-45f2-a1a7-4a267ac135ce service cinder] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:59.342017 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1284/2566] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:18:59 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:18:59.418667 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3dadb4-5bc3-431c-b62b-570cbf349a01 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:18:59.430129 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3dadb4-5bc3-431c-b62b-570cbf349a01 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:18:59.435614 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd87f340-9499-4cf2-a61e-5832c91b264a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75135b856134ba4b9ccac337886f682', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:18:59.436646 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd87f340-9499-4cf2-a61e-5832c91b264a service cinder] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:18:59.437129 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd87f340-9499-4cf2-a61e-5832c91b264a service cinder] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:18:59.437669 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd87f340-9499-4cf2-a61e-5832c91b264a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:18:59.495637 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd87f340-9499-4cf2-a61e-5832c91b264a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:18:59.497055 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd87f340-9499-4cf2-a61e-5832c91b264a service cinder] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:18:59.506741 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1283/2567] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:18:59 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:19:09.337928 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=45,keystone:INSERT=5 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:19:09.501950 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=79 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:19:14.245146 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aa1139-f380-45f2-a1a7-4a267ac135ce service cinder] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:14.246673 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-97aa1139-f380-45f2-a1a7-4a267ac135ce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:14.334022 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aa1139-f380-45f2-a1a7-4a267ac135ce service cinder] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:14.340852 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d2eee2-62af-49cb-8f6d-d03cfbae779d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:14.341723 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d2eee2-62af-49cb-8f6d-d03cfbae779d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:14.341997 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d2eee2-62af-49cb-8f6d-d03cfbae779d admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:14.342318 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d2eee2-62af-49cb-8f6d-d03cfbae779d admin admin] PATH_INFO: `/v3/users/81b66c402e9b426394c273175f4b5fca` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:14.344010 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d2eee2-62af-49cb-8f6d-d03cfbae779d admin admin] RBAC: Authorizing `identity:delete_user(user_id=81b66c402e9b426394c273175f4b5fca)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:14.346939 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d2eee2-62af-49cb-8f6d-d03cfbae779d admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:14.404011 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-73d2eee2-62af-49cb-8f6d-d03cfbae779d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81b66c402e9b426394c273175f4b5fca'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:14.404671 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-73d2eee2-62af-49cb-8f6d-d03cfbae779d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81b66c402e9b426394c273175f4b5fca'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:14.417747 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-73d2eee2-62af-49cb-8f6d-d03cfbae779d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81b66c402e9b426394c273175f4b5fca'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:14.429486 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-73d2eee2-62af-49cb-8f6d-d03cfbae779d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81b66c402e9b426394c273175f4b5fca'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:14.430110 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-73d2eee2-62af-49cb-8f6d-d03cfbae779d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81b66c402e9b426394c273175f4b5fca'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:14.445051 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1285/2568] 10.222.0.49 () {58 vars in 1224 bytes} [Thu Sep 29 02:19:14 2022] DELETE /identity/v3/users/81b66c402e9b426394c273175f4b5fca => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:19:14.691102 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd87f340-9499-4cf2-a61e-5832c91b264a service cinder] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:14.703216 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd87f340-9499-4cf2-a61e-5832c91b264a service cinder] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:14.761443 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084e3374-f201-44a3-a87b-ca962a7a83c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:14.762065 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e3374-f201-44a3-a87b-ca962a7a83c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:14.762340 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e3374-f201-44a3-a87b-ca962a7a83c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:14.762608 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e3374-f201-44a3-a87b-ca962a7a83c0 admin admin] PATH_INFO: `/v3/projects/df0405453f304b0091c0d9eda1c17725` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:14.763706 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084e3374-f201-44a3-a87b-ca962a7a83c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df0405453f304b0091c0d9eda1c17725)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:14.765617 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084e3374-f201-44a3-a87b-ca962a7a83c0 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:14.810966 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-084e3374-f201-44a3-a87b-ca962a7a83c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df0405453f304b0091c0d9eda1c17725', 'request_id': 'req-084e3374-f201-44a3-a87b-ca962a7a83c0'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:14.817116 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-084e3374-f201-44a3-a87b-ca962a7a83c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df0405453f304b0091c0d9eda1c17725', 'request_id': 'req-084e3374-f201-44a3-a87b-ca962a7a83c0'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:14.824326 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-084e3374-f201-44a3-a87b-ca962a7a83c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df0405453f304b0091c0d9eda1c17725', 'request_id': 'req-084e3374-f201-44a3-a87b-ca962a7a83c0'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:14.834847 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-084e3374-f201-44a3-a87b-ca962a7a83c0 admin admin] The token cache is being invalidate because project df0405453f304b0091c0d9eda1c17725 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81649) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:19:14.835187 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-084e3374-f201-44a3-a87b-ca962a7a83c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:14.835755 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-084e3374-f201-44a3-a87b-ca962a7a83c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:14.837220 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1284/2569] 10.222.0.49 () {58 vars in 1233 bytes} [Thu Sep 29 02:19:14 2022] DELETE /identity/v3/projects/df0405453f304b0091c0d9eda1c17725 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:19:14.841185 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d2eee2-62af-49cb-8f6d-d03cfbae779d admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:14.842602 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-73d2eee2-62af-49cb-8f6d-d03cfbae779d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:14.856135 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d2eee2-62af-49cb-8f6d-d03cfbae779d admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:14.913173 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee2e039-1b24-4756-88aa-557d12474a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:14.913840 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee2e039-1b24-4756-88aa-557d12474a5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:14.914120 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee2e039-1b24-4756-88aa-557d12474a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:14.914391 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee2e039-1b24-4756-88aa-557d12474a5b admin admin] PATH_INFO: `/v3/users/9f4418744cfb4628816d23bf5856695e` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:14.915519 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee2e039-1b24-4756-88aa-557d12474a5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f4418744cfb4628816d23bf5856695e)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:14.917471 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee2e039-1b24-4756-88aa-557d12474a5b admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:14.939039 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:19:14.966885 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-dee2e039-1b24-4756-88aa-557d12474a5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f4418744cfb4628816d23bf5856695e'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:14.967529 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-dee2e039-1b24-4756-88aa-557d12474a5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f4418744cfb4628816d23bf5856695e'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:14.979455 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-dee2e039-1b24-4756-88aa-557d12474a5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f4418744cfb4628816d23bf5856695e'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:14.988017 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-dee2e039-1b24-4756-88aa-557d12474a5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f4418744cfb4628816d23bf5856695e'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:14.988658 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-dee2e039-1b24-4756-88aa-557d12474a5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f4418744cfb4628816d23bf5856695e'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:15.000794 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1286/2570] 10.222.0.49 () {58 vars in 1224 bytes} [Thu Sep 29 02:19:14 2022] DELETE /identity/v3/users/9f4418744cfb4628816d23bf5856695e => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:19:15.177616 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084e3374-f201-44a3-a87b-ca962a7a83c0 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:15.179078 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-084e3374-f201-44a3-a87b-ca962a7a83c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:15.193503 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084e3374-f201-44a3-a87b-ca962a7a83c0 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:15.250849 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a4871f-c882-4343-8b77-c321b3562c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:15.251502 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a4871f-c882-4343-8b77-c321b3562c1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:15.252332 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a4871f-c882-4343-8b77-c321b3562c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:15.252601 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a4871f-c882-4343-8b77-c321b3562c1c admin admin] PATH_INFO: `/v3/projects/f024de3be4b546368070c6bde987fcb3` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:15.253978 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a4871f-c882-4343-8b77-c321b3562c1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f024de3be4b546368070c6bde987fcb3)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:15.255855 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a4871f-c882-4343-8b77-c321b3562c1c admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:15.292481 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:19:15.306503 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-26a4871f-c882-4343-8b77-c321b3562c1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f024de3be4b546368070c6bde987fcb3', 'request_id': 'req-26a4871f-c882-4343-8b77-c321b3562c1c'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:15.312680 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-26a4871f-c882-4343-8b77-c321b3562c1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f024de3be4b546368070c6bde987fcb3', 'request_id': 'req-26a4871f-c882-4343-8b77-c321b3562c1c'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:15.320455 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-26a4871f-c882-4343-8b77-c321b3562c1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f024de3be4b546368070c6bde987fcb3', 'request_id': 'req-26a4871f-c882-4343-8b77-c321b3562c1c'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:15.331304 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-26a4871f-c882-4343-8b77-c321b3562c1c admin admin] The token cache is being invalidate because project f024de3be4b546368070c6bde987fcb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81649) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:19:15.331589 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-26a4871f-c882-4343-8b77-c321b3562c1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:15.332214 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-26a4871f-c882-4343-8b77-c321b3562c1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:15.333731 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1285/2571] 10.222.0.49 () {58 vars in 1233 bytes} [Thu Sep 29 02:19:15 2022] DELETE /identity/v3/projects/f024de3be4b546368070c6bde987fcb3 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:19:19.985543 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65d1395-e7dc-468f-91a3-ab2696c13243 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:19.986076 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65d1395-e7dc-468f-91a3-ab2696c13243 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:19.986351 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65d1395-e7dc-468f-91a3-ab2696c13243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:20.005679 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-f65d1395-e7dc-468f-91a3-ab2696c13243 None None] MFA Rules not processed for user `f68a35fdeeea469f873ec50671fc35f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:19:20.006882 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-f65d1395-e7dc-468f-91a3-ab2696c13243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:20.060207 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1287/2572] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:19:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:19:25.327691 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=12,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:19:29.232010 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a4871f-c882-4343-8b77-c321b3562c1c admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:29.233578 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-26a4871f-c882-4343-8b77-c321b3562c1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:29.297486 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a4871f-c882-4343-8b77-c321b3562c1c admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:29.302066 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b08d16-ea07-48eb-8999-7fd8461a4a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:29.302692 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b08d16-ea07-48eb-8999-7fd8461a4a63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:29.302971 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b08d16-ea07-48eb-8999-7fd8461a4a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:29.303245 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b08d16-ea07-48eb-8999-7fd8461a4a63 admin admin] PATH_INFO: `/v3/users/a159184c5ce740b3818bcbf85d2747d7` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:29.304353 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b08d16-ea07-48eb-8999-7fd8461a4a63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a159184c5ce740b3818bcbf85d2747d7)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:29.306282 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b08d16-ea07-48eb-8999-7fd8461a4a63 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:29.354623 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-10b08d16-ea07-48eb-8999-7fd8461a4a63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a159184c5ce740b3818bcbf85d2747d7'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:29.355391 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-10b08d16-ea07-48eb-8999-7fd8461a4a63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a159184c5ce740b3818bcbf85d2747d7'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:29.368962 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-10b08d16-ea07-48eb-8999-7fd8461a4a63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a159184c5ce740b3818bcbf85d2747d7'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:29.376044 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-10b08d16-ea07-48eb-8999-7fd8461a4a63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a159184c5ce740b3818bcbf85d2747d7'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:29.376750 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-10b08d16-ea07-48eb-8999-7fd8461a4a63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a159184c5ce740b3818bcbf85d2747d7'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:29.389997 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1286/2573] 10.222.0.49 () {58 vars in 1224 bytes} [Thu Sep 29 02:19:29 2022] DELETE /identity/v3/users/a159184c5ce740b3818bcbf85d2747d7 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:19:29.396012 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f315e38a-3c1e-4502-afd2-e281d330f439 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:29.396012 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f315e38a-3c1e-4502-afd2-e281d330f439 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:29.396558 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f315e38a-3c1e-4502-afd2-e281d330f439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:29.416550 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-f315e38a-3c1e-4502-afd2-e281d330f439 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:19:29.417801 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-f315e38a-3c1e-4502-afd2-e281d330f439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:29.480804 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1288/2574] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:19:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 29 02:19:29.491237 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b08d16-ea07-48eb-8999-7fd8461a4a63 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:29.492703 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-10b08d16-ea07-48eb-8999-7fd8461a4a63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:29.553221 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b08d16-ea07-48eb-8999-7fd8461a4a63 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:29.556842 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47b50ad-eef6-4775-9194-49fa2273d166 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:29.557479 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47b50ad-eef6-4775-9194-49fa2273d166 service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:29.557757 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47b50ad-eef6-4775-9194-49fa2273d166 service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:29.558031 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47b50ad-eef6-4775-9194-49fa2273d166 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:29.568342 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47b50ad-eef6-4775-9194-49fa2273d166 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:29.569852 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47b50ad-eef6-4775-9194-49fa2273d166 service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:29.580560 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1287/2575] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:19:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:19:29.959667 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f315e38a-3c1e-4502-afd2-e281d330f439 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:29.961187 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-f315e38a-3c1e-4502-afd2-e281d330f439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:29.974459 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f315e38a-3c1e-4502-afd2-e281d330f439 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:29.979394 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94d14b6-cdbf-44b9-a9d1-d8d0648e0ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:29.979934 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d14b6-cdbf-44b9-a9d1-d8d0648e0ada admin admin] REQUEST_METHOD: `DELETE` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:29.980212 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d14b6-cdbf-44b9-a9d1-d8d0648e0ada admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:29.980477 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d14b6-cdbf-44b9-a9d1-d8d0648e0ada admin admin] PATH_INFO: `/v3/projects/3c4c4ff258c042999742fcb68386a2ea` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:29.981621 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94d14b6-cdbf-44b9-a9d1-d8d0648e0ada admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c4c4ff258c042999742fcb68386a2ea)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:29.983516 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94d14b6-cdbf-44b9-a9d1-d8d0648e0ada admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:30.031307 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:19:30.046596 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-a94d14b6-cdbf-44b9-a9d1-d8d0648e0ada admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c4c4ff258c042999742fcb68386a2ea', 'request_id': 'req-a94d14b6-cdbf-44b9-a9d1-d8d0648e0ada'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:30.055258 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-a94d14b6-cdbf-44b9-a9d1-d8d0648e0ada admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c4c4ff258c042999742fcb68386a2ea', 'request_id': 'req-a94d14b6-cdbf-44b9-a9d1-d8d0648e0ada'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:30.065384 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-a94d14b6-cdbf-44b9-a9d1-d8d0648e0ada admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c4c4ff258c042999742fcb68386a2ea', 'request_id': 'req-a94d14b6-cdbf-44b9-a9d1-d8d0648e0ada'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:30.081442 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-a94d14b6-cdbf-44b9-a9d1-d8d0648e0ada admin admin] The token cache is being invalidate because project 3c4c4ff258c042999742fcb68386a2ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81648) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:19:30.081802 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-a94d14b6-cdbf-44b9-a9d1-d8d0648e0ada admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:30.082525 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-a94d14b6-cdbf-44b9-a9d1-d8d0648e0ada admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:30.084554 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1289/2576] 10.222.0.49 () {58 vars in 1233 bytes} [Thu Sep 29 02:19:29 2022] DELETE /identity/v3/projects/3c4c4ff258c042999742fcb68386a2ea => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:19:30.088809 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47b50ad-eef6-4775-9194-49fa2273d166 service neutron] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:30.099689 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47b50ad-eef6-4775-9194-49fa2273d166 service neutron] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:30.128210 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:19:30.175275 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf04cc-bf44-4be5-ab77-750a830fdecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:30.175979 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf04cc-bf44-4be5-ab77-750a830fdecc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:30.176319 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf04cc-bf44-4be5-ab77-750a830fdecc admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:30.176651 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf04cc-bf44-4be5-ab77-750a830fdecc admin admin] PATH_INFO: `/v3/users/05b28f05bf2347ee875af56419b3b359` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:30.177889 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecf04cc-bf44-4be5-ab77-750a830fdecc admin admin] RBAC: Authorizing `identity:delete_user(user_id=05b28f05bf2347ee875af56419b3b359)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:30.179856 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecf04cc-bf44-4be5-ab77-750a830fdecc admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:30.227746 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-3ecf04cc-bf44-4be5-ab77-750a830fdecc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05b28f05bf2347ee875af56419b3b359'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:30.228406 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-3ecf04cc-bf44-4be5-ab77-750a830fdecc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05b28f05bf2347ee875af56419b3b359'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:30.241347 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-3ecf04cc-bf44-4be5-ab77-750a830fdecc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05b28f05bf2347ee875af56419b3b359'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:30.248633 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-3ecf04cc-bf44-4be5-ab77-750a830fdecc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05b28f05bf2347ee875af56419b3b359'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:30.249249 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-3ecf04cc-bf44-4be5-ab77-750a830fdecc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05b28f05bf2347ee875af56419b3b359'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:30.262023 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1288/2577] 10.222.0.49 () {58 vars in 1224 bytes} [Thu Sep 29 02:19:30 2022] DELETE /identity/v3/users/05b28f05bf2347ee875af56419b3b359 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:19:30.537500 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94d14b6-cdbf-44b9-a9d1-d8d0648e0ada admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:30.538923 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-a94d14b6-cdbf-44b9-a9d1-d8d0648e0ada admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:30.554015 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94d14b6-cdbf-44b9-a9d1-d8d0648e0ada admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:30.614537 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c30da7-3d2e-4e2c-bb1b-66c15e52b9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:30.615170 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c30da7-3d2e-4e2c-bb1b-66c15e52b9cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:30.615447 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c30da7-3d2e-4e2c-bb1b-66c15e52b9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:30.615718 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c30da7-3d2e-4e2c-bb1b-66c15e52b9cd admin admin] PATH_INFO: `/v3/projects/b585d5d822e3494c8b3cce249748867e` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:30.616836 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c30da7-3d2e-4e2c-bb1b-66c15e52b9cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=b585d5d822e3494c8b3cce249748867e)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:30.618800 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c30da7-3d2e-4e2c-bb1b-66c15e52b9cd admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:30.664592 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-43c30da7-3d2e-4e2c-bb1b-66c15e52b9cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b585d5d822e3494c8b3cce249748867e', 'request_id': 'req-43c30da7-3d2e-4e2c-bb1b-66c15e52b9cd'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:30.670679 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-43c30da7-3d2e-4e2c-bb1b-66c15e52b9cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b585d5d822e3494c8b3cce249748867e', 'request_id': 'req-43c30da7-3d2e-4e2c-bb1b-66c15e52b9cd'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:30.681661 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-43c30da7-3d2e-4e2c-bb1b-66c15e52b9cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b585d5d822e3494c8b3cce249748867e', 'request_id': 'req-43c30da7-3d2e-4e2c-bb1b-66c15e52b9cd'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:30.692490 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-43c30da7-3d2e-4e2c-bb1b-66c15e52b9cd admin admin] The token cache is being invalidate because project b585d5d822e3494c8b3cce249748867e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81648) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:19:30.692779 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-43c30da7-3d2e-4e2c-bb1b-66c15e52b9cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:30.693452 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-43c30da7-3d2e-4e2c-bb1b-66c15e52b9cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:30.694917 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1290/2578] 10.222.0.49 () {58 vars in 1233 bytes} [Thu Sep 29 02:19:30 2022] DELETE /identity/v3/projects/b585d5d822e3494c8b3cce249748867e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:19:30.700023 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95546f8-19d4-4c0b-9e33-eb5da3401d82 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:30.700309 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95546f8-19d4-4c0b-9e33-eb5da3401d82 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:30.700579 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95546f8-19d4-4c0b-9e33-eb5da3401d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:30.721380 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-a95546f8-19d4-4c0b-9e33-eb5da3401d82 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:19:30.722618 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-a95546f8-19d4-4c0b-9e33-eb5da3401d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:30.784443 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1289/2579] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:19:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:19:30.793883 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b536131-65fd-47b5-892d-bb8feba9d404 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:30.794172 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b536131-65fd-47b5-892d-bb8feba9d404 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:30.794447 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b536131-65fd-47b5-892d-bb8feba9d404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:30.814763 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-1b536131-65fd-47b5-892d-bb8feba9d404 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:19:30.816008 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-1b536131-65fd-47b5-892d-bb8feba9d404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:30.823732 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1291/2580] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:19:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:19:30.827949 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95546f8-19d4-4c0b-9e33-eb5da3401d82 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:30.838268 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95546f8-19d4-4c0b-9e33-eb5da3401d82 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:30.842809 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b027ca-64da-432c-a2e7-d7add22abb30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:30.843398 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b027ca-64da-432c-a2e7-d7add22abb30 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:30.843675 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b027ca-64da-432c-a2e7-d7add22abb30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:30.843964 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b027ca-64da-432c-a2e7-d7add22abb30 admin admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:30.845555 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b027ca-64da-432c-a2e7-d7add22abb30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:19:30.845857 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b027ca-64da-432c-a2e7-d7add22abb30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:30.847429 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b027ca-64da-432c-a2e7-d7add22abb30 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:30.858940 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1290/2581] 10.222.0.49 () {58 vars in 1153 bytes} [Thu Sep 29 02:19:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 02:19:30.863152 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b536131-65fd-47b5-892d-bb8feba9d404 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:30.872372 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b536131-65fd-47b5-892d-bb8feba9d404 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:30.877253 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cf218e-c47a-4237-9dc3-a709e6b9e8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:30.877906 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cf218e-c47a-4237-9dc3-a709e6b9e8be admin admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:30.878182 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cf218e-c47a-4237-9dc3-a709e6b9e8be admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:30.878452 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cf218e-c47a-4237-9dc3-a709e6b9e8be admin admin] PATH_INFO: `/v3/projects` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:30.879085 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cf218e-c47a-4237-9dc3-a709e6b9e8be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:30.881006 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cf218e-c47a-4237-9dc3-a709e6b9e8be admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:30.910795 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1292/2582] 10.222.0.49 () {60 vars in 1153 bytes} [Thu Sep 29 02:19:30 2022] POST /identity/v3/projects => generated 367 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:19:30.914982 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b027ca-64da-432c-a2e7-d7add22abb30 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:30.925480 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b027ca-64da-432c-a2e7-d7add22abb30 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:30.950534 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:19:30.983637 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4bf87d-35d1-4a12-a743-9fec606c1399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:30.984243 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4bf87d-35d1-4a12-a743-9fec606c1399 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:30.984525 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4bf87d-35d1-4a12-a743-9fec606c1399 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:30.984798 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4bf87d-35d1-4a12-a743-9fec606c1399 admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:30.986142 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4bf87d-35d1-4a12-a743-9fec606c1399 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:30.988045 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4bf87d-35d1-4a12-a743-9fec606c1399 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:31.008617 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1291/2583] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 02:19:30 2022] POST /identity/v3/users => generated 284 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 29 02:19:31.013185 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cf218e-c47a-4237-9dc3-a709e6b9e8be admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:31.025814 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cf218e-c47a-4237-9dc3-a709e6b9e8be admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:31.030275 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63705b64-9def-4726-a59b-f392792ef86c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:31.030864 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63705b64-9def-4726-a59b-f392792ef86c admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:31.031140 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63705b64-9def-4726-a59b-f392792ef86c admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:31.031557 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63705b64-9def-4726-a59b-f392792ef86c admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:31.032987 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63705b64-9def-4726-a59b-f392792ef86c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:31.034611 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63705b64-9def-4726-a59b-f392792ef86c admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:31.044410 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1293/2584] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:19:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:19:31.048556 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4bf87d-35d1-4a12-a743-9fec606c1399 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:31.058491 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4bf87d-35d1-4a12-a743-9fec606c1399 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:31.063069 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a381210-84b7-427d-adff-8dc964ac668c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:31.063804 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a381210-84b7-427d-adff-8dc964ac668c admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:31.064081 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a381210-84b7-427d-adff-8dc964ac668c admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:31.064355 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a381210-84b7-427d-adff-8dc964ac668c admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:31.065000 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a381210-84b7-427d-adff-8dc964ac668c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:31.066647 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a381210-84b7-427d-adff-8dc964ac668c admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:31.077016 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1292/2585] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:19:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 29 02:19:31.081594 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63705b64-9def-4726-a59b-f392792ef86c admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:31.091647 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63705b64-9def-4726-a59b-f392792ef86c admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:31.097034 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1165d47a-c0e2-4fa9-b062-7d63f7b43e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:31.097715 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1165d47a-c0e2-4fa9-b062-7d63f7b43e46 admin admin] REQUEST_METHOD: `PUT` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:31.097996 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1165d47a-c0e2-4fa9-b062-7d63f7b43e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:31.098269 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1165d47a-c0e2-4fa9-b062-7d63f7b43e46 admin admin] PATH_INFO: `/v3/projects/95d6342866eb441482460d2e7a9b8184/users/993942c183754a13a80175d81006d7ed/roles/f157f905c9c94ccfbfb46e52d443e8f2` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:31.113916 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1165d47a-c0e2-4fa9-b062-7d63f7b43e46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95d6342866eb441482460d2e7a9b8184, user_id=993942c183754a13a80175d81006d7ed, role_id=f157f905c9c94ccfbfb46e52d443e8f2)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:31.116545 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1165d47a-c0e2-4fa9-b062-7d63f7b43e46 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:31.118814 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:19:31.139410 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1294/2586] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:19:31 2022] PUT /identity/v3/projects/95d6342866eb441482460d2e7a9b8184/users/993942c183754a13a80175d81006d7ed/roles/f157f905c9c94ccfbfb46e52d443e8f2 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:19:31.150498 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e65bcfd-095e-4c4f-b1a1-178c803d6fb0 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:31.150782 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e65bcfd-095e-4c4f-b1a1-178c803d6fb0 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:31.151052 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e65bcfd-095e-4c4f-b1a1-178c803d6fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:31.178455 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-5e65bcfd-095e-4c4f-b1a1-178c803d6fb0 None None] MFA Rules not processed for user `993942c183754a13a80175d81006d7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:19:31.179692 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-5e65bcfd-095e-4c4f-b1a1-178c803d6fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:31.246697 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1293/2587] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:19:31 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:19:31.252338 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1165d47a-c0e2-4fa9-b062-7d63f7b43e46 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:31.317055 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1165d47a-c0e2-4fa9-b062-7d63f7b43e46 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:31.321714 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b0b4bc-e001-451c-be0e-7ec760e25eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:31.322324 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b0b4bc-e001-451c-be0e-7ec760e25eda admin admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:31.322604 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b0b4bc-e001-451c-be0e-7ec760e25eda admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:31.323245 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b0b4bc-e001-451c-be0e-7ec760e25eda admin admin] PATH_INFO: `/v3/projects` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:31.323891 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b0b4bc-e001-451c-be0e-7ec760e25eda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:31.326061 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b0b4bc-e001-451c-be0e-7ec760e25eda admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:31.356520 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1295/2588] 10.222.0.49 () {60 vars in 1153 bytes} [Thu Sep 29 02:19:31 2022] POST /identity/v3/projects => generated 367 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:19:31.361501 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e65bcfd-095e-4c4f-b1a1-178c803d6fb0 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:31.372273 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e65bcfd-095e-4c4f-b1a1-178c803d6fb0 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:31.430676 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62ec96f-d3df-4c38-a43b-3b71fa54e044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:31.431283 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ec96f-d3df-4c38-a43b-3b71fa54e044 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:31.431557 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ec96f-d3df-4c38-a43b-3b71fa54e044 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:31.431823 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ec96f-d3df-4c38-a43b-3b71fa54e044 admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:31.432465 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62ec96f-d3df-4c38-a43b-3b71fa54e044 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:31.434431 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62ec96f-d3df-4c38-a43b-3b71fa54e044 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:31.455913 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1294/2589] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 02:19:31 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:19:31.460019 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b0b4bc-e001-451c-be0e-7ec760e25eda admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:31.470211 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b0b4bc-e001-451c-be0e-7ec760e25eda admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:31.474824 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9645cbd-7120-4f0f-bc32-79c6be6217f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:31.475410 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9645cbd-7120-4f0f-bc32-79c6be6217f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:31.475684 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9645cbd-7120-4f0f-bc32-79c6be6217f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:31.475948 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9645cbd-7120-4f0f-bc32-79c6be6217f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:31.476576 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9645cbd-7120-4f0f-bc32-79c6be6217f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:31.478179 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9645cbd-7120-4f0f-bc32-79c6be6217f3 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:31.489230 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1296/2590] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:19:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:19:31.493151 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62ec96f-d3df-4c38-a43b-3b71fa54e044 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:31.504308 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62ec96f-d3df-4c38-a43b-3b71fa54e044 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:31.508800 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f8a78a-2c95-42c3-bcfa-151b1227fd05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:31.509477 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f8a78a-2c95-42c3-bcfa-151b1227fd05 admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:31.509754 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f8a78a-2c95-42c3-bcfa-151b1227fd05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:31.510025 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f8a78a-2c95-42c3-bcfa-151b1227fd05 admin admin] PATH_INFO: `/v3/projects/6ba552db8a624b98b2a5d08b411c6f23/users/8422dc43693346f4b899bf9097774d7d/roles/fe9bbc67742f4f5893f39b18eb31d59a` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:31.524320 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f8a78a-2c95-42c3-bcfa-151b1227fd05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ba552db8a624b98b2a5d08b411c6f23, user_id=8422dc43693346f4b899bf9097774d7d, role_id=fe9bbc67742f4f5893f39b18eb31d59a)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:31.526986 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f8a78a-2c95-42c3-bcfa-151b1227fd05 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:31.539956 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1295/2591] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:19:31 2022] PUT /identity/v3/projects/6ba552db8a624b98b2a5d08b411c6f23/users/8422dc43693346f4b899bf9097774d7d/roles/fe9bbc67742f4f5893f39b18eb31d59a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:19:31.543951 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9645cbd-7120-4f0f-bc32-79c6be6217f3 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:31.554574 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9645cbd-7120-4f0f-bc32-79c6be6217f3 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:31.612818 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d082e925-73d9-4ade-8091-1cd8d261ab83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:31.613460 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d082e925-73d9-4ade-8091-1cd8d261ab83 admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:31.613738 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d082e925-73d9-4ade-8091-1cd8d261ab83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:31.614083 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d082e925-73d9-4ade-8091-1cd8d261ab83 admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:31.614631 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d082e925-73d9-4ade-8091-1cd8d261ab83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:31.616209 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d082e925-73d9-4ade-8091-1cd8d261ab83 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:31.626736 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1297/2592] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:19:31 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:19:31.631116 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f8a78a-2c95-42c3-bcfa-151b1227fd05 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:31.637270 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:19:31.644245 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f8a78a-2c95-42c3-bcfa-151b1227fd05 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:31.649205 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9fa693-9cc4-4a09-a85b-ac1f6da6a42e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:31.649957 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9fa693-9cc4-4a09-a85b-ac1f6da6a42e admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:31.650302 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9fa693-9cc4-4a09-a85b-ac1f6da6a42e admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:31.650640 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9fa693-9cc4-4a09-a85b-ac1f6da6a42e admin admin] PATH_INFO: `/v3/projects/6ba552db8a624b98b2a5d08b411c6f23/users/8422dc43693346f4b899bf9097774d7d/roles/fe9bbc67742f4f5893f39b18eb31d59a` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:31.652652 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9fa693-9cc4-4a09-a85b-ac1f6da6a42e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ba552db8a624b98b2a5d08b411c6f23, user_id=8422dc43693346f4b899bf9097774d7d, role_id=fe9bbc67742f4f5893f39b18eb31d59a)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:31.655462 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9fa693-9cc4-4a09-a85b-ac1f6da6a42e admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:31.683395 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1296/2593] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:19:31 2022] PUT /identity/v3/projects/6ba552db8a624b98b2a5d08b411c6f23/users/8422dc43693346f4b899bf9097774d7d/roles/fe9bbc67742f4f5893f39b18eb31d59a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:19:31.695195 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ab956-dca3-41f6-88e1-e5e138842908 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:31.695555 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ab956-dca3-41f6-88e1-e5e138842908 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:31.695732 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ab956-dca3-41f6-88e1-e5e138842908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:31.738186 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-455ab956-dca3-41f6-88e1-e5e138842908 None None] MFA Rules not processed for user `8422dc43693346f4b899bf9097774d7d`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:19:31.739399 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-455ab956-dca3-41f6-88e1-e5e138842908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:31.785177 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:19:31.848511 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1298/2594] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:19:31 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 29 02:19:31.859421 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9fa693-9cc4-4a09-a85b-ac1f6da6a42e admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:31.862144 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-6d9fa693-9cc4-4a09-a85b-ac1f6da6a42e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:32.061518 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9fa693-9cc4-4a09-a85b-ac1f6da6a42e admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:32.066031 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa415a74-551a-4f06-b586-7cf3c4275700 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75135b856134ba4b9ccac337886f682', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:32.066637 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa415a74-551a-4f06-b586-7cf3c4275700 service cinder] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:32.066912 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa415a74-551a-4f06-b586-7cf3c4275700 service cinder] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:32.067178 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa415a74-551a-4f06-b586-7cf3c4275700 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:32.076174 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa415a74-551a-4f06-b586-7cf3c4275700 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:32.077629 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa415a74-551a-4f06-b586-7cf3c4275700 service cinder] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:32.087596 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1297/2595] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:19:31 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:19:33.538626 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455ab956-dca3-41f6-88e1-e5e138842908 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:33.633540 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455ab956-dca3-41f6-88e1-e5e138842908 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:33.638940 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dea1c4-35b5-41f4-bc86-83d31f6b2666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:33.639624 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dea1c4-35b5-41f4-bc86-83d31f6b2666 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:33.639978 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dea1c4-35b5-41f4-bc86-83d31f6b2666 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:33.640325 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dea1c4-35b5-41f4-bc86-83d31f6b2666 admin admin] PATH_INFO: `/v3/users/993942c183754a13a80175d81006d7ed` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:33.641657 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dea1c4-35b5-41f4-bc86-83d31f6b2666 admin admin] RBAC: Authorizing `identity:delete_user(user_id=993942c183754a13a80175d81006d7ed)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:33.643935 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dea1c4-35b5-41f4-bc86-83d31f6b2666 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:33.699038 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-34dea1c4-35b5-41f4-bc86-83d31f6b2666 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '993942c183754a13a80175d81006d7ed'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:33.699913 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-34dea1c4-35b5-41f4-bc86-83d31f6b2666 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '993942c183754a13a80175d81006d7ed'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:33.715514 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-34dea1c4-35b5-41f4-bc86-83d31f6b2666 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '993942c183754a13a80175d81006d7ed'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:33.724579 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-34dea1c4-35b5-41f4-bc86-83d31f6b2666 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '993942c183754a13a80175d81006d7ed'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:33.725456 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-34dea1c4-35b5-41f4-bc86-83d31f6b2666 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '993942c183754a13a80175d81006d7ed'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:33.740782 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1299/2596] 10.222.0.49 () {58 vars in 1224 bytes} [Thu Sep 29 02:19:33 2022] DELETE /identity/v3/users/993942c183754a13a80175d81006d7ed => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:19:33.745499 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e84ba8-53f4-40e4-8722-6ffc1349fcda None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:33.746004 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e84ba8-53f4-40e4-8722-6ffc1349fcda None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:33.746110 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e84ba8-53f4-40e4-8722-6ffc1349fcda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:33.776823 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-49e84ba8-53f4-40e4-8722-6ffc1349fcda None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:19:33.778136 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-49e84ba8-53f4-40e4-8722-6ffc1349fcda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:33.861363 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1298/2597] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:19:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:19:33.871796 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dea1c4-35b5-41f4-bc86-83d31f6b2666 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:33.873293 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-34dea1c4-35b5-41f4-bc86-83d31f6b2666 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:33.898210 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:19:33.967022 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dea1c4-35b5-41f4-bc86-83d31f6b2666 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:33.975184 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e7cb02-8870-4211-89a6-b59bf67a5489 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:33.975815 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e7cb02-8870-4211-89a6-b59bf67a5489 service neutron] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:33.976096 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e7cb02-8870-4211-89a6-b59bf67a5489 service neutron] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:33.976371 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e7cb02-8870-4211-89a6-b59bf67a5489 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:33.986522 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e7cb02-8870-4211-89a6-b59bf67a5489 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:33.987961 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e7cb02-8870-4211-89a6-b59bf67a5489 service neutron] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:34.000514 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1300/2598] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:19:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 29 02:19:34.499228 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e84ba8-53f4-40e4-8722-6ffc1349fcda None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:34.502320 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-49e84ba8-53f4-40e4-8722-6ffc1349fcda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:34.516840 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e84ba8-53f4-40e4-8722-6ffc1349fcda None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:34.523256 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768d53fa-bd5e-4010-956a-f5b7b188319d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:34.524337 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d53fa-bd5e-4010-956a-f5b7b188319d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:34.524827 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d53fa-bd5e-4010-956a-f5b7b188319d admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:34.525370 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d53fa-bd5e-4010-956a-f5b7b188319d admin admin] PATH_INFO: `/v3/projects/95d6342866eb441482460d2e7a9b8184` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:34.526752 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768d53fa-bd5e-4010-956a-f5b7b188319d admin admin] RBAC: Authorizing `identity:delete_project(project_id=95d6342866eb441482460d2e7a9b8184)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:34.528874 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768d53fa-bd5e-4010-956a-f5b7b188319d admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:34.596837 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-768d53fa-bd5e-4010-956a-f5b7b188319d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95d6342866eb441482460d2e7a9b8184', 'request_id': 'req-768d53fa-bd5e-4010-956a-f5b7b188319d'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:34.604080 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-768d53fa-bd5e-4010-956a-f5b7b188319d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95d6342866eb441482460d2e7a9b8184', 'request_id': 'req-768d53fa-bd5e-4010-956a-f5b7b188319d'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:34.608366 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:19:34.612826 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-768d53fa-bd5e-4010-956a-f5b7b188319d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95d6342866eb441482460d2e7a9b8184', 'request_id': 'req-768d53fa-bd5e-4010-956a-f5b7b188319d'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:34.628665 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-768d53fa-bd5e-4010-956a-f5b7b188319d admin admin] The token cache is being invalidate because project 95d6342866eb441482460d2e7a9b8184 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81649) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:19:34.628964 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-768d53fa-bd5e-4010-956a-f5b7b188319d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:34.629800 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-768d53fa-bd5e-4010-956a-f5b7b188319d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:34.631363 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1299/2599] 10.222.0.49 () {58 vars in 1233 bytes} [Thu Sep 29 02:19:34 2022] DELETE /identity/v3/projects/95d6342866eb441482460d2e7a9b8184 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:19:34.635655 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e7cb02-8870-4211-89a6-b59bf67a5489 service neutron] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:34.647242 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e7cb02-8870-4211-89a6-b59bf67a5489 service neutron] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:34.724100 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d20a868-3002-410f-b00f-9fb67f3c8435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:34.724736 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d20a868-3002-410f-b00f-9fb67f3c8435 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:34.725008 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d20a868-3002-410f-b00f-9fb67f3c8435 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:34.725276 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d20a868-3002-410f-b00f-9fb67f3c8435 admin admin] PATH_INFO: `/v3/users/8422dc43693346f4b899bf9097774d7d` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:34.726434 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d20a868-3002-410f-b00f-9fb67f3c8435 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8422dc43693346f4b899bf9097774d7d)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:34.728312 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d20a868-3002-410f-b00f-9fb67f3c8435 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:34.780144 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-9d20a868-3002-410f-b00f-9fb67f3c8435 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8422dc43693346f4b899bf9097774d7d'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:34.780811 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-9d20a868-3002-410f-b00f-9fb67f3c8435 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8422dc43693346f4b899bf9097774d7d'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:34.795274 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-9d20a868-3002-410f-b00f-9fb67f3c8435 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8422dc43693346f4b899bf9097774d7d'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:34.818064 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-9d20a868-3002-410f-b00f-9fb67f3c8435 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8422dc43693346f4b899bf9097774d7d'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:34.818918 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-9d20a868-3002-410f-b00f-9fb67f3c8435 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8422dc43693346f4b899bf9097774d7d'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:34.833460 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1301/2600] 10.222.0.49 () {58 vars in 1224 bytes} [Thu Sep 29 02:19:34 2022] DELETE /identity/v3/users/8422dc43693346f4b899bf9097774d7d => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:19:35.114993 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768d53fa-bd5e-4010-956a-f5b7b188319d admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:35.116652 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-768d53fa-bd5e-4010-956a-f5b7b188319d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:35.131402 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768d53fa-bd5e-4010-956a-f5b7b188319d admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:35.188274 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6322f0-597f-49f2-844f-19ca418a1e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:35.189497 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6322f0-597f-49f2-844f-19ca418a1e82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:35.189709 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6322f0-597f-49f2-844f-19ca418a1e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:35.189974 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6322f0-597f-49f2-844f-19ca418a1e82 admin admin] PATH_INFO: `/v3/projects/6ba552db8a624b98b2a5d08b411c6f23` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:35.191172 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6322f0-597f-49f2-844f-19ca418a1e82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ba552db8a624b98b2a5d08b411c6f23)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:35.193051 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6322f0-597f-49f2-844f-19ca418a1e82 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:35.241120 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-ed6322f0-597f-49f2-844f-19ca418a1e82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ba552db8a624b98b2a5d08b411c6f23', 'request_id': 'req-ed6322f0-597f-49f2-844f-19ca418a1e82'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:35.247469 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-ed6322f0-597f-49f2-844f-19ca418a1e82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ba552db8a624b98b2a5d08b411c6f23', 'request_id': 'req-ed6322f0-597f-49f2-844f-19ca418a1e82'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:35.256322 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-ed6322f0-597f-49f2-844f-19ca418a1e82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ba552db8a624b98b2a5d08b411c6f23', 'request_id': 'req-ed6322f0-597f-49f2-844f-19ca418a1e82'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:35.267586 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-ed6322f0-597f-49f2-844f-19ca418a1e82 admin admin] The token cache is being invalidate because project 6ba552db8a624b98b2a5d08b411c6f23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81649) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:19:35.267870 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-ed6322f0-597f-49f2-844f-19ca418a1e82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:35.268495 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-ed6322f0-597f-49f2-844f-19ca418a1e82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:35.269976 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1300/2601] 10.222.0.49 () {58 vars in 1233 bytes} [Thu Sep 29 02:19:35 2022] DELETE /identity/v3/projects/6ba552db8a624b98b2a5d08b411c6f23 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:19:35.274789 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da195591-660e-4aa9-9ea8-fd0b257434fa None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:35.275127 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da195591-660e-4aa9-9ea8-fd0b257434fa None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:35.275400 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da195591-660e-4aa9-9ea8-fd0b257434fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:35.324117 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:19:35.330571 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-da195591-660e-4aa9-9ea8-fd0b257434fa None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:19:35.332388 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-da195591-660e-4aa9-9ea8-fd0b257434fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:35.392234 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1302/2602] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:19:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:19:35.400812 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c0827-51b1-4ee9-9a22-1a328d89197e None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:35.401090 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c0827-51b1-4ee9-9a22-1a328d89197e None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:35.401394 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c0827-51b1-4ee9-9a22-1a328d89197e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:35.420673 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-f04c0827-51b1-4ee9-9a22-1a328d89197e None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:19:35.422410 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-f04c0827-51b1-4ee9-9a22-1a328d89197e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:35.430573 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1301/2603] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:19:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:19:35.434842 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da195591-660e-4aa9-9ea8-fd0b257434fa None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:35.445469 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da195591-660e-4aa9-9ea8-fd0b257434fa None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:35.449924 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfb6618-99aa-437b-a20b-d7e6d8a4e977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:35.450514 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb6618-99aa-437b-a20b-d7e6d8a4e977 admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:35.450788 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb6618-99aa-437b-a20b-d7e6d8a4e977 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:35.451055 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb6618-99aa-437b-a20b-d7e6d8a4e977 admin admin] PATH_INFO: `/v3/domains` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:35.451693 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfb6618-99aa-437b-a20b-d7e6d8a4e977 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:19:35.451989 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfb6618-99aa-437b-a20b-d7e6d8a4e977 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:35.453818 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfb6618-99aa-437b-a20b-d7e6d8a4e977 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:35.465159 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1303/2604] 10.222.0.49 () {58 vars in 1153 bytes} [Thu Sep 29 02:19:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:19:35.469379 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04c0827-51b1-4ee9-9a22-1a328d89197e None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:35.478717 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04c0827-51b1-4ee9-9a22-1a328d89197e None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:35.483332 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363f84fe-4461-48cf-ad3a-88074d860a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:35.483916 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363f84fe-4461-48cf-ad3a-88074d860a59 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:35.484728 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363f84fe-4461-48cf-ad3a-88074d860a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:35.484990 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363f84fe-4461-48cf-ad3a-88074d860a59 admin admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:35.485655 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363f84fe-4461-48cf-ad3a-88074d860a59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:35.487521 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363f84fe-4461-48cf-ad3a-88074d860a59 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:35.518538 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1302/2605] 10.222.0.49 () {60 vars in 1153 bytes} [Thu Sep 29 02:19:35 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:19:35.519844 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfb6618-99aa-437b-a20b-d7e6d8a4e977 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:35.530052 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfb6618-99aa-437b-a20b-d7e6d8a4e977 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:35.591713 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d77670d-6d2a-4186-8257-bd664ba46556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:35.592309 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d77670d-6d2a-4186-8257-bd664ba46556 admin admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:35.592585 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d77670d-6d2a-4186-8257-bd664ba46556 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:35.592852 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d77670d-6d2a-4186-8257-bd664ba46556 admin admin] PATH_INFO: `/v3/users` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:35.594128 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d77670d-6d2a-4186-8257-bd664ba46556 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:35.596186 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d77670d-6d2a-4186-8257-bd664ba46556 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:35.618388 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1304/2606] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 02:19:35 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:19:35.622452 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363f84fe-4461-48cf-ad3a-88074d860a59 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:35.633716 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363f84fe-4461-48cf-ad3a-88074d860a59 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:35.638272 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff155da4-063c-4ed4-89f3-ff2053e81d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:35.638859 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff155da4-063c-4ed4-89f3-ff2053e81d43 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:35.639156 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff155da4-063c-4ed4-89f3-ff2053e81d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:35.639406 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff155da4-063c-4ed4-89f3-ff2053e81d43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:35.640040 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff155da4-063c-4ed4-89f3-ff2053e81d43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:35.642259 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff155da4-063c-4ed4-89f3-ff2053e81d43 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:35.652765 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1303/2607] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:19:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:19:35.656844 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d77670d-6d2a-4186-8257-bd664ba46556 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:35.667013 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d77670d-6d2a-4186-8257-bd664ba46556 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:35.671489 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d1c0cd-bed2-415f-a7aa-90005d31101e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:35.672215 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1c0cd-bed2-415f-a7aa-90005d31101e admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:35.672510 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1c0cd-bed2-415f-a7aa-90005d31101e admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:35.672774 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1c0cd-bed2-415f-a7aa-90005d31101e admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:35.673438 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d1c0cd-bed2-415f-a7aa-90005d31101e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:35.675009 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d1c0cd-bed2-415f-a7aa-90005d31101e admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:35.684755 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1305/2608] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:19:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:19:35.689541 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff155da4-063c-4ed4-89f3-ff2053e81d43 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:35.699636 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff155da4-063c-4ed4-89f3-ff2053e81d43 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:35.704894 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41392721-74a5-4e05-9ce8-3b9fe895ec22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:35.705592 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41392721-74a5-4e05-9ce8-3b9fe895ec22 admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:35.705888 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41392721-74a5-4e05-9ce8-3b9fe895ec22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:35.706146 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41392721-74a5-4e05-9ce8-3b9fe895ec22 admin admin] PATH_INFO: `/v3/projects/640e0fba2d0d4b0f908ad99ddd38b655/users/f81755e587164b5ca1bd44550628e0e7/roles/f157f905c9c94ccfbfb46e52d443e8f2` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:35.722067 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41392721-74a5-4e05-9ce8-3b9fe895ec22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=640e0fba2d0d4b0f908ad99ddd38b655, user_id=f81755e587164b5ca1bd44550628e0e7, role_id=f157f905c9c94ccfbfb46e52d443e8f2)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:35.724775 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41392721-74a5-4e05-9ce8-3b9fe895ec22 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:35.739368 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1304/2609] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:19:35 2022] PUT /identity/v3/projects/640e0fba2d0d4b0f908ad99ddd38b655/users/f81755e587164b5ca1bd44550628e0e7/roles/f157f905c9c94ccfbfb46e52d443e8f2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:19:35.750573 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b722f0-d2e0-43c7-9567-3a42f16c4b96 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:35.751219 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b722f0-d2e0-43c7-9567-3a42f16c4b96 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:35.752441 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b722f0-d2e0-43c7-9567-3a42f16c4b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:35.781234 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-f1b722f0-d2e0-43c7-9567-3a42f16c4b96 None None] MFA Rules not processed for user `f81755e587164b5ca1bd44550628e0e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:19:35.782482 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-f1b722f0-d2e0-43c7-9567-3a42f16c4b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:35.850499 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1306/2610] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:19:35 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:19:35.855091 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41392721-74a5-4e05-9ce8-3b9fe895ec22 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:35.873554 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:19:35.926147 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41392721-74a5-4e05-9ce8-3b9fe895ec22 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:35.930775 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c876cb-a8fb-4014-bbb5-0cf2fe94ee42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:35.931376 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c876cb-a8fb-4014-bbb5-0cf2fe94ee42 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:35.931652 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c876cb-a8fb-4014-bbb5-0cf2fe94ee42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:35.931921 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c876cb-a8fb-4014-bbb5-0cf2fe94ee42 admin admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:35.932816 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c876cb-a8fb-4014-bbb5-0cf2fe94ee42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:35.934735 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c876cb-a8fb-4014-bbb5-0cf2fe94ee42 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:35.962437 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1305/2611] 10.222.0.49 () {60 vars in 1153 bytes} [Thu Sep 29 02:19:35 2022] POST /identity/v3/projects => generated 387 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:19:35.966528 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b722f0-d2e0-43c7-9567-3a42f16c4b96 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:35.972721 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:19:35.980596 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b722f0-d2e0-43c7-9567-3a42f16c4b96 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:36.039986 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7a74b9-76ec-45e6-83dd-0bf05f838679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:36.040595 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7a74b9-76ec-45e6-83dd-0bf05f838679 admin admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:36.040876 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7a74b9-76ec-45e6-83dd-0bf05f838679 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:36.041147 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7a74b9-76ec-45e6-83dd-0bf05f838679 admin admin] PATH_INFO: `/v3/users` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:36.041819 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7a74b9-76ec-45e6-83dd-0bf05f838679 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:36.043735 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7a74b9-76ec-45e6-83dd-0bf05f838679 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:36.066014 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1307/2612] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 02:19:35 2022] POST /identity/v3/users => generated 300 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:19:36.070307 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c876cb-a8fb-4014-bbb5-0cf2fe94ee42 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:36.080629 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c876cb-a8fb-4014-bbb5-0cf2fe94ee42 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:36.085115 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a238086-744f-4699-84a0-550c5ca27389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:36.085733 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a238086-744f-4699-84a0-550c5ca27389 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:36.086005 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a238086-744f-4699-84a0-550c5ca27389 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:36.086267 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a238086-744f-4699-84a0-550c5ca27389 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:36.086944 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a238086-744f-4699-84a0-550c5ca27389 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:36.088599 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a238086-744f-4699-84a0-550c5ca27389 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:36.098144 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1306/2613] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:19:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 29 02:19:36.102158 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7a74b9-76ec-45e6-83dd-0bf05f838679 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:36.112546 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7a74b9-76ec-45e6-83dd-0bf05f838679 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:36.117530 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acf1a46-fa74-4038-bb33-b1db0dbb7979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:36.118179 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acf1a46-fa74-4038-bb33-b1db0dbb7979 admin admin] REQUEST_METHOD: `PUT` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:36.118455 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acf1a46-fa74-4038-bb33-b1db0dbb7979 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:36.118725 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acf1a46-fa74-4038-bb33-b1db0dbb7979 admin admin] PATH_INFO: `/v3/projects/7c122021eb0146259ead39c04f31ef61/users/96ca6942950e4f4bb5086f12fb125210/roles/fe9bbc67742f4f5893f39b18eb31d59a` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:36.134196 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acf1a46-fa74-4038-bb33-b1db0dbb7979 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c122021eb0146259ead39c04f31ef61, user_id=96ca6942950e4f4bb5086f12fb125210, role_id=fe9bbc67742f4f5893f39b18eb31d59a)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:36.137223 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acf1a46-fa74-4038-bb33-b1db0dbb7979 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:36.150511 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1308/2614] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:19:36 2022] PUT /identity/v3/projects/7c122021eb0146259ead39c04f31ef61/users/96ca6942950e4f4bb5086f12fb125210/roles/fe9bbc67742f4f5893f39b18eb31d59a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:19:36.154378 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a238086-744f-4699-84a0-550c5ca27389 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:36.165110 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a238086-744f-4699-84a0-550c5ca27389 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:36.220185 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7a1920-ec39-433e-aa4c-ef40b2b52c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:36.220723 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7a1920-ec39-433e-aa4c-ef40b2b52c11 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:36.221001 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7a1920-ec39-433e-aa4c-ef40b2b52c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:36.221291 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7a1920-ec39-433e-aa4c-ef40b2b52c11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:36.222031 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7a1920-ec39-433e-aa4c-ef40b2b52c11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:36.223718 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7a1920-ec39-433e-aa4c-ef40b2b52c11 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:36.233170 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1307/2615] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:19:36 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:19:36.237366 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acf1a46-fa74-4038-bb33-b1db0dbb7979 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:36.247450 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acf1a46-fa74-4038-bb33-b1db0dbb7979 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:36.252736 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e617e1-4e52-4bed-b197-a4d7af60cf5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:36.253409 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e617e1-4e52-4bed-b197-a4d7af60cf5e admin admin] REQUEST_METHOD: `PUT` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:36.253689 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e617e1-4e52-4bed-b197-a4d7af60cf5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:36.253962 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e617e1-4e52-4bed-b197-a4d7af60cf5e admin admin] PATH_INFO: `/v3/projects/7c122021eb0146259ead39c04f31ef61/users/96ca6942950e4f4bb5086f12fb125210/roles/fe9bbc67742f4f5893f39b18eb31d59a` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:36.255919 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e617e1-4e52-4bed-b197-a4d7af60cf5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c122021eb0146259ead39c04f31ef61, user_id=96ca6942950e4f4bb5086f12fb125210, role_id=fe9bbc67742f4f5893f39b18eb31d59a)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:36.258580 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e617e1-4e52-4bed-b197-a4d7af60cf5e admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:36.269575 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1309/2616] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:19:36 2022] PUT /identity/v3/projects/7c122021eb0146259ead39c04f31ef61/users/96ca6942950e4f4bb5086f12fb125210/roles/fe9bbc67742f4f5893f39b18eb31d59a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:19:36.280597 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbb1a84-a06f-4ba2-82b0-cb060b2f8d01 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:36.280876 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbb1a84-a06f-4ba2-82b0-cb060b2f8d01 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:36.281206 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbb1a84-a06f-4ba2-82b0-cb060b2f8d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:36.309675 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-8bbb1a84-a06f-4ba2-82b0-cb060b2f8d01 None None] MFA Rules not processed for user `96ca6942950e4f4bb5086f12fb125210`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:19:36.310862 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-8bbb1a84-a06f-4ba2-82b0-cb060b2f8d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:36.384122 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1308/2617] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:19:36 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 29 02:19:36.395979 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e617e1-4e52-4bed-b197-a4d7af60cf5e admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:36.397754 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-13e617e1-4e52-4bed-b197-a4d7af60cf5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:36.456633 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e617e1-4e52-4bed-b197-a4d7af60cf5e admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:36.460211 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1857f9b8-9ca9-4ded-978d-a3c6914d7d23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75135b856134ba4b9ccac337886f682', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:36.460803 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1857f9b8-9ca9-4ded-978d-a3c6914d7d23 service cinder] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:36.461078 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1857f9b8-9ca9-4ded-978d-a3c6914d7d23 service cinder] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:36.461375 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1857f9b8-9ca9-4ded-978d-a3c6914d7d23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:36.470287 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1857f9b8-9ca9-4ded-978d-a3c6914d7d23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:36.471625 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1857f9b8-9ca9-4ded-978d-a3c6914d7d23 service cinder] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:36.480834 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1310/2618] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:19:36 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:19:36.509637 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbb1a84-a06f-4ba2-82b0-cb060b2f8d01 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:36.519906 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:19:36.571441 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbb1a84-a06f-4ba2-82b0-cb060b2f8d01 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:36.576025 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88db5163-7aca-44b9-938d-030bb973dee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:36.576639 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88db5163-7aca-44b9-938d-030bb973dee2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:36.576910 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88db5163-7aca-44b9-938d-030bb973dee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:36.577165 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88db5163-7aca-44b9-938d-030bb973dee2 admin admin] PATH_INFO: `/v3/users/f81755e587164b5ca1bd44550628e0e7` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:36.578404 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88db5163-7aca-44b9-938d-030bb973dee2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f81755e587164b5ca1bd44550628e0e7)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:36.580842 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88db5163-7aca-44b9-938d-030bb973dee2 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:36.626202 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-88db5163-7aca-44b9-938d-030bb973dee2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f81755e587164b5ca1bd44550628e0e7'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:36.627124 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-88db5163-7aca-44b9-938d-030bb973dee2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f81755e587164b5ca1bd44550628e0e7'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:36.638712 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-88db5163-7aca-44b9-938d-030bb973dee2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f81755e587164b5ca1bd44550628e0e7'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:36.646149 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-88db5163-7aca-44b9-938d-030bb973dee2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f81755e587164b5ca1bd44550628e0e7'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:36.646959 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-88db5163-7aca-44b9-938d-030bb973dee2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f81755e587164b5ca1bd44550628e0e7'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:36.659690 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1309/2619] 10.222.0.49 () {58 vars in 1224 bytes} [Thu Sep 29 02:19:36 2022] DELETE /identity/v3/users/f81755e587164b5ca1bd44550628e0e7 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:19:36.664263 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4864705-1b5f-4a21-a81c-4985f7b9b186 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:36.664768 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4864705-1b5f-4a21-a81c-4985f7b9b186 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:36.664865 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4864705-1b5f-4a21-a81c-4985f7b9b186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:36.684824 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-b4864705-1b5f-4a21-a81c-4985f7b9b186 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:19:36.686066 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-b4864705-1b5f-4a21-a81c-4985f7b9b186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:36.740401 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:19:36.751594 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1311/2620] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:19:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:19:36.762764 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88db5163-7aca-44b9-938d-030bb973dee2 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:36.764178 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-88db5163-7aca-44b9-938d-030bb973dee2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:36.823957 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88db5163-7aca-44b9-938d-030bb973dee2 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:36.827555 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fbf70a-4ada-42c0-8be9-fc009f2925a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:36.828258 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fbf70a-4ada-42c0-8be9-fc009f2925a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:36.828561 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fbf70a-4ada-42c0-8be9-fc009f2925a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:36.828983 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fbf70a-4ada-42c0-8be9-fc009f2925a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:36.838166 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fbf70a-4ada-42c0-8be9-fc009f2925a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:36.839572 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fbf70a-4ada-42c0-8be9-fc009f2925a8 service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:36.850044 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1310/2621] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:19:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:19:37.165483 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4864705-1b5f-4a21-a81c-4985f7b9b186 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:37.170640 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-b4864705-1b5f-4a21-a81c-4985f7b9b186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:37.198741 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4864705-1b5f-4a21-a81c-4985f7b9b186 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:37.204976 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e5c2ea-35b7-4fa9-ad68-1cfb6323418d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:37.205937 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e5c2ea-35b7-4fa9-ad68-1cfb6323418d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:37.206307 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e5c2ea-35b7-4fa9-ad68-1cfb6323418d admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:37.206649 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e5c2ea-35b7-4fa9-ad68-1cfb6323418d admin admin] PATH_INFO: `/v3/projects/640e0fba2d0d4b0f908ad99ddd38b655` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:37.207927 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e5c2ea-35b7-4fa9-ad68-1cfb6323418d admin admin] RBAC: Authorizing `identity:delete_project(project_id=640e0fba2d0d4b0f908ad99ddd38b655)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:37.210626 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e5c2ea-35b7-4fa9-ad68-1cfb6323418d admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:37.272231 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-05e5c2ea-35b7-4fa9-ad68-1cfb6323418d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '640e0fba2d0d4b0f908ad99ddd38b655', 'request_id': 'req-05e5c2ea-35b7-4fa9-ad68-1cfb6323418d'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:37.280546 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-05e5c2ea-35b7-4fa9-ad68-1cfb6323418d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '640e0fba2d0d4b0f908ad99ddd38b655', 'request_id': 'req-05e5c2ea-35b7-4fa9-ad68-1cfb6323418d'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:37.290202 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-05e5c2ea-35b7-4fa9-ad68-1cfb6323418d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '640e0fba2d0d4b0f908ad99ddd38b655', 'request_id': 'req-05e5c2ea-35b7-4fa9-ad68-1cfb6323418d'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:37.305022 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-05e5c2ea-35b7-4fa9-ad68-1cfb6323418d admin admin] The token cache is being invalidate because project 640e0fba2d0d4b0f908ad99ddd38b655 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81648) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:19:37.305542 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-05e5c2ea-35b7-4fa9-ad68-1cfb6323418d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:37.306333 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-05e5c2ea-35b7-4fa9-ad68-1cfb6323418d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:37.307916 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1312/2622] 10.222.0.49 () {58 vars in 1233 bytes} [Thu Sep 29 02:19:37 2022] DELETE /identity/v3/projects/640e0fba2d0d4b0f908ad99ddd38b655 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:19:37.312381 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fbf70a-4ada-42c0-8be9-fc009f2925a8 service neutron] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:37.329785 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fbf70a-4ada-42c0-8be9-fc009f2925a8 service neutron] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:37.365291 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:19:37.397468 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae83a7d-3b96-4e1f-9098-d3c3a1d00f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:37.398102 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae83a7d-3b96-4e1f-9098-d3c3a1d00f70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:37.398386 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae83a7d-3b96-4e1f-9098-d3c3a1d00f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:37.398642 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae83a7d-3b96-4e1f-9098-d3c3a1d00f70 admin admin] PATH_INFO: `/v3/users/96ca6942950e4f4bb5086f12fb125210` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:37.399782 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae83a7d-3b96-4e1f-9098-d3c3a1d00f70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96ca6942950e4f4bb5086f12fb125210)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:37.401723 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae83a7d-3b96-4e1f-9098-d3c3a1d00f70 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:37.451212 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-2ae83a7d-3b96-4e1f-9098-d3c3a1d00f70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96ca6942950e4f4bb5086f12fb125210'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:37.451873 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-2ae83a7d-3b96-4e1f-9098-d3c3a1d00f70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96ca6942950e4f4bb5086f12fb125210'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:37.464860 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-2ae83a7d-3b96-4e1f-9098-d3c3a1d00f70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96ca6942950e4f4bb5086f12fb125210'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:37.472894 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-2ae83a7d-3b96-4e1f-9098-d3c3a1d00f70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96ca6942950e4f4bb5086f12fb125210'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:37.473914 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-2ae83a7d-3b96-4e1f-9098-d3c3a1d00f70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96ca6942950e4f4bb5086f12fb125210'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:37.487104 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1311/2623] 10.222.0.49 () {58 vars in 1224 bytes} [Thu Sep 29 02:19:37 2022] DELETE /identity/v3/users/96ca6942950e4f4bb5086f12fb125210 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:19:37.782840 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e5c2ea-35b7-4fa9-ad68-1cfb6323418d admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:37.784327 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-05e5c2ea-35b7-4fa9-ad68-1cfb6323418d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:37.804740 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e5c2ea-35b7-4fa9-ad68-1cfb6323418d admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:37.866735 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2745312f-c4a7-4297-83f8-b202d5b31e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:37.867534 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2745312f-c4a7-4297-83f8-b202d5b31e8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:37.867810 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2745312f-c4a7-4297-83f8-b202d5b31e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:37.868078 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2745312f-c4a7-4297-83f8-b202d5b31e8f admin admin] PATH_INFO: `/v3/projects/7c122021eb0146259ead39c04f31ef61` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:37.869207 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2745312f-c4a7-4297-83f8-b202d5b31e8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c122021eb0146259ead39c04f31ef61)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:37.871183 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2745312f-c4a7-4297-83f8-b202d5b31e8f admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:37.923887 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-2745312f-c4a7-4297-83f8-b202d5b31e8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c122021eb0146259ead39c04f31ef61', 'request_id': 'req-2745312f-c4a7-4297-83f8-b202d5b31e8f'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:37.931846 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-2745312f-c4a7-4297-83f8-b202d5b31e8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c122021eb0146259ead39c04f31ef61', 'request_id': 'req-2745312f-c4a7-4297-83f8-b202d5b31e8f'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:37.940104 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-2745312f-c4a7-4297-83f8-b202d5b31e8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c122021eb0146259ead39c04f31ef61', 'request_id': 'req-2745312f-c4a7-4297-83f8-b202d5b31e8f'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:37.950711 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-2745312f-c4a7-4297-83f8-b202d5b31e8f admin admin] The token cache is being invalidate because project 7c122021eb0146259ead39c04f31ef61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81648) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:19:37.951164 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-2745312f-c4a7-4297-83f8-b202d5b31e8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:37.951611 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-2745312f-c4a7-4297-83f8-b202d5b31e8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:37.954307 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1313/2624] 10.222.0.49 () {58 vars in 1233 bytes} [Thu Sep 29 02:19:37 2022] DELETE /identity/v3/projects/7c122021eb0146259ead39c04f31ef61 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:19:37.959129 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ab204-544f-4651-a658-d404c8b5876c None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:37.959412 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ab204-544f-4651-a658-d404c8b5876c None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:37.959682 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ab204-544f-4651-a658-d404c8b5876c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:37.981013 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-b22ab204-544f-4651-a658-d404c8b5876c None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:19:37.982250 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-b22ab204-544f-4651-a658-d404c8b5876c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:38.042960 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1312/2625] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:19:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:19:38.051358 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047f1bc-17fc-4d32-8629-f8f2179da035 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:38.051639 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047f1bc-17fc-4d32-8629-f8f2179da035 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:38.051910 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047f1bc-17fc-4d32-8629-f8f2179da035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:38.072501 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-9047f1bc-17fc-4d32-8629-f8f2179da035 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:19:38.073738 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-9047f1bc-17fc-4d32-8629-f8f2179da035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:38.081546 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1314/2626] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:19:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:19:38.086520 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22ab204-544f-4651-a658-d404c8b5876c None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:38.097664 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22ab204-544f-4651-a658-d404c8b5876c None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:38.102196 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d2ba90-c0ab-49e5-ae54-55104bdbdb50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:38.102833 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d2ba90-c0ab-49e5-ae54-55104bdbdb50 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:38.103112 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d2ba90-c0ab-49e5-ae54-55104bdbdb50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:38.103372 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d2ba90-c0ab-49e5-ae54-55104bdbdb50 admin admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:38.104012 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d2ba90-c0ab-49e5-ae54-55104bdbdb50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:19:38.104308 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d2ba90-c0ab-49e5-ae54-55104bdbdb50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:38.105917 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d2ba90-c0ab-49e5-ae54-55104bdbdb50 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:38.118561 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1313/2627] 10.222.0.49 () {58 vars in 1153 bytes} [Thu Sep 29 02:19:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:19:38.123057 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9047f1bc-17fc-4d32-8629-f8f2179da035 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:38.129805 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:19:38.134155 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9047f1bc-17fc-4d32-8629-f8f2179da035 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:38.140113 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97f55d5-c8ef-48cd-91e8-8d146654756c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:38.140813 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f55d5-c8ef-48cd-91e8-8d146654756c admin admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:38.141233 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f55d5-c8ef-48cd-91e8-8d146654756c admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:38.141552 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f55d5-c8ef-48cd-91e8-8d146654756c admin admin] PATH_INFO: `/v3/projects` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:38.142225 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97f55d5-c8ef-48cd-91e8-8d146654756c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:38.144196 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97f55d5-c8ef-48cd-91e8-8d146654756c admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:38.171233 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1315/2628] 10.222.0.49 () {60 vars in 1153 bytes} [Thu Sep 29 02:19:38 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:19:38.176114 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d2ba90-c0ab-49e5-ae54-55104bdbdb50 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:38.186182 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d2ba90-c0ab-49e5-ae54-55104bdbdb50 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:38.219957 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:19:38.246709 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e2237f-b63c-4840-ad33-2d49b55887c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:38.247541 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e2237f-b63c-4840-ad33-2d49b55887c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:38.247978 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e2237f-b63c-4840-ad33-2d49b55887c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:38.248358 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e2237f-b63c-4840-ad33-2d49b55887c2 admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:38.249408 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e2237f-b63c-4840-ad33-2d49b55887c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:38.253657 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e2237f-b63c-4840-ad33-2d49b55887c2 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:38.275181 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1314/2629] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 02:19:38 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:19:38.279138 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97f55d5-c8ef-48cd-91e8-8d146654756c admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:38.289582 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97f55d5-c8ef-48cd-91e8-8d146654756c admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:38.294193 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf053fc-295d-4e28-bf13-3076459fc549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:38.294725 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf053fc-295d-4e28-bf13-3076459fc549 admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:38.295004 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf053fc-295d-4e28-bf13-3076459fc549 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:38.295274 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf053fc-295d-4e28-bf13-3076459fc549 admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:38.295911 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf053fc-295d-4e28-bf13-3076459fc549 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:38.298081 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf053fc-295d-4e28-bf13-3076459fc549 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:38.308672 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1316/2630] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:19:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:19:38.313650 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e2237f-b63c-4840-ad33-2d49b55887c2 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:38.325454 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e2237f-b63c-4840-ad33-2d49b55887c2 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:38.330205 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3225096c-a04b-47f5-89a0-c7ac7566b6be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:38.330794 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3225096c-a04b-47f5-89a0-c7ac7566b6be admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:38.331070 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3225096c-a04b-47f5-89a0-c7ac7566b6be admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:38.331339 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3225096c-a04b-47f5-89a0-c7ac7566b6be admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:38.331972 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3225096c-a04b-47f5-89a0-c7ac7566b6be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:38.334073 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3225096c-a04b-47f5-89a0-c7ac7566b6be admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:38.345499 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1315/2631] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:19:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:19:38.349496 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf053fc-295d-4e28-bf13-3076459fc549 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:38.360272 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf053fc-295d-4e28-bf13-3076459fc549 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:38.364808 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a205dda-a68a-4d32-b573-f543c5a36252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:38.365488 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a205dda-a68a-4d32-b573-f543c5a36252 admin admin] REQUEST_METHOD: `PUT` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:38.365767 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a205dda-a68a-4d32-b573-f543c5a36252 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:38.366112 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a205dda-a68a-4d32-b573-f543c5a36252 admin admin] PATH_INFO: `/v3/projects/076ab2e483da41aa9489e8e974faf0ca/users/7c62009537bf44d88f07b6fa580ce49d/roles/f157f905c9c94ccfbfb46e52d443e8f2` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:38.381133 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a205dda-a68a-4d32-b573-f543c5a36252 admin admin] RBAC: Authorizing `identity:create_grant(project_id=076ab2e483da41aa9489e8e974faf0ca, user_id=7c62009537bf44d88f07b6fa580ce49d, role_id=f157f905c9c94ccfbfb46e52d443e8f2)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:38.383807 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a205dda-a68a-4d32-b573-f543c5a36252 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:38.396666 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1317/2632] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:19:38 2022] PUT /identity/v3/projects/076ab2e483da41aa9489e8e974faf0ca/users/7c62009537bf44d88f07b6fa580ce49d/roles/f157f905c9c94ccfbfb46e52d443e8f2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:19:38.407348 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6019e2-3e58-4428-bd2b-4129b98856b0 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:38.407703 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6019e2-3e58-4428-bd2b-4129b98856b0 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:38.408043 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6019e2-3e58-4428-bd2b-4129b98856b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:38.439029 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-df6019e2-3e58-4428-bd2b-4129b98856b0 None None] MFA Rules not processed for user `7c62009537bf44d88f07b6fa580ce49d`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:19:38.440259 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-df6019e2-3e58-4428-bd2b-4129b98856b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:38.511626 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1316/2633] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:19:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:19:38.516314 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a205dda-a68a-4d32-b573-f543c5a36252 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:38.590000 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a205dda-a68a-4d32-b573-f543c5a36252 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:38.595145 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faedc1dd-0fba-4664-90ac-40b9dfab1858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:38.595740 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faedc1dd-0fba-4664-90ac-40b9dfab1858 admin admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:38.596015 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faedc1dd-0fba-4664-90ac-40b9dfab1858 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:38.596283 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faedc1dd-0fba-4664-90ac-40b9dfab1858 admin admin] PATH_INFO: `/v3/projects` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:38.596914 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faedc1dd-0fba-4664-90ac-40b9dfab1858 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:38.598841 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faedc1dd-0fba-4664-90ac-40b9dfab1858 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:38.627643 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1318/2634] 10.222.0.49 () {60 vars in 1153 bytes} [Thu Sep 29 02:19:38 2022] POST /identity/v3/projects => generated 387 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 29 02:19:38.631769 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6019e2-3e58-4428-bd2b-4129b98856b0 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:38.642447 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6019e2-3e58-4428-bd2b-4129b98856b0 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:38.698967 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802b6148-fa76-48a1-bfd6-5f24cb04f51d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:38.699593 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b6148-fa76-48a1-bfd6-5f24cb04f51d admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:38.699869 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b6148-fa76-48a1-bfd6-5f24cb04f51d admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:38.700137 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b6148-fa76-48a1-bfd6-5f24cb04f51d admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:38.700766 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802b6148-fa76-48a1-bfd6-5f24cb04f51d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:38.702691 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802b6148-fa76-48a1-bfd6-5f24cb04f51d admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:38.724184 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1317/2635] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 02:19:38 2022] POST /identity/v3/users => generated 294 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 29 02:19:38.728656 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faedc1dd-0fba-4664-90ac-40b9dfab1858 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:38.739550 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faedc1dd-0fba-4664-90ac-40b9dfab1858 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:38.744042 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167380a4-1e54-4837-a5d2-1a8fbe060d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:38.744635 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167380a4-1e54-4837-a5d2-1a8fbe060d9f admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:38.744909 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167380a4-1e54-4837-a5d2-1a8fbe060d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:38.745176 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167380a4-1e54-4837-a5d2-1a8fbe060d9f admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:38.745841 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167380a4-1e54-4837-a5d2-1a8fbe060d9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:38.747415 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167380a4-1e54-4837-a5d2-1a8fbe060d9f admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:38.758766 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1319/2636] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:19:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:19:38.762963 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802b6148-fa76-48a1-bfd6-5f24cb04f51d admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:38.773031 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802b6148-fa76-48a1-bfd6-5f24cb04f51d admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:38.777610 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23c1282-6f28-4eb7-bd19-ab6030a22e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:38.778261 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23c1282-6f28-4eb7-bd19-ab6030a22e0d admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:38.778535 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23c1282-6f28-4eb7-bd19-ab6030a22e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:38.778797 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23c1282-6f28-4eb7-bd19-ab6030a22e0d admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:38.779420 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23c1282-6f28-4eb7-bd19-ab6030a22e0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:38.781543 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23c1282-6f28-4eb7-bd19-ab6030a22e0d admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:38.791191 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1318/2637] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:19:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 29 02:19:38.797356 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167380a4-1e54-4837-a5d2-1a8fbe060d9f admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:38.807110 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167380a4-1e54-4837-a5d2-1a8fbe060d9f admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:38.811881 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2379c83f-5e95-41f1-8194-cd776a4cc363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:38.812550 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2379c83f-5e95-41f1-8194-cd776a4cc363 admin admin] REQUEST_METHOD: `PUT` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:38.812846 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2379c83f-5e95-41f1-8194-cd776a4cc363 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:38.813655 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2379c83f-5e95-41f1-8194-cd776a4cc363 admin admin] PATH_INFO: `/v3/projects/6c65c3b4639945e68152f16d2000ed39/users/eaa0c94cf7c94192b55fd6c3bd0151af/roles/f157f905c9c94ccfbfb46e52d443e8f2` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:38.828458 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2379c83f-5e95-41f1-8194-cd776a4cc363 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c65c3b4639945e68152f16d2000ed39, user_id=eaa0c94cf7c94192b55fd6c3bd0151af, role_id=f157f905c9c94ccfbfb46e52d443e8f2)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:38.831153 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2379c83f-5e95-41f1-8194-cd776a4cc363 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:38.844578 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1320/2638] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:19:38 2022] PUT /identity/v3/projects/6c65c3b4639945e68152f16d2000ed39/users/eaa0c94cf7c94192b55fd6c3bd0151af/roles/f157f905c9c94ccfbfb46e52d443e8f2 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:19:38.918496 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8885da5e-acee-4dff-8792-afd2fffc2705 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:38.918776 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8885da5e-acee-4dff-8792-afd2fffc2705 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:38.919047 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8885da5e-acee-4dff-8792-afd2fffc2705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:38.947633 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-8885da5e-acee-4dff-8792-afd2fffc2705 None None] MFA Rules not processed for user `eaa0c94cf7c94192b55fd6c3bd0151af`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:19:38.948858 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-8885da5e-acee-4dff-8792-afd2fffc2705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:38.961201 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:19:39.013492 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1319/2639] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:19:38 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:19:39.018509 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2379c83f-5e95-41f1-8194-cd776a4cc363 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:39.082033 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:19:39.086565 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2379c83f-5e95-41f1-8194-cd776a4cc363 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:39.092054 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bba6369-b728-41d2-bdaf-c52bade94af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:39.092652 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bba6369-b728-41d2-bdaf-c52bade94af8 admin admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:39.092928 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bba6369-b728-41d2-bdaf-c52bade94af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:39.093218 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bba6369-b728-41d2-bdaf-c52bade94af8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:39.093963 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bba6369-b728-41d2-bdaf-c52bade94af8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:39.095914 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bba6369-b728-41d2-bdaf-c52bade94af8 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:39.121899 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1321/2640] 10.222.0.49 () {60 vars in 1153 bytes} [Thu Sep 29 02:19:39 2022] POST /identity/v3/projects => generated 387 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:19:39.126294 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8885da5e-acee-4dff-8792-afd2fffc2705 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:39.137392 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8885da5e-acee-4dff-8792-afd2fffc2705 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:39.192002 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567d601d-8209-4244-ac6e-d08c7526e044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:39.192598 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d601d-8209-4244-ac6e-d08c7526e044 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:39.192877 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d601d-8209-4244-ac6e-d08c7526e044 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:39.193149 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d601d-8209-4244-ac6e-d08c7526e044 admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:39.193811 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567d601d-8209-4244-ac6e-d08c7526e044 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:39.195731 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567d601d-8209-4244-ac6e-d08c7526e044 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:39.217091 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1320/2641] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 02:19:39 2022] POST /identity/v3/users => generated 300 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:19:39.221719 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bba6369-b728-41d2-bdaf-c52bade94af8 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:39.232048 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bba6369-b728-41d2-bdaf-c52bade94af8 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:39.236647 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e2b4b9-03f5-4a50-bfb4-b8d63717e386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:39.237244 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e2b4b9-03f5-4a50-bfb4-b8d63717e386 admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:39.237553 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e2b4b9-03f5-4a50-bfb4-b8d63717e386 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:39.237827 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e2b4b9-03f5-4a50-bfb4-b8d63717e386 admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:39.238467 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e2b4b9-03f5-4a50-bfb4-b8d63717e386 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:39.240079 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e2b4b9-03f5-4a50-bfb4-b8d63717e386 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:39.250751 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1322/2642] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:19:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:19:39.254955 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567d601d-8209-4244-ac6e-d08c7526e044 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:39.264789 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567d601d-8209-4244-ac6e-d08c7526e044 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:39.270634 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303aabe7-e14e-459f-9e2f-88f904dbe9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:39.271273 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303aabe7-e14e-459f-9e2f-88f904dbe9d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:39.271550 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303aabe7-e14e-459f-9e2f-88f904dbe9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:39.271820 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303aabe7-e14e-459f-9e2f-88f904dbe9d0 admin admin] PATH_INFO: `/v3/projects/b7e8a5e679734a6b8f6555f89e31bbac/users/f382b5dd2cb241b38f7373211c69856b/roles/fe9bbc67742f4f5893f39b18eb31d59a` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:39.286422 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303aabe7-e14e-459f-9e2f-88f904dbe9d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7e8a5e679734a6b8f6555f89e31bbac, user_id=f382b5dd2cb241b38f7373211c69856b, role_id=fe9bbc67742f4f5893f39b18eb31d59a)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:39.289023 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303aabe7-e14e-459f-9e2f-88f904dbe9d0 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:39.302616 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1321/2643] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:19:39 2022] PUT /identity/v3/projects/b7e8a5e679734a6b8f6555f89e31bbac/users/f382b5dd2cb241b38f7373211c69856b/roles/fe9bbc67742f4f5893f39b18eb31d59a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:19:39.306461 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e2b4b9-03f5-4a50-bfb4-b8d63717e386 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:39.317526 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e2b4b9-03f5-4a50-bfb4-b8d63717e386 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:39.373399 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f429cce-177c-41bd-a91e-5b61ff9e32e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:39.373930 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f429cce-177c-41bd-a91e-5b61ff9e32e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:39.374212 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f429cce-177c-41bd-a91e-5b61ff9e32e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:39.375203 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f429cce-177c-41bd-a91e-5b61ff9e32e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:39.375869 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f429cce-177c-41bd-a91e-5b61ff9e32e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:39.377777 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f429cce-177c-41bd-a91e-5b61ff9e32e8 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:39.387428 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1323/2644] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:19:39 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:19:39.392300 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303aabe7-e14e-459f-9e2f-88f904dbe9d0 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:39.402576 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303aabe7-e14e-459f-9e2f-88f904dbe9d0 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:39.407264 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea20e23-2165-495e-a32f-943e6c55823f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:39.407893 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea20e23-2165-495e-a32f-943e6c55823f admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:39.408166 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea20e23-2165-495e-a32f-943e6c55823f admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:39.408434 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea20e23-2165-495e-a32f-943e6c55823f admin admin] PATH_INFO: `/v3/projects/b7e8a5e679734a6b8f6555f89e31bbac/users/f382b5dd2cb241b38f7373211c69856b/roles/fe9bbc67742f4f5893f39b18eb31d59a` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:39.410342 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea20e23-2165-495e-a32f-943e6c55823f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7e8a5e679734a6b8f6555f89e31bbac, user_id=f382b5dd2cb241b38f7373211c69856b, role_id=fe9bbc67742f4f5893f39b18eb31d59a)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:39.412954 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea20e23-2165-495e-a32f-943e6c55823f admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:39.424074 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1322/2645] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:19:39 2022] PUT /identity/v3/projects/b7e8a5e679734a6b8f6555f89e31bbac/users/f382b5dd2cb241b38f7373211c69856b/roles/fe9bbc67742f4f5893f39b18eb31d59a => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:19:39.434126 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224bf746-8b7d-4758-8f01-36cfbf5afb1d None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:39.434416 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224bf746-8b7d-4758-8f01-36cfbf5afb1d None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:39.434690 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224bf746-8b7d-4758-8f01-36cfbf5afb1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:39.463204 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-224bf746-8b7d-4758-8f01-36cfbf5afb1d None None] MFA Rules not processed for user `f382b5dd2cb241b38f7373211c69856b`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:19:39.464403 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-224bf746-8b7d-4758-8f01-36cfbf5afb1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:39.535749 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1324/2646] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:19:39 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:19:39.547907 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea20e23-2165-495e-a32f-943e6c55823f admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:39.549606 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-aea20e23-2165-495e-a32f-943e6c55823f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:39.608561 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea20e23-2165-495e-a32f-943e6c55823f admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:39.613378 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcfc5ae-04b0-4d71-959a-a9a2bc7134de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75135b856134ba4b9ccac337886f682', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:39.613980 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcfc5ae-04b0-4d71-959a-a9a2bc7134de service cinder] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:39.614254 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcfc5ae-04b0-4d71-959a-a9a2bc7134de service cinder] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:39.614517 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcfc5ae-04b0-4d71-959a-a9a2bc7134de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:39.623956 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcfc5ae-04b0-4d71-959a-a9a2bc7134de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:39.625332 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcfc5ae-04b0-4d71-959a-a9a2bc7134de service cinder] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:39.635286 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1323/2647] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:19:39 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:19:40.158291 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224bf746-8b7d-4758-8f01-36cfbf5afb1d None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:40.159614 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-224bf746-8b7d-4758-8f01-36cfbf5afb1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:40.171164 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224bf746-8b7d-4758-8f01-36cfbf5afb1d None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:40.175631 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea45f47a-356c-465f-8d12-93afc1aa3db7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75135b856134ba4b9ccac337886f682', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:40.176227 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea45f47a-356c-465f-8d12-93afc1aa3db7 service cinder] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:40.176503 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea45f47a-356c-465f-8d12-93afc1aa3db7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:40.176769 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea45f47a-356c-465f-8d12-93afc1aa3db7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:40.225511 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:19:40.236120 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea45f47a-356c-465f-8d12-93afc1aa3db7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:40.237916 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea45f47a-356c-465f-8d12-93afc1aa3db7 service cinder] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:40.246637 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1325/2648] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:19:40 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:19:43.804884 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcfc5ae-04b0-4d71-959a-a9a2bc7134de service cinder] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:43.806315 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-fbcfc5ae-04b0-4d71-959a-a9a2bc7134de service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:43.819672 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:19:43.904853 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcfc5ae-04b0-4d71-959a-a9a2bc7134de service cinder] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:43.910431 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1839e89-1ccc-4c4d-b976-a9bc40aa6404 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cbb39731a6b42e2a6647d6134b5c7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:43.911082 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1839e89-1ccc-4c4d-b976-a9bc40aa6404 service placement] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:43.911351 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1839e89-1ccc-4c4d-b976-a9bc40aa6404 service placement] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:43.911659 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1839e89-1ccc-4c4d-b976-a9bc40aa6404 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:43.913427 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-f1839e89-1ccc-4c4d-b976-a9bc40aa6404 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:43.925644 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1839e89-1ccc-4c4d-b976-a9bc40aa6404 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:43.927231 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1839e89-1ccc-4c4d-b976-a9bc40aa6404 service placement] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:43.938023 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1324/2649] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:19:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:19:44.372937 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea45f47a-356c-465f-8d12-93afc1aa3db7 service cinder] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:44.382202 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea45f47a-356c-465f-8d12-93afc1aa3db7 service cinder] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:44.385984 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0ca7be-fdd0-4e86-9bb6-2d5753855e6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75135b856134ba4b9ccac337886f682', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:44.386614 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0ca7be-fdd0-4e86-9bb6-2d5753855e6b service cinder] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:44.386888 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0ca7be-fdd0-4e86-9bb6-2d5753855e6b service cinder] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:44.387152 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0ca7be-fdd0-4e86-9bb6-2d5753855e6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:44.453483 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0ca7be-fdd0-4e86-9bb6-2d5753855e6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:44.455391 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0ca7be-fdd0-4e86-9bb6-2d5753855e6b service cinder] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:44.465420 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1326/2650] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:19:44 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:19:46.574514 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1839e89-1ccc-4c4d-b976-a9bc40aa6404 service placement] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:46.635261 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1839e89-1ccc-4c4d-b976-a9bc40aa6404 service placement] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:46.640224 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad6f59b-8229-401e-a5cd-58e1055cf680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:46.640843 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad6f59b-8229-401e-a5cd-58e1055cf680 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:46.641119 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad6f59b-8229-401e-a5cd-58e1055cf680 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:46.641416 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad6f59b-8229-401e-a5cd-58e1055cf680 admin admin] PATH_INFO: `/v3/users/7c62009537bf44d88f07b6fa580ce49d` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:46.642555 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad6f59b-8229-401e-a5cd-58e1055cf680 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c62009537bf44d88f07b6fa580ce49d)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:46.644450 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad6f59b-8229-401e-a5cd-58e1055cf680 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:46.692100 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-0ad6f59b-8229-401e-a5cd-58e1055cf680 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c62009537bf44d88f07b6fa580ce49d'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:46.692683 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-0ad6f59b-8229-401e-a5cd-58e1055cf680 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c62009537bf44d88f07b6fa580ce49d'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:46.706740 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-0ad6f59b-8229-401e-a5cd-58e1055cf680 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c62009537bf44d88f07b6fa580ce49d'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:46.714197 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-0ad6f59b-8229-401e-a5cd-58e1055cf680 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c62009537bf44d88f07b6fa580ce49d'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:46.714982 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-0ad6f59b-8229-401e-a5cd-58e1055cf680 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c62009537bf44d88f07b6fa580ce49d'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:46.723530 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:19:46.729882 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1325/2651] 10.222.0.49 () {58 vars in 1224 bytes} [Thu Sep 29 02:19:46 2022] DELETE /identity/v3/users/7c62009537bf44d88f07b6fa580ce49d => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:19:46.735176 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a142ba12-62d1-48c5-850d-21f7b1e6e48d None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:46.735693 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a142ba12-62d1-48c5-850d-21f7b1e6e48d None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:46.735693 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a142ba12-62d1-48c5-850d-21f7b1e6e48d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:46.754973 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-a142ba12-62d1-48c5-850d-21f7b1e6e48d None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:19:46.756172 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-a142ba12-62d1-48c5-850d-21f7b1e6e48d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:46.813721 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1327/2652] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:19:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:19:46.823204 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad6f59b-8229-401e-a5cd-58e1055cf680 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:46.824601 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-0ad6f59b-8229-401e-a5cd-58e1055cf680 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:46.884195 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad6f59b-8229-401e-a5cd-58e1055cf680 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:46.887917 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36543d9-a0f0-4e9b-98e0-42cb9a93a296 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:46.888523 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36543d9-a0f0-4e9b-98e0-42cb9a93a296 service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:46.888802 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36543d9-a0f0-4e9b-98e0-42cb9a93a296 service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:46.889070 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36543d9-a0f0-4e9b-98e0-42cb9a93a296 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:46.898289 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36543d9-a0f0-4e9b-98e0-42cb9a93a296 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:46.899744 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36543d9-a0f0-4e9b-98e0-42cb9a93a296 service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:46.910837 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1326/2653] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:19:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 29 02:19:47.236831 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a142ba12-62d1-48c5-850d-21f7b1e6e48d None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:47.238270 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-a142ba12-62d1-48c5-850d-21f7b1e6e48d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:47.250724 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a142ba12-62d1-48c5-850d-21f7b1e6e48d None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:47.255564 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76bd253-a1e7-4048-a56d-69af13a1dc1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:47.256190 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76bd253-a1e7-4048-a56d-69af13a1dc1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:47.256464 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76bd253-a1e7-4048-a56d-69af13a1dc1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:47.256752 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76bd253-a1e7-4048-a56d-69af13a1dc1d admin admin] PATH_INFO: `/v3/projects/076ab2e483da41aa9489e8e974faf0ca` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:47.257891 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76bd253-a1e7-4048-a56d-69af13a1dc1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=076ab2e483da41aa9489e8e974faf0ca)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:47.259833 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76bd253-a1e7-4048-a56d-69af13a1dc1d admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:47.305197 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-e76bd253-a1e7-4048-a56d-69af13a1dc1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '076ab2e483da41aa9489e8e974faf0ca', 'request_id': 'req-e76bd253-a1e7-4048-a56d-69af13a1dc1d'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:47.312263 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-e76bd253-a1e7-4048-a56d-69af13a1dc1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '076ab2e483da41aa9489e8e974faf0ca', 'request_id': 'req-e76bd253-a1e7-4048-a56d-69af13a1dc1d'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:47.319947 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-e76bd253-a1e7-4048-a56d-69af13a1dc1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '076ab2e483da41aa9489e8e974faf0ca', 'request_id': 'req-e76bd253-a1e7-4048-a56d-69af13a1dc1d'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:47.330945 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-e76bd253-a1e7-4048-a56d-69af13a1dc1d admin admin] The token cache is being invalidate because project 076ab2e483da41aa9489e8e974faf0ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81648) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:19:47.331231 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-e76bd253-a1e7-4048-a56d-69af13a1dc1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:47.331867 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-e76bd253-a1e7-4048-a56d-69af13a1dc1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:47.333335 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1328/2654] 10.222.0.49 () {58 vars in 1233 bytes} [Thu Sep 29 02:19:47 2022] DELETE /identity/v3/projects/076ab2e483da41aa9489e8e974faf0ca => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:19:47.337368 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36543d9-a0f0-4e9b-98e0-42cb9a93a296 service neutron] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:47.346819 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36543d9-a0f0-4e9b-98e0-42cb9a93a296 service neutron] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:47.401414 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b14aea-52d4-48c3-bad7-56457ca33d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:47.402011 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b14aea-52d4-48c3-bad7-56457ca33d1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:47.402283 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b14aea-52d4-48c3-bad7-56457ca33d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:47.402548 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b14aea-52d4-48c3-bad7-56457ca33d1d admin admin] PATH_INFO: `/v3/users/eaa0c94cf7c94192b55fd6c3bd0151af` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:47.403642 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b14aea-52d4-48c3-bad7-56457ca33d1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=eaa0c94cf7c94192b55fd6c3bd0151af)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:47.405584 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b14aea-52d4-48c3-bad7-56457ca33d1d admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:47.451154 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-30b14aea-52d4-48c3-bad7-56457ca33d1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eaa0c94cf7c94192b55fd6c3bd0151af'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:47.451809 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-30b14aea-52d4-48c3-bad7-56457ca33d1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eaa0c94cf7c94192b55fd6c3bd0151af'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:47.463549 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-30b14aea-52d4-48c3-bad7-56457ca33d1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eaa0c94cf7c94192b55fd6c3bd0151af'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:47.471104 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-30b14aea-52d4-48c3-bad7-56457ca33d1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eaa0c94cf7c94192b55fd6c3bd0151af'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:47.471772 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-30b14aea-52d4-48c3-bad7-56457ca33d1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eaa0c94cf7c94192b55fd6c3bd0151af'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:47.484782 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1327/2655] 10.222.0.49 () {58 vars in 1224 bytes} [Thu Sep 29 02:19:47 2022] DELETE /identity/v3/users/eaa0c94cf7c94192b55fd6c3bd0151af => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:19:47.752660 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76bd253-a1e7-4048-a56d-69af13a1dc1d admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:47.754189 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-e76bd253-a1e7-4048-a56d-69af13a1dc1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:47.768373 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76bd253-a1e7-4048-a56d-69af13a1dc1d admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:47.778354 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:19:47.828232 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9e7abc-c9ca-4ac2-b010-da1cf8cfb5ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:47.828779 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e7abc-c9ca-4ac2-b010-da1cf8cfb5ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:47.829056 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e7abc-c9ca-4ac2-b010-da1cf8cfb5ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:47.829350 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e7abc-c9ca-4ac2-b010-da1cf8cfb5ba admin admin] PATH_INFO: `/v3/projects/6c65c3b4639945e68152f16d2000ed39` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:47.830466 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9e7abc-c9ca-4ac2-b010-da1cf8cfb5ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c65c3b4639945e68152f16d2000ed39)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:47.832349 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9e7abc-c9ca-4ac2-b010-da1cf8cfb5ba admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:47.878677 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-9e9e7abc-c9ca-4ac2-b010-da1cf8cfb5ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c65c3b4639945e68152f16d2000ed39', 'request_id': 'req-9e9e7abc-c9ca-4ac2-b010-da1cf8cfb5ba'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:47.885063 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-9e9e7abc-c9ca-4ac2-b010-da1cf8cfb5ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c65c3b4639945e68152f16d2000ed39', 'request_id': 'req-9e9e7abc-c9ca-4ac2-b010-da1cf8cfb5ba'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:47.892502 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-9e9e7abc-c9ca-4ac2-b010-da1cf8cfb5ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c65c3b4639945e68152f16d2000ed39', 'request_id': 'req-9e9e7abc-c9ca-4ac2-b010-da1cf8cfb5ba'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:47.905797 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-9e9e7abc-c9ca-4ac2-b010-da1cf8cfb5ba admin admin] The token cache is being invalidate because project 6c65c3b4639945e68152f16d2000ed39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81648) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:19:47.906158 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-9e9e7abc-c9ca-4ac2-b010-da1cf8cfb5ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:47.909843 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-9e9e7abc-c9ca-4ac2-b010-da1cf8cfb5ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:47.911409 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1329/2656] 10.222.0.49 () {58 vars in 1233 bytes} [Thu Sep 29 02:19:47 2022] DELETE /identity/v3/projects/6c65c3b4639945e68152f16d2000ed39 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:19:47.915433 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b14aea-52d4-48c3-bad7-56457ca33d1d admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:47.916833 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-30b14aea-52d4-48c3-bad7-56457ca33d1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:47.930826 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b14aea-52d4-48c3-bad7-56457ca33d1d admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:47.947854 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:19:47.988887 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c674000-47f5-4a89-a58f-d9d5a6bf1e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:47.989529 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c674000-47f5-4a89-a58f-d9d5a6bf1e92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:47.989805 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c674000-47f5-4a89-a58f-d9d5a6bf1e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:47.990072 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c674000-47f5-4a89-a58f-d9d5a6bf1e92 admin admin] PATH_INFO: `/v3/users/f382b5dd2cb241b38f7373211c69856b` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:47.991285 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c674000-47f5-4a89-a58f-d9d5a6bf1e92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f382b5dd2cb241b38f7373211c69856b)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:47.993169 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c674000-47f5-4a89-a58f-d9d5a6bf1e92 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:48.043030 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-6c674000-47f5-4a89-a58f-d9d5a6bf1e92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f382b5dd2cb241b38f7373211c69856b'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:48.043830 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-6c674000-47f5-4a89-a58f-d9d5a6bf1e92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f382b5dd2cb241b38f7373211c69856b'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:48.057060 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-6c674000-47f5-4a89-a58f-d9d5a6bf1e92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f382b5dd2cb241b38f7373211c69856b'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:48.065374 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-6c674000-47f5-4a89-a58f-d9d5a6bf1e92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f382b5dd2cb241b38f7373211c69856b'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:48.065987 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-6c674000-47f5-4a89-a58f-d9d5a6bf1e92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f382b5dd2cb241b38f7373211c69856b'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:48.078382 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1328/2657] 10.222.0.49 () {58 vars in 1224 bytes} [Thu Sep 29 02:19:47 2022] DELETE /identity/v3/users/f382b5dd2cb241b38f7373211c69856b => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:19:48.358524 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9e7abc-c9ca-4ac2-b010-da1cf8cfb5ba admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:48.360123 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-9e9e7abc-c9ca-4ac2-b010-da1cf8cfb5ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:48.374248 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9e7abc-c9ca-4ac2-b010-da1cf8cfb5ba admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:48.430486 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7759472e-d78f-4077-851c-b7d8d42b8a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:48.431106 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7759472e-d78f-4077-851c-b7d8d42b8a66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:48.431381 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7759472e-d78f-4077-851c-b7d8d42b8a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:48.431647 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7759472e-d78f-4077-851c-b7d8d42b8a66 admin admin] PATH_INFO: `/v3/projects/b7e8a5e679734a6b8f6555f89e31bbac` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:48.432744 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7759472e-d78f-4077-851c-b7d8d42b8a66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7e8a5e679734a6b8f6555f89e31bbac)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:48.434649 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7759472e-d78f-4077-851c-b7d8d42b8a66 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:48.478099 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:19:48.481469 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-7759472e-d78f-4077-851c-b7d8d42b8a66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7e8a5e679734a6b8f6555f89e31bbac', 'request_id': 'req-7759472e-d78f-4077-851c-b7d8d42b8a66'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:48.489059 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-7759472e-d78f-4077-851c-b7d8d42b8a66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7e8a5e679734a6b8f6555f89e31bbac', 'request_id': 'req-7759472e-d78f-4077-851c-b7d8d42b8a66'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:48.496267 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-7759472e-d78f-4077-851c-b7d8d42b8a66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7e8a5e679734a6b8f6555f89e31bbac', 'request_id': 'req-7759472e-d78f-4077-851c-b7d8d42b8a66'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:48.507122 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-7759472e-d78f-4077-851c-b7d8d42b8a66 admin admin] The token cache is being invalidate because project b7e8a5e679734a6b8f6555f89e31bbac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81648) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:19:48.507410 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-7759472e-d78f-4077-851c-b7d8d42b8a66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:48.508025 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-7759472e-d78f-4077-851c-b7d8d42b8a66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:48.509512 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1330/2658] 10.222.0.49 () {58 vars in 1233 bytes} [Thu Sep 29 02:19:48 2022] DELETE /identity/v3/projects/b7e8a5e679734a6b8f6555f89e31bbac => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:19:48.516146 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85fa258-fc04-4711-996f-7661edefbe06 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:48.516427 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85fa258-fc04-4711-996f-7661edefbe06 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:48.516702 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85fa258-fc04-4711-996f-7661edefbe06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:48.537051 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-b85fa258-fc04-4711-996f-7661edefbe06 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:19:48.538287 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-b85fa258-fc04-4711-996f-7661edefbe06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:48.601474 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1329/2659] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:19:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:19:48.611097 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21313b7d-79bc-4853-a1a3-758d83e9540c None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:48.611380 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21313b7d-79bc-4853-a1a3-758d83e9540c None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:48.611654 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21313b7d-79bc-4853-a1a3-758d83e9540c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:48.632714 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-21313b7d-79bc-4853-a1a3-758d83e9540c None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:19:48.633948 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-21313b7d-79bc-4853-a1a3-758d83e9540c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:48.643051 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1331/2660] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:19:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:19:48.647216 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85fa258-fc04-4711-996f-7661edefbe06 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:48.657002 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85fa258-fc04-4711-996f-7661edefbe06 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:48.661803 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba41f1c-6df7-4b1c-bf64-94ab36ffe258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:48.662391 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba41f1c-6df7-4b1c-bf64-94ab36ffe258 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:48.662663 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba41f1c-6df7-4b1c-bf64-94ab36ffe258 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:48.662930 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba41f1c-6df7-4b1c-bf64-94ab36ffe258 admin admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:48.663591 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba41f1c-6df7-4b1c-bf64-94ab36ffe258 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:19:48.663886 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba41f1c-6df7-4b1c-bf64-94ab36ffe258 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:48.665741 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba41f1c-6df7-4b1c-bf64-94ab36ffe258 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:48.678589 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1330/2661] 10.222.0.49 () {58 vars in 1153 bytes} [Thu Sep 29 02:19:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:19:48.682950 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21313b7d-79bc-4853-a1a3-758d83e9540c None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:48.692539 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21313b7d-79bc-4853-a1a3-758d83e9540c None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:48.697082 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a9e2c5-6b50-4dfa-af05-350c5e9294af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:48.697705 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a9e2c5-6b50-4dfa-af05-350c5e9294af admin admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:48.697979 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a9e2c5-6b50-4dfa-af05-350c5e9294af admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:48.698244 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a9e2c5-6b50-4dfa-af05-350c5e9294af admin admin] PATH_INFO: `/v3/projects` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:48.698874 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a9e2c5-6b50-4dfa-af05-350c5e9294af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:48.700738 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a9e2c5-6b50-4dfa-af05-350c5e9294af admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:48.728047 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1332/2662] 10.222.0.49 () {60 vars in 1153 bytes} [Thu Sep 29 02:19:48 2022] POST /identity/v3/projects => generated 381 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:19:48.732202 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba41f1c-6df7-4b1c-bf64-94ab36ffe258 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:48.743104 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba41f1c-6df7-4b1c-bf64-94ab36ffe258 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:48.769092 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:19:48.803755 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab7f96c-fca9-4b4f-a238-ce402c912208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:48.804358 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab7f96c-fca9-4b4f-a238-ce402c912208 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:48.804711 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab7f96c-fca9-4b4f-a238-ce402c912208 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:48.804882 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab7f96c-fca9-4b4f-a238-ce402c912208 admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:48.805547 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab7f96c-fca9-4b4f-a238-ce402c912208 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:48.807417 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab7f96c-fca9-4b4f-a238-ce402c912208 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:48.831256 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1331/2663] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 02:19:48 2022] POST /identity/v3/users => generated 291 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:19:48.835878 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a9e2c5-6b50-4dfa-af05-350c5e9294af admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:48.847615 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a9e2c5-6b50-4dfa-af05-350c5e9294af admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:48.852746 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d5502f-48fd-4bf7-bb00-2ce832b834db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:48.853287 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d5502f-48fd-4bf7-bb00-2ce832b834db admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:48.853591 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d5502f-48fd-4bf7-bb00-2ce832b834db admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:48.853865 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d5502f-48fd-4bf7-bb00-2ce832b834db admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:48.854506 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d5502f-48fd-4bf7-bb00-2ce832b834db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:48.856152 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d5502f-48fd-4bf7-bb00-2ce832b834db admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:48.871001 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1333/2664] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:19:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:19:48.872328 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab7f96c-fca9-4b4f-a238-ce402c912208 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:48.883630 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab7f96c-fca9-4b4f-a238-ce402c912208 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:48.886849 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8778eb-77b7-4bf7-b652-3c3038d39b10 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:48.887258 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8778eb-77b7-4bf7-b652-3c3038d39b10 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:48.887604 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8778eb-77b7-4bf7-b652-3c3038d39b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:48.888647 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94876285-de06-4a6c-a17b-968a344dfeb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:48.889286 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94876285-de06-4a6c-a17b-968a344dfeb3 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:48.889747 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94876285-de06-4a6c-a17b-968a344dfeb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:48.890025 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94876285-de06-4a6c-a17b-968a344dfeb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:48.890780 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94876285-de06-4a6c-a17b-968a344dfeb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:48.892345 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94876285-de06-4a6c-a17b-968a344dfeb3 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:48.906002 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1332/2665] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:19:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:19:48.910964 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94876285-de06-4a6c-a17b-968a344dfeb3 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:48.919407 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-6c8778eb-77b7-4bf7-b652-3c3038d39b10 None None] MFA Rules not processed for user `0f8f13f302de4701a7f4e0562bca08cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:19:48.921294 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-6c8778eb-77b7-4bf7-b652-3c3038d39b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:48.921735 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94876285-de06-4a6c-a17b-968a344dfeb3 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:48.926494 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7044cff-3c0a-4fef-a1a9-2559648920f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:48.927136 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7044cff-3c0a-4fef-a1a9-2559648920f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:48.927412 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7044cff-3c0a-4fef-a1a9-2559648920f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:48.927686 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7044cff-3c0a-4fef-a1a9-2559648920f0 admin admin] PATH_INFO: `/v3/projects/aca0703f6af2454eb9d76bc5229cc660/users/a41351c6328a4eae894a168e23d94127/roles/f157f905c9c94ccfbfb46e52d443e8f2` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:48.957527 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7044cff-3c0a-4fef-a1a9-2559648920f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aca0703f6af2454eb9d76bc5229cc660, user_id=a41351c6328a4eae894a168e23d94127, role_id=f157f905c9c94ccfbfb46e52d443e8f2)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:48.960432 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7044cff-3c0a-4fef-a1a9-2559648920f0 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:48.975404 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1333/2666] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:19:48 2022] PUT /identity/v3/projects/aca0703f6af2454eb9d76bc5229cc660/users/a41351c6328a4eae894a168e23d94127/roles/f157f905c9c94ccfbfb46e52d443e8f2 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:19:48.987396 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e91a23-98d7-4bea-a7c5-7f8a00d8b3ec None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:48.987676 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e91a23-98d7-4bea-a7c5-7f8a00d8b3ec None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:48.987947 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e91a23-98d7-4bea-a7c5-7f8a00d8b3ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:48.992023 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1334/2667] 10.222.0.49 () {58 vars in 1009 bytes} [Thu Sep 29 02:19:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 29 02:19:49.022104 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-f2e91a23-98d7-4bea-a7c5-7f8a00d8b3ec None None] MFA Rules not processed for user `a41351c6328a4eae894a168e23d94127`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:19:49.023411 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-f2e91a23-98d7-4bea-a7c5-7f8a00d8b3ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:49.042632 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8778eb-77b7-4bf7-b652-3c3038d39b10 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:49.044434 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-6c8778eb-77b7-4bf7-b652-3c3038d39b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:49.096703 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1334/2668] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:19:48 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 29 02:19:49.101079 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e91a23-98d7-4bea-a7c5-7f8a00d8b3ec None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:49.127370 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8778eb-77b7-4bf7-b652-3c3038d39b10 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:49.151076 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:19:49.165059 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e91a23-98d7-4bea-a7c5-7f8a00d8b3ec None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:49.169876 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdb3ced-4969-4a2d-a2b7-e77a0160bbec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:49.170556 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdb3ced-4969-4a2d-a2b7-e77a0160bbec admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:49.171496 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdb3ced-4969-4a2d-a2b7-e77a0160bbec admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:49.171770 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdb3ced-4969-4a2d-a2b7-e77a0160bbec admin admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:49.172705 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdb3ced-4969-4a2d-a2b7-e77a0160bbec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:49.174603 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdb3ced-4969-4a2d-a2b7-e77a0160bbec admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:49.190115 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:19:49.190642 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036825fc-cf27-4a02-a73e-a6970783c5f1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c88bc0f32600416ca7c6a59f4196e497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:49.191257 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036825fc-cf27-4a02-a73e-a6970783c5f1 service swift] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:49.191646 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036825fc-cf27-4a02-a73e-a6970783c5f1 service swift] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:49.192068 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036825fc-cf27-4a02-a73e-a6970783c5f1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:49.203047 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1335/2669] 10.222.0.49 () {60 vars in 1153 bytes} [Thu Sep 29 02:19:49 2022] POST /identity/v3/projects => generated 381 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 29 02:19:49.206941 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdb3ced-4969-4a2d-a2b7-e77a0160bbec admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:49.255178 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036825fc-cf27-4a02-a73e-a6970783c5f1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:49.256979 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036825fc-cf27-4a02-a73e-a6970783c5f1 service swift] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:49.266101 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1335/2670] 10.222.0.49 () {60 vars in 1384 bytes} [Thu Sep 29 02:19:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 29 02:19:49.282108 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdb3ced-4969-4a2d-a2b7-e77a0160bbec admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:49.287025 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d04bb21-b6c6-4c84-a039-7a11158fb3b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:49.287623 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d04bb21-b6c6-4c84-a039-7a11158fb3b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:49.287937 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d04bb21-b6c6-4c84-a039-7a11158fb3b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:49.299398 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d04bb21-b6c6-4c84-a039-7a11158fb3b3 admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:49.300179 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d04bb21-b6c6-4c84-a039-7a11158fb3b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:49.302169 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d04bb21-b6c6-4c84-a039-7a11158fb3b3 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:49.342498 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1336/2671] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 02:19:49 2022] POST /identity/v3/users => generated 297 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:19:49.346673 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036825fc-cf27-4a02-a73e-a6970783c5f1 service swift] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:49.360468 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036825fc-cf27-4a02-a73e-a6970783c5f1 service swift] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:49.366373 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de7ff1d-dcba-4694-b021-e35c89dc0219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:49.367035 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de7ff1d-dcba-4694-b021-e35c89dc0219 admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:49.367322 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de7ff1d-dcba-4694-b021-e35c89dc0219 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:49.367722 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de7ff1d-dcba-4694-b021-e35c89dc0219 admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:49.368409 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de7ff1d-dcba-4694-b021-e35c89dc0219 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:49.370109 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de7ff1d-dcba-4694-b021-e35c89dc0219 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:49.386746 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1336/2672] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:19:49 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:19:49.387905 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d04bb21-b6c6-4c84-a039-7a11158fb3b3 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:49.401186 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d04bb21-b6c6-4c84-a039-7a11158fb3b3 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:49.414633 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd1717a-cca7-499f-af92-251ea48f47a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:49.415481 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd1717a-cca7-499f-af92-251ea48f47a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:49.415983 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd1717a-cca7-499f-af92-251ea48f47a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:49.416259 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd1717a-cca7-499f-af92-251ea48f47a7 admin admin] PATH_INFO: `/v3/projects/11ed503f53b1423fba44841d13e18b4c/users/ee4cf1481b3c4fa7a2826b3c08137b48/roles/fe9bbc67742f4f5893f39b18eb31d59a` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:49.441731 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd1717a-cca7-499f-af92-251ea48f47a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11ed503f53b1423fba44841d13e18b4c, user_id=ee4cf1481b3c4fa7a2826b3c08137b48, role_id=fe9bbc67742f4f5893f39b18eb31d59a)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:49.444552 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd1717a-cca7-499f-af92-251ea48f47a7 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:49.462422 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1337/2673] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:19:49 2022] PUT /identity/v3/projects/11ed503f53b1423fba44841d13e18b4c/users/ee4cf1481b3c4fa7a2826b3c08137b48/roles/fe9bbc67742f4f5893f39b18eb31d59a => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:19:49.466342 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de7ff1d-dcba-4694-b021-e35c89dc0219 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:49.477749 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de7ff1d-dcba-4694-b021-e35c89dc0219 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:49.546366 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3809efd7-e6e9-4ba0-a94e-16488668e231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:49.546979 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3809efd7-e6e9-4ba0-a94e-16488668e231 admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:49.549790 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3809efd7-e6e9-4ba0-a94e-16488668e231 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:49.550069 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3809efd7-e6e9-4ba0-a94e-16488668e231 admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:49.550726 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3809efd7-e6e9-4ba0-a94e-16488668e231 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:49.552338 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3809efd7-e6e9-4ba0-a94e-16488668e231 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:49.563342 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1337/2674] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:19:49 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 29 02:19:49.567457 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd1717a-cca7-499f-af92-251ea48f47a7 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:49.581777 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd1717a-cca7-499f-af92-251ea48f47a7 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:49.599536 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7c0ff6-0858-43b8-a52f-5340ce9e62d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:49.599536 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c0ff6-0858-43b8-a52f-5340ce9e62d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:49.599536 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c0ff6-0858-43b8-a52f-5340ce9e62d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:49.599536 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c0ff6-0858-43b8-a52f-5340ce9e62d9 admin admin] PATH_INFO: `/v3/projects/11ed503f53b1423fba44841d13e18b4c/users/ee4cf1481b3c4fa7a2826b3c08137b48/roles/fe9bbc67742f4f5893f39b18eb31d59a` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:49.599993 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7c0ff6-0858-43b8-a52f-5340ce9e62d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11ed503f53b1423fba44841d13e18b4c, user_id=ee4cf1481b3c4fa7a2826b3c08137b48, role_id=fe9bbc67742f4f5893f39b18eb31d59a)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:49.600309 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7c0ff6-0858-43b8-a52f-5340ce9e62d9 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:49.614745 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1338/2675] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:19:49 2022] PUT /identity/v3/projects/11ed503f53b1423fba44841d13e18b4c/users/ee4cf1481b3c4fa7a2826b3c08137b48/roles/fe9bbc67742f4f5893f39b18eb31d59a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:19:49.626707 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52821ec-325b-457d-8b85-194b8d85aeff None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:49.626986 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52821ec-325b-457d-8b85-194b8d85aeff None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:49.627266 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52821ec-325b-457d-8b85-194b8d85aeff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:49.661142 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-c52821ec-325b-457d-8b85-194b8d85aeff None None] MFA Rules not processed for user `ee4cf1481b3c4fa7a2826b3c08137b48`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:19:49.662320 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-c52821ec-325b-457d-8b85-194b8d85aeff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:49.717080 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:19:49.751740 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1338/2676] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:19:49 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:19:49.762792 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7c0ff6-0858-43b8-a52f-5340ce9e62d9 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:49.765338 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-6b7c0ff6-0858-43b8-a52f-5340ce9e62d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:49.839575 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7c0ff6-0858-43b8-a52f-5340ce9e62d9 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:49.845131 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec109e24-17b0-4b47-a4b0-dcf1663035a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75135b856134ba4b9ccac337886f682', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:49.845784 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec109e24-17b0-4b47-a4b0-dcf1663035a0 service cinder] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:49.846058 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec109e24-17b0-4b47-a4b0-dcf1663035a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:49.846325 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec109e24-17b0-4b47-a4b0-dcf1663035a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:49.856787 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec109e24-17b0-4b47-a4b0-dcf1663035a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:49.858729 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec109e24-17b0-4b47-a4b0-dcf1663035a0 service cinder] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:49.868761 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1339/2677] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:19:49 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:19:49.992208 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52821ec-325b-457d-8b85-194b8d85aeff None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:50.003113 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52821ec-325b-457d-8b85-194b8d85aeff None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:50.006662 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d8440f-000c-4c23-9278-8d44d10955b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75135b856134ba4b9ccac337886f682', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:50.007262 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d8440f-000c-4c23-9278-8d44d10955b5 service cinder] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:50.007536 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d8440f-000c-4c23-9278-8d44d10955b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:50.007802 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d8440f-000c-4c23-9278-8d44d10955b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:50.084448 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d8440f-000c-4c23-9278-8d44d10955b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:50.086040 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d8440f-000c-4c23-9278-8d44d10955b5 service cinder] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:50.097121 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1339/2678] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:19:49 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:19:52.780731 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec109e24-17b0-4b47-a4b0-dcf1663035a0 service cinder] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:52.836077 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:19:52.854438 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec109e24-17b0-4b47-a4b0-dcf1663035a0 service cinder] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:52.860807 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7f6c4c-0ca8-4d26-b14d-ae09336d5d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:52.861630 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f6c4c-0ca8-4d26-b14d-ae09336d5d89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:52.861909 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f6c4c-0ca8-4d26-b14d-ae09336d5d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:52.862180 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f6c4c-0ca8-4d26-b14d-ae09336d5d89 admin admin] PATH_INFO: `/v3/users/a41351c6328a4eae894a168e23d94127` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:52.863463 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7f6c4c-0ca8-4d26-b14d-ae09336d5d89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a41351c6328a4eae894a168e23d94127)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:52.865390 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7f6c4c-0ca8-4d26-b14d-ae09336d5d89 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:52.929369 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-4e7f6c4c-0ca8-4d26-b14d-ae09336d5d89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a41351c6328a4eae894a168e23d94127'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:52.930342 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-4e7f6c4c-0ca8-4d26-b14d-ae09336d5d89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a41351c6328a4eae894a168e23d94127'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:52.945374 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-4e7f6c4c-0ca8-4d26-b14d-ae09336d5d89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a41351c6328a4eae894a168e23d94127'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:52.955422 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-4e7f6c4c-0ca8-4d26-b14d-ae09336d5d89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a41351c6328a4eae894a168e23d94127'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:52.956331 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-4e7f6c4c-0ca8-4d26-b14d-ae09336d5d89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a41351c6328a4eae894a168e23d94127'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:52.975962 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1340/2679] 10.222.0.49 () {58 vars in 1224 bytes} [Thu Sep 29 02:19:52 2022] DELETE /identity/v3/users/a41351c6328a4eae894a168e23d94127 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:19:52.979924 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c17b11-f771-4efc-8e45-4351a50456d4 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:52.979924 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c17b11-f771-4efc-8e45-4351a50456d4 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:52.979924 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c17b11-f771-4efc-8e45-4351a50456d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:53.012466 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-00c17b11-f771-4efc-8e45-4351a50456d4 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:19:53.013788 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-00c17b11-f771-4efc-8e45-4351a50456d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:53.113563 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1340/2680] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:19:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:19:53.121302 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7f6c4c-0ca8-4d26-b14d-ae09336d5d89 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:53.123097 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-4e7f6c4c-0ca8-4d26-b14d-ae09336d5d89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:53.236031 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7f6c4c-0ca8-4d26-b14d-ae09336d5d89 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:53.240347 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc2c4b9-e3db-4936-aeae-6a7dba6c4b34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:53.241141 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2c4b9-e3db-4936-aeae-6a7dba6c4b34 service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:53.241575 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2c4b9-e3db-4936-aeae-6a7dba6c4b34 service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:53.242064 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2c4b9-e3db-4936-aeae-6a7dba6c4b34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:53.253828 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc2c4b9-e3db-4936-aeae-6a7dba6c4b34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:53.255538 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc2c4b9-e3db-4936-aeae-6a7dba6c4b34 service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:53.273633 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1341/2681] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:19:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:19:53.568382 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c17b11-f771-4efc-8e45-4351a50456d4 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:53.569819 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-00c17b11-f771-4efc-8e45-4351a50456d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:53.596916 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c17b11-f771-4efc-8e45-4351a50456d4 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:53.605456 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed46dbb-ff6d-4799-8004-bfe886cb85e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:53.606198 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed46dbb-ff6d-4799-8004-bfe886cb85e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:53.606548 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed46dbb-ff6d-4799-8004-bfe886cb85e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:53.606734 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed46dbb-ff6d-4799-8004-bfe886cb85e9 admin admin] PATH_INFO: `/v3/projects/aca0703f6af2454eb9d76bc5229cc660` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:53.609171 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed46dbb-ff6d-4799-8004-bfe886cb85e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aca0703f6af2454eb9d76bc5229cc660)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:53.611193 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed46dbb-ff6d-4799-8004-bfe886cb85e9 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:53.669598 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-2ed46dbb-ff6d-4799-8004-bfe886cb85e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aca0703f6af2454eb9d76bc5229cc660', 'request_id': 'req-2ed46dbb-ff6d-4799-8004-bfe886cb85e9'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:53.677464 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-2ed46dbb-ff6d-4799-8004-bfe886cb85e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aca0703f6af2454eb9d76bc5229cc660', 'request_id': 'req-2ed46dbb-ff6d-4799-8004-bfe886cb85e9'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:53.689843 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-2ed46dbb-ff6d-4799-8004-bfe886cb85e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aca0703f6af2454eb9d76bc5229cc660', 'request_id': 'req-2ed46dbb-ff6d-4799-8004-bfe886cb85e9'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:53.698705 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:19:53.708830 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-2ed46dbb-ff6d-4799-8004-bfe886cb85e9 admin admin] The token cache is being invalidate because project aca0703f6af2454eb9d76bc5229cc660 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81648) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:19:53.709125 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-2ed46dbb-ff6d-4799-8004-bfe886cb85e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:53.709861 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-2ed46dbb-ff6d-4799-8004-bfe886cb85e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:53.711487 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1341/2682] 10.222.0.49 () {58 vars in 1233 bytes} [Thu Sep 29 02:19:53 2022] DELETE /identity/v3/projects/aca0703f6af2454eb9d76bc5229cc660 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:19:53.715944 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc2c4b9-e3db-4936-aeae-6a7dba6c4b34 service neutron] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:53.728070 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc2c4b9-e3db-4936-aeae-6a7dba6c4b34 service neutron] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:53.796701 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:19:53.807684 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee22036-6f55-4b94-9b4e-c325758fb327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:53.808360 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee22036-6f55-4b94-9b4e-c325758fb327 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:53.808712 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee22036-6f55-4b94-9b4e-c325758fb327 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:53.808891 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee22036-6f55-4b94-9b4e-c325758fb327 admin admin] PATH_INFO: `/v3/users/ee4cf1481b3c4fa7a2826b3c08137b48` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:53.810349 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee22036-6f55-4b94-9b4e-c325758fb327 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee4cf1481b3c4fa7a2826b3c08137b48)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:53.813879 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee22036-6f55-4b94-9b4e-c325758fb327 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:53.871986 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-fee22036-6f55-4b94-9b4e-c325758fb327 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee4cf1481b3c4fa7a2826b3c08137b48'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:53.872949 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-fee22036-6f55-4b94-9b4e-c325758fb327 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee4cf1481b3c4fa7a2826b3c08137b48'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:53.889876 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-fee22036-6f55-4b94-9b4e-c325758fb327 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee4cf1481b3c4fa7a2826b3c08137b48'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:53.898046 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-fee22036-6f55-4b94-9b4e-c325758fb327 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee4cf1481b3c4fa7a2826b3c08137b48'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:53.898854 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-fee22036-6f55-4b94-9b4e-c325758fb327 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee4cf1481b3c4fa7a2826b3c08137b48'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:53.919541 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1342/2683] 10.222.0.49 () {58 vars in 1224 bytes} [Thu Sep 29 02:19:53 2022] DELETE /identity/v3/users/ee4cf1481b3c4fa7a2826b3c08137b48 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:19:54.223396 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed46dbb-ff6d-4799-8004-bfe886cb85e9 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:54.225282 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-2ed46dbb-ff6d-4799-8004-bfe886cb85e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:54.256219 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed46dbb-ff6d-4799-8004-bfe886cb85e9 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:54.329980 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dc4268-f2f5-46f4-b249-f6dbdef36942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:54.330697 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dc4268-f2f5-46f4-b249-f6dbdef36942 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:54.331037 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dc4268-f2f5-46f4-b249-f6dbdef36942 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:54.331309 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dc4268-f2f5-46f4-b249-f6dbdef36942 admin admin] PATH_INFO: `/v3/projects/11ed503f53b1423fba44841d13e18b4c` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:54.333334 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dc4268-f2f5-46f4-b249-f6dbdef36942 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11ed503f53b1423fba44841d13e18b4c)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:54.335353 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dc4268-f2f5-46f4-b249-f6dbdef36942 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:54.417160 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-60dc4268-f2f5-46f4-b249-f6dbdef36942 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11ed503f53b1423fba44841d13e18b4c', 'request_id': 'req-60dc4268-f2f5-46f4-b249-f6dbdef36942'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:54.428023 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-60dc4268-f2f5-46f4-b249-f6dbdef36942 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11ed503f53b1423fba44841d13e18b4c', 'request_id': 'req-60dc4268-f2f5-46f4-b249-f6dbdef36942'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:54.440169 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-60dc4268-f2f5-46f4-b249-f6dbdef36942 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11ed503f53b1423fba44841d13e18b4c', 'request_id': 'req-60dc4268-f2f5-46f4-b249-f6dbdef36942'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:54.454796 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-60dc4268-f2f5-46f4-b249-f6dbdef36942 admin admin] The token cache is being invalidate because project 11ed503f53b1423fba44841d13e18b4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81648) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:19:54.455071 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-60dc4268-f2f5-46f4-b249-f6dbdef36942 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:54.455789 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-60dc4268-f2f5-46f4-b249-f6dbdef36942 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:54.457548 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1342/2684] 10.222.0.49 () {58 vars in 1233 bytes} [Thu Sep 29 02:19:54 2022] DELETE /identity/v3/projects/11ed503f53b1423fba44841d13e18b4c => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:19:54.462604 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f500905d-d021-4749-96ae-5d6ba2aa7c9b None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:54.462894 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f500905d-d021-4749-96ae-5d6ba2aa7c9b None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:54.463169 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f500905d-d021-4749-96ae-5d6ba2aa7c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:54.487168 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-f500905d-d021-4749-96ae-5d6ba2aa7c9b None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:19:54.488399 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-f500905d-d021-4749-96ae-5d6ba2aa7c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:54.565660 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1343/2685] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:19:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:19:54.567168 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c07ed6-62e2-43fb-b501-2c409f9a05c9 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:54.567539 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c07ed6-62e2-43fb-b501-2c409f9a05c9 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:54.567920 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c07ed6-62e2-43fb-b501-2c409f9a05c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:54.591151 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-77c07ed6-62e2-43fb-b501-2c409f9a05c9 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:19:54.592958 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-77c07ed6-62e2-43fb-b501-2c409f9a05c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:54.601176 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1343/2686] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:19:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 29 02:19:54.605744 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f500905d-d021-4749-96ae-5d6ba2aa7c9b None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:54.616916 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f500905d-d021-4749-96ae-5d6ba2aa7c9b None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:54.622062 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8065ff5d-4201-43e6-8c51-2bf9e136fab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:54.622665 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8065ff5d-4201-43e6-8c51-2bf9e136fab8 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:54.624648 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8065ff5d-4201-43e6-8c51-2bf9e136fab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:54.624648 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8065ff5d-4201-43e6-8c51-2bf9e136fab8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:54.624648 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8065ff5d-4201-43e6-8c51-2bf9e136fab8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:19:54.624970 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8065ff5d-4201-43e6-8c51-2bf9e136fab8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:54.626854 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8065ff5d-4201-43e6-8c51-2bf9e136fab8 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:54.643123 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1344/2687] 10.222.0.49 () {58 vars in 1153 bytes} [Thu Sep 29 02:19:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 02:19:54.644496 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c07ed6-62e2-43fb-b501-2c409f9a05c9 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:54.654976 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c07ed6-62e2-43fb-b501-2c409f9a05c9 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:54.660830 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a4fbb7-6ef3-4e68-8ed0-d43d37aecdf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:54.661519 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a4fbb7-6ef3-4e68-8ed0-d43d37aecdf3 admin admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:54.661776 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a4fbb7-6ef3-4e68-8ed0-d43d37aecdf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:54.662053 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a4fbb7-6ef3-4e68-8ed0-d43d37aecdf3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:54.662627 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a4fbb7-6ef3-4e68-8ed0-d43d37aecdf3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:54.664516 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a4fbb7-6ef3-4e68-8ed0-d43d37aecdf3 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:54.695107 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1344/2688] 10.222.0.49 () {60 vars in 1153 bytes} [Thu Sep 29 02:19:54 2022] POST /identity/v3/projects => generated 381 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 29 02:19:54.699415 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8065ff5d-4201-43e6-8c51-2bf9e136fab8 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:54.710097 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8065ff5d-4201-43e6-8c51-2bf9e136fab8 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:54.787847 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302b068e-d17c-460d-9ab7-1a93088e37d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:54.788467 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b068e-d17c-460d-9ab7-1a93088e37d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:54.788746 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b068e-d17c-460d-9ab7-1a93088e37d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:54.789017 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b068e-d17c-460d-9ab7-1a93088e37d8 admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:54.789806 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302b068e-d17c-460d-9ab7-1a93088e37d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:54.791576 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302b068e-d17c-460d-9ab7-1a93088e37d8 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:54.803168 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:19:54.820402 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1345/2689] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 02:19:54 2022] POST /identity/v3/users => generated 291 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:19:54.824723 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a4fbb7-6ef3-4e68-8ed0-d43d37aecdf3 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:54.836246 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a4fbb7-6ef3-4e68-8ed0-d43d37aecdf3 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:54.841443 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7f655c-fcc5-49b0-8126-18a58a115b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:54.841996 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f655c-fcc5-49b0-8126-18a58a115b31 admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:54.842273 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f655c-fcc5-49b0-8126-18a58a115b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:54.842544 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f655c-fcc5-49b0-8126-18a58a115b31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:54.843169 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7f655c-fcc5-49b0-8126-18a58a115b31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:54.844762 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7f655c-fcc5-49b0-8126-18a58a115b31 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:54.856050 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1345/2690] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:19:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:19:54.860352 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302b068e-d17c-460d-9ab7-1a93088e37d8 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:54.872238 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302b068e-d17c-460d-9ab7-1a93088e37d8 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:54.880383 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e2d2a0-4ff1-4fb0-b185-073c51ddbdc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:54.880950 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e2d2a0-4ff1-4fb0-b185-073c51ddbdc6 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:54.881396 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e2d2a0-4ff1-4fb0-b185-073c51ddbdc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:54.881700 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e2d2a0-4ff1-4fb0-b185-073c51ddbdc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:54.882479 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e2d2a0-4ff1-4fb0-b185-073c51ddbdc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:54.884645 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e2d2a0-4ff1-4fb0-b185-073c51ddbdc6 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:54.900791 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1346/2691] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:19:54 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 29 02:19:54.902090 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7f655c-fcc5-49b0-8126-18a58a115b31 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:54.914632 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7f655c-fcc5-49b0-8126-18a58a115b31 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:54.920609 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf7a084-3caa-4f46-ac16-1c664ba48dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:54.921500 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf7a084-3caa-4f46-ac16-1c664ba48dc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:54.921783 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf7a084-3caa-4f46-ac16-1c664ba48dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:54.922058 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf7a084-3caa-4f46-ac16-1c664ba48dc1 admin admin] PATH_INFO: `/v3/projects/c43a5e0267c347b59537cefb963718a8/users/ca38161343a34624ba2acbb6378049d7/roles/f157f905c9c94ccfbfb46e52d443e8f2` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:54.939437 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf7a084-3caa-4f46-ac16-1c664ba48dc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c43a5e0267c347b59537cefb963718a8, user_id=ca38161343a34624ba2acbb6378049d7, role_id=f157f905c9c94ccfbfb46e52d443e8f2)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:54.942362 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf7a084-3caa-4f46-ac16-1c664ba48dc1 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:54.959523 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1346/2692] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:19:54 2022] PUT /identity/v3/projects/c43a5e0267c347b59537cefb963718a8/users/ca38161343a34624ba2acbb6378049d7/roles/f157f905c9c94ccfbfb46e52d443e8f2 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:19:54.969490 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f403126-209e-4659-9ae4-5a951f631d69 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:54.970060 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f403126-209e-4659-9ae4-5a951f631d69 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:54.970667 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f403126-209e-4659-9ae4-5a951f631d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:55.002946 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-5f403126-209e-4659-9ae4-5a951f631d69 None None] MFA Rules not processed for user `ca38161343a34624ba2acbb6378049d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:19:55.004248 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-5f403126-209e-4659-9ae4-5a951f631d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:55.080563 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1347/2693] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:19:54 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:19:55.093243 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf7a084-3caa-4f46-ac16-1c664ba48dc1 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:55.094913 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-bdf7a084-3caa-4f46-ac16-1c664ba48dc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:55.134113 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:19:55.168586 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf7a084-3caa-4f46-ac16-1c664ba48dc1 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:55.173006 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76f9384-74fa-4c87-9383-35d74c745290 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75135b856134ba4b9ccac337886f682', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:55.173649 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76f9384-74fa-4c87-9383-35d74c745290 service cinder] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:55.173927 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76f9384-74fa-4c87-9383-35d74c745290 service cinder] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:55.174317 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76f9384-74fa-4c87-9383-35d74c745290 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:55.184119 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76f9384-74fa-4c87-9383-35d74c745290 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:55.185769 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76f9384-74fa-4c87-9383-35d74c745290 service cinder] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:55.197297 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1347/2694] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:19:55 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:19:55.219974 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f403126-209e-4659-9ae4-5a951f631d69 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:55.290890 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f403126-209e-4659-9ae4-5a951f631d69 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:55.297031 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a83c703-d8f8-4b5d-a38e-39e9b14527bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:55.297811 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a83c703-d8f8-4b5d-a38e-39e9b14527bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:55.298192 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a83c703-d8f8-4b5d-a38e-39e9b14527bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:55.298568 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a83c703-d8f8-4b5d-a38e-39e9b14527bb admin admin] PATH_INFO: `/v3/users/ca38161343a34624ba2acbb6378049d7` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:55.299812 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a83c703-d8f8-4b5d-a38e-39e9b14527bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca38161343a34624ba2acbb6378049d7)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:55.301880 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a83c703-d8f8-4b5d-a38e-39e9b14527bb admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:55.368909 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-3a83c703-d8f8-4b5d-a38e-39e9b14527bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca38161343a34624ba2acbb6378049d7'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:55.369705 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-3a83c703-d8f8-4b5d-a38e-39e9b14527bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca38161343a34624ba2acbb6378049d7'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:55.385345 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-3a83c703-d8f8-4b5d-a38e-39e9b14527bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca38161343a34624ba2acbb6378049d7'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:55.391479 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:19:55.405384 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-3a83c703-d8f8-4b5d-a38e-39e9b14527bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca38161343a34624ba2acbb6378049d7'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:55.406507 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-3a83c703-d8f8-4b5d-a38e-39e9b14527bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca38161343a34624ba2acbb6378049d7'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:55.427162 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1348/2695] 10.222.0.49 () {58 vars in 1224 bytes} [Thu Sep 29 02:19:55 2022] DELETE /identity/v3/users/ca38161343a34624ba2acbb6378049d7 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:19:55.431791 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd87cfb0-8300-4e4e-bce8-aab3db6cd4b4 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:55.432719 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd87cfb0-8300-4e4e-bce8-aab3db6cd4b4 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:55.433018 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd87cfb0-8300-4e4e-bce8-aab3db6cd4b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:55.454691 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-dd87cfb0-8300-4e4e-bce8-aab3db6cd4b4 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:19:55.456152 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-dd87cfb0-8300-4e4e-bce8-aab3db6cd4b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:55.550605 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1348/2696] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:19:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:19:55.561774 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a83c703-d8f8-4b5d-a38e-39e9b14527bb admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:55.563463 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-3a83c703-d8f8-4b5d-a38e-39e9b14527bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:55.633909 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a83c703-d8f8-4b5d-a38e-39e9b14527bb admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:55.638300 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfab5a8-db42-436b-820d-8483d014ee3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:55.639148 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfab5a8-db42-436b-820d-8483d014ee3f service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:55.639447 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfab5a8-db42-436b-820d-8483d014ee3f service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:55.639812 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfab5a8-db42-436b-820d-8483d014ee3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:55.649476 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfab5a8-db42-436b-820d-8483d014ee3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:55.650890 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfab5a8-db42-436b-820d-8483d014ee3f service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:55.661609 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1349/2697] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:19:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 29 02:19:55.993575 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd87cfb0-8300-4e4e-bce8-aab3db6cd4b4 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:19:55.995743 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-dd87cfb0-8300-4e4e-bce8-aab3db6cd4b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:19:56.011471 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd87cfb0-8300-4e4e-bce8-aab3db6cd4b4 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:19:56.018792 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7765c576-1e61-4450-9076-ed63279fa02e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:19:56.019542 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7765c576-1e61-4450-9076-ed63279fa02e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:19:56.020531 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7765c576-1e61-4450-9076-ed63279fa02e admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:19:56.021267 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7765c576-1e61-4450-9076-ed63279fa02e admin admin] PATH_INFO: `/v3/projects/c43a5e0267c347b59537cefb963718a8` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:19:56.022518 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7765c576-1e61-4450-9076-ed63279fa02e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c43a5e0267c347b59537cefb963718a8)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:19:56.025584 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7765c576-1e61-4450-9076-ed63279fa02e admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:19:56.084482 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-7765c576-1e61-4450-9076-ed63279fa02e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c43a5e0267c347b59537cefb963718a8', 'request_id': 'req-7765c576-1e61-4450-9076-ed63279fa02e'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:56.090718 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-7765c576-1e61-4450-9076-ed63279fa02e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c43a5e0267c347b59537cefb963718a8', 'request_id': 'req-7765c576-1e61-4450-9076-ed63279fa02e'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:56.099745 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-7765c576-1e61-4450-9076-ed63279fa02e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c43a5e0267c347b59537cefb963718a8', 'request_id': 'req-7765c576-1e61-4450-9076-ed63279fa02e'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:56.111132 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-7765c576-1e61-4450-9076-ed63279fa02e admin admin] The token cache is being invalidate because project c43a5e0267c347b59537cefb963718a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81648) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:19:56.111451 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-7765c576-1e61-4450-9076-ed63279fa02e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:56.112037 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-7765c576-1e61-4450-9076-ed63279fa02e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:19:56.113535 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1349/2698] 10.222.0.49 () {58 vars in 1233 bytes} [Thu Sep 29 02:19:55 2022] DELETE /identity/v3/projects/c43a5e0267c347b59537cefb963718a8 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:20:03.721953 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f3a5e-42c4-4273-b730-060fde7f596e None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:20:03.722480 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f3a5e-42c4-4273-b730-060fde7f596e None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:20:03.722709 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f3a5e-42c4-4273-b730-060fde7f596e None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:20:03.724120 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1350/2699] 10.222.0.49 () {54 vars in 921 bytes} [Thu Sep 29 02:20:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:20:03.730630 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56a30c7-168b-4798-afea-139be3073d2d None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:20:03.731072 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56a30c7-168b-4798-afea-139be3073d2d None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:20:03.731334 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56a30c7-168b-4798-afea-139be3073d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:20:03.764964 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-d56a30c7-168b-4798-afea-139be3073d2d None None] MFA Rules not processed for user `f3325a7111d447f4a9cf00c672d5420f`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:20:03.766502 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-d56a30c7-168b-4798-afea-139be3073d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:20:03.806075 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:20:03.849337 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1350/2700] 10.222.0.49 () {58 vars in 1018 bytes} [Thu Sep 29 02:20:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:20:03.862308 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61f3a5e-42c4-4273-b730-060fde7f596e None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:20:03.864292 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-d61f3a5e-42c4-4273-b730-060fde7f596e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:20:03.928546 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61f3a5e-42c4-4273-b730-060fde7f596e None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:20:03.932015 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7cee57-0a39-4058-a7ee-f8bb106882d1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d36669146554031ba8596cb583cd6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:20:03.932606 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7cee57-0a39-4058-a7ee-f8bb106882d1 service glance] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:20:03.932877 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7cee57-0a39-4058-a7ee-f8bb106882d1 service glance] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:20:03.933142 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7cee57-0a39-4058-a7ee-f8bb106882d1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:20:03.943798 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7cee57-0a39-4058-a7ee-f8bb106882d1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:20:03.945198 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7cee57-0a39-4058-a7ee-f8bb106882d1 service glance] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:20:03.955758 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1351/2701] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:20:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:20:04.024325 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef7e0c-bb1f-4cf8-abe8-c9d0a5747040 None None] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:20:04.024613 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef7e0c-bb1f-4cf8-abe8-c9d0a5747040 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:20:04.024892 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef7e0c-bb1f-4cf8-abe8-c9d0a5747040 None None] PATH_INFO: `/` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:20:04.026271 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1351/2702] 10.222.0.49 () {54 vars in 921 bytes} [Thu Sep 29 02:20:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:20:04.030760 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4324901c-14b2-4020-a5e1-bd8489ec58bc None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:20:04.031046 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4324901c-14b2-4020-a5e1-bd8489ec58bc None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:20:04.031317 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4324901c-14b2-4020-a5e1-bd8489ec58bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:20:04.051888 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-4324901c-14b2-4020-a5e1-bd8489ec58bc None None] MFA Rules not processed for user `2053f823bd3c4098a43c299890c1f733`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:20:04.053106 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-4324901c-14b2-4020-a5e1-bd8489ec58bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:20:04.108039 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1352/2703] 10.222.0.49 () {58 vars in 1018 bytes} [Thu Sep 29 02:20:04 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:20:04.119507 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ef7e0c-bb1f-4cf8-abe8-c9d0a5747040 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:20:04.121219 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-53ef7e0c-bb1f-4cf8-abe8-c9d0a5747040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:20:04.134622 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ef7e0c-bb1f-4cf8-abe8-c9d0a5747040 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:20:04.139832 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237af3af-1145-46bb-b4ae-6a9afaf4390c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:20:04.140419 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237af3af-1145-46bb-b4ae-6a9afaf4390c service neutron] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:20:04.140691 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237af3af-1145-46bb-b4ae-6a9afaf4390c service neutron] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:20:04.140957 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237af3af-1145-46bb-b4ae-6a9afaf4390c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:20:04.147932 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237af3af-1145-46bb-b4ae-6a9afaf4390c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:20:04.149372 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237af3af-1145-46bb-b4ae-6a9afaf4390c service neutron] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:20:04.157558 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1352/2704] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:20:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:20:05.251708 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da35544-dedd-435b-add5-0d8901880576 None None] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:20:05.252179 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da35544-dedd-435b-add5-0d8901880576 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:20:05.252293 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da35544-dedd-435b-add5-0d8901880576 None None] PATH_INFO: `/` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:20:05.253686 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1353/2705] 10.222.0.49 () {54 vars in 921 bytes} [Thu Sep 29 02:20:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 29 02:20:05.258957 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a30d294-9af8-46da-8cc3-9c05248afed0 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:20:05.259397 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a30d294-9af8-46da-8cc3-9c05248afed0 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:20:05.259512 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a30d294-9af8-46da-8cc3-9c05248afed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:20:05.278890 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-0a30d294-9af8-46da-8cc3-9c05248afed0 None None] MFA Rules not processed for user `f3325a7111d447f4a9cf00c672d5420f`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:20:05.280074 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-0a30d294-9af8-46da-8cc3-9c05248afed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:20:05.288968 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1353/2706] 10.222.0.49 () {58 vars in 1018 bytes} [Thu Sep 29 02:20:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:20:05.300283 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da35544-dedd-435b-add5-0d8901880576 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:20:05.302038 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-2da35544-dedd-435b-add5-0d8901880576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:20:05.315804 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da35544-dedd-435b-add5-0d8901880576 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:20:05.319258 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6609e69-3d83-4ed6-ac1e-4d46becd4e9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:20:05.319847 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6609e69-3d83-4ed6-ac1e-4d46becd4e9c service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:20:05.320122 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6609e69-3d83-4ed6-ac1e-4d46becd4e9c service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:20:05.320391 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6609e69-3d83-4ed6-ac1e-4d46becd4e9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:20:05.330333 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6609e69-3d83-4ed6-ac1e-4d46becd4e9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:20:05.331740 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6609e69-3d83-4ed6-ac1e-4d46becd4e9c service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:20:05.342223 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1354/2707] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:20:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 29 02:20:10.051000 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6461254-9dc9-4430-a251-7e3a518ae41f None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:20:10.051478 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6461254-9dc9-4430-a251-7e3a518ae41f None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:20:10.051581 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6461254-9dc9-4430-a251-7e3a518ae41f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:20:10.070537 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-d6461254-9dc9-4430-a251-7e3a518ae41f None None] MFA Rules not processed for user `0f8f13f302de4701a7f4e0562bca08cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:20:10.071648 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-d6461254-9dc9-4430-a251-7e3a518ae41f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:20:10.127332 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1354/2708] 10.222.0.49 () {58 vars in 1009 bytes} [Thu Sep 29 02:20:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:20:10.139403 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6609e69-3d83-4ed6-ac1e-4d46becd4e9c service neutron] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:20:10.140766 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-b6609e69-3d83-4ed6-ac1e-4d46becd4e9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:20:10.173682 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=100 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:20:10.209845 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6609e69-3d83-4ed6-ac1e-4d46becd4e9c service neutron] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:20:10.214776 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0025ac1-4165-4fc3-87a8-1bcf7842f6c4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c88bc0f32600416ca7c6a59f4196e497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:20:10.215367 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0025ac1-4165-4fc3-87a8-1bcf7842f6c4 service swift] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:20:10.216169 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0025ac1-4165-4fc3-87a8-1bcf7842f6c4 service swift] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:20:10.216436 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0025ac1-4165-4fc3-87a8-1bcf7842f6c4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:20:10.224358 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0025ac1-4165-4fc3-87a8-1bcf7842f6c4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:20:10.225950 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0025ac1-4165-4fc3-87a8-1bcf7842f6c4 service swift] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:20:10.234752 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1355/2709] 10.222.0.49 () {60 vars in 1384 bytes} [Thu Sep 29 02:20:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 29 02:20:20.119747 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=50 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:20:20.230718 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=19 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:20:29.783947 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc8f033-723f-47ec-912a-1c47508ebd1f None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:20:29.784395 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc8f033-723f-47ec-912a-1c47508ebd1f None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:20:29.784491 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc8f033-723f-47ec-912a-1c47508ebd1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:20:29.804865 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-fbc8f033-723f-47ec-912a-1c47508ebd1f None None] MFA Rules not processed for user `0f8f13f302de4701a7f4e0562bca08cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:20:29.806094 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-fbc8f033-723f-47ec-912a-1c47508ebd1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:20:29.813750 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1355/2710] 10.222.0.49 () {58 vars in 967 bytes} [Thu Sep 29 02:20:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:20:29.826169 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0025ac1-4165-4fc3-87a8-1bcf7842f6c4 service swift] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:20:29.836628 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0025ac1-4165-4fc3-87a8-1bcf7842f6c4 service swift] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:20:29.842348 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35719ff-56d9-4854-af27-e5bfa0750a41 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c88bc0f32600416ca7c6a59f4196e497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:20:29.842932 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35719ff-56d9-4854-af27-e5bfa0750a41 service swift] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:20:29.843204 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35719ff-56d9-4854-af27-e5bfa0750a41 service swift] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:20:29.843468 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35719ff-56d9-4854-af27-e5bfa0750a41 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:20:29.851756 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35719ff-56d9-4854-af27-e5bfa0750a41 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:20:29.853354 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35719ff-56d9-4854-af27-e5bfa0750a41 service swift] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:20:29.862264 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1356/2711] 10.222.0.49 () {60 vars in 1384 bytes} [Thu Sep 29 02:20:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 29 02:20:39.799892 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=3 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:20:39.858881 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=6 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:21:03.231898 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc8f033-723f-47ec-912a-1c47508ebd1f None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:03.241985 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc8f033-723f-47ec-912a-1c47508ebd1f None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:03.245654 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4574974d-cd46-488b-ac9f-2b3ba75f9c7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:03.246247 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4574974d-cd46-488b-ac9f-2b3ba75f9c7f service neutron] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:03.246521 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4574974d-cd46-488b-ac9f-2b3ba75f9c7f service neutron] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:03.247057 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4574974d-cd46-488b-ac9f-2b3ba75f9c7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:03.248750 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-4574974d-cd46-488b-ac9f-2b3ba75f9c7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:21:03.312089 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4574974d-cd46-488b-ac9f-2b3ba75f9c7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:03.313564 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4574974d-cd46-488b-ac9f-2b3ba75f9c7f service neutron] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:03.324321 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1356/2712] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:21:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:21:06.451173 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35719ff-56d9-4854-af27-e5bfa0750a41 service swift] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:06.452593 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-e35719ff-56d9-4854-af27-e5bfa0750a41 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:21:06.467109 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35719ff-56d9-4854-af27-e5bfa0750a41 service swift] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:06.471620 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc15b4b-13c5-47c6-826d-77d636887034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:06.472296 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc15b4b-13c5-47c6-826d-77d636887034 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:06.472566 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc15b4b-13c5-47c6-826d-77d636887034 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:06.473009 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc15b4b-13c5-47c6-826d-77d636887034 admin admin] PATH_INFO: `/v3/users/f68a35fdeeea469f873ec50671fc35f0` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:06.474210 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc15b4b-13c5-47c6-826d-77d636887034 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f68a35fdeeea469f873ec50671fc35f0)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:06.476083 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc15b4b-13c5-47c6-826d-77d636887034 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:06.535405 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-2bc15b4b-13c5-47c6-826d-77d636887034 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f68a35fdeeea469f873ec50671fc35f0'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:06.536095 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-2bc15b4b-13c5-47c6-826d-77d636887034 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f68a35fdeeea469f873ec50671fc35f0'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:06.548745 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-2bc15b4b-13c5-47c6-826d-77d636887034 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f68a35fdeeea469f873ec50671fc35f0'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:06.557564 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-2bc15b4b-13c5-47c6-826d-77d636887034 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f68a35fdeeea469f873ec50671fc35f0'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:06.558124 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-2bc15b4b-13c5-47c6-826d-77d636887034 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f68a35fdeeea469f873ec50671fc35f0'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:06.573004 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1357/2713] 10.222.0.49 () {58 vars in 1224 bytes} [Thu Sep 29 02:21:06 2022] DELETE /identity/v3/users/f68a35fdeeea469f873ec50671fc35f0 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:21:06.750206 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4574974d-cd46-488b-ac9f-2b3ba75f9c7f service neutron] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:06.760837 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4574974d-cd46-488b-ac9f-2b3ba75f9c7f service neutron] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:06.824160 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0961ea2e-3183-4673-8a21-b7241e213c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:06.824710 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0961ea2e-3183-4673-8a21-b7241e213c60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:06.824988 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0961ea2e-3183-4673-8a21-b7241e213c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:06.825258 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0961ea2e-3183-4673-8a21-b7241e213c60 admin admin] PATH_INFO: `/v3/projects/1765f90d50914c75bf5c10c43bc688e9` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:06.826387 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0961ea2e-3183-4673-8a21-b7241e213c60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1765f90d50914c75bf5c10c43bc688e9)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:06.828266 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0961ea2e-3183-4673-8a21-b7241e213c60 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:06.874132 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-0961ea2e-3183-4673-8a21-b7241e213c60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1765f90d50914c75bf5c10c43bc688e9', 'request_id': 'req-0961ea2e-3183-4673-8a21-b7241e213c60'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:06.880363 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-0961ea2e-3183-4673-8a21-b7241e213c60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1765f90d50914c75bf5c10c43bc688e9', 'request_id': 'req-0961ea2e-3183-4673-8a21-b7241e213c60'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:06.886943 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-0961ea2e-3183-4673-8a21-b7241e213c60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1765f90d50914c75bf5c10c43bc688e9', 'request_id': 'req-0961ea2e-3183-4673-8a21-b7241e213c60'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:06.897740 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-0961ea2e-3183-4673-8a21-b7241e213c60 admin admin] The token cache is being invalidate because project 1765f90d50914c75bf5c10c43bc688e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81648) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:21:06.898030 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-0961ea2e-3183-4673-8a21-b7241e213c60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:06.898680 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-0961ea2e-3183-4673-8a21-b7241e213c60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:06.903277 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1357/2714] 10.222.0.49 () {58 vars in 1233 bytes} [Thu Sep 29 02:21:06 2022] DELETE /identity/v3/projects/1765f90d50914c75bf5c10c43bc688e9 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:21:06.905576 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70244805-82c0-43d5-9b39-1abe76ff9447 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:06.905865 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70244805-82c0-43d5-9b39-1abe76ff9447 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:06.906140 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70244805-82c0-43d5-9b39-1abe76ff9447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:06.926884 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-70244805-82c0-43d5-9b39-1abe76ff9447 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:21:06.928082 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-70244805-82c0-43d5-9b39-1abe76ff9447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:21:06.985989 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1358/2715] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:21:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:21:06.994117 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd475da-41c8-4645-8ec6-a72613177ab3 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:06.994410 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd475da-41c8-4645-8ec6-a72613177ab3 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:06.994690 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd475da-41c8-4645-8ec6-a72613177ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:07.014521 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-8bd475da-41c8-4645-8ec6-a72613177ab3 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:21:07.015733 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-8bd475da-41c8-4645-8ec6-a72613177ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:21:07.024199 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1358/2716] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:21:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:21:07.028220 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70244805-82c0-43d5-9b39-1abe76ff9447 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:07.038357 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70244805-82c0-43d5-9b39-1abe76ff9447 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:07.042866 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087ee0db-37c3-4174-a48d-a243620dc5d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:07.043449 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ee0db-37c3-4174-a48d-a243620dc5d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:07.043729 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ee0db-37c3-4174-a48d-a243620dc5d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:07.043996 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ee0db-37c3-4174-a48d-a243620dc5d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:07.044628 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087ee0db-37c3-4174-a48d-a243620dc5d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:21:07.044921 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087ee0db-37c3-4174-a48d-a243620dc5d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:07.046507 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087ee0db-37c3-4174-a48d-a243620dc5d8 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:07.057904 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1359/2717] 10.222.0.49 () {58 vars in 1153 bytes} [Thu Sep 29 02:21:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:21:07.062162 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd475da-41c8-4645-8ec6-a72613177ab3 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:07.071423 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd475da-41c8-4645-8ec6-a72613177ab3 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:07.076079 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b490c7-7c19-434d-9da9-422ccad1593d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:07.076647 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b490c7-7c19-434d-9da9-422ccad1593d admin admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:07.076925 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b490c7-7c19-434d-9da9-422ccad1593d admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:07.077199 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b490c7-7c19-434d-9da9-422ccad1593d admin admin] PATH_INFO: `/v3/projects` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:07.077855 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b490c7-7c19-434d-9da9-422ccad1593d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:07.079736 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b490c7-7c19-434d-9da9-422ccad1593d admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:07.095693 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:21:07.109281 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1359/2718] 10.222.0.49 () {60 vars in 1153 bytes} [Thu Sep 29 02:21:07 2022] POST /identity/v3/projects => generated 355 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:21:07.113625 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087ee0db-37c3-4174-a48d-a243620dc5d8 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:07.123921 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087ee0db-37c3-4174-a48d-a243620dc5d8 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:07.178957 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dfbd04-1ff8-4572-b37b-37522c6e9518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:07.179588 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dfbd04-1ff8-4572-b37b-37522c6e9518 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:07.179893 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dfbd04-1ff8-4572-b37b-37522c6e9518 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:07.180164 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dfbd04-1ff8-4572-b37b-37522c6e9518 admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:07.180792 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dfbd04-1ff8-4572-b37b-37522c6e9518 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:07.182740 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dfbd04-1ff8-4572-b37b-37522c6e9518 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:07.190622 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:21:07.204470 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1360/2719] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 02:21:07 2022] POST /identity/v3/users => generated 278 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:21:07.209184 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b490c7-7c19-434d-9da9-422ccad1593d admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:07.219419 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b490c7-7c19-434d-9da9-422ccad1593d admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:07.224269 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3497fa6c-6a35-4da3-bff7-b8fea68104ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:07.224867 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3497fa6c-6a35-4da3-bff7-b8fea68104ca admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:07.225141 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3497fa6c-6a35-4da3-bff7-b8fea68104ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:07.225459 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3497fa6c-6a35-4da3-bff7-b8fea68104ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:07.226095 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3497fa6c-6a35-4da3-bff7-b8fea68104ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:07.227722 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3497fa6c-6a35-4da3-bff7-b8fea68104ca admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:07.237462 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1360/2720] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:21:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:21:07.241989 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dfbd04-1ff8-4572-b37b-37522c6e9518 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:07.251867 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dfbd04-1ff8-4572-b37b-37522c6e9518 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:07.257026 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e989139-42b4-4a4c-8c3e-bcc1d672ac78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:07.257639 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e989139-42b4-4a4c-8c3e-bcc1d672ac78 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:07.257916 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e989139-42b4-4a4c-8c3e-bcc1d672ac78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:07.258184 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e989139-42b4-4a4c-8c3e-bcc1d672ac78 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:07.258807 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e989139-42b4-4a4c-8c3e-bcc1d672ac78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:07.260362 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e989139-42b4-4a4c-8c3e-bcc1d672ac78 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:07.270895 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1361/2721] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:21:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:21:07.274963 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3497fa6c-6a35-4da3-bff7-b8fea68104ca admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:07.285574 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3497fa6c-6a35-4da3-bff7-b8fea68104ca admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:07.290247 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a622408a-037e-47d8-b2fc-f486f7e0067e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:07.290897 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a622408a-037e-47d8-b2fc-f486f7e0067e admin admin] REQUEST_METHOD: `PUT` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:07.291179 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a622408a-037e-47d8-b2fc-f486f7e0067e admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:07.291453 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a622408a-037e-47d8-b2fc-f486f7e0067e admin admin] PATH_INFO: `/v3/projects/6b1f5e9cda7640b4b86b9383c103ae13/users/be78fa75b4a248f39c76a21c5af6cdb4/roles/f157f905c9c94ccfbfb46e52d443e8f2` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:07.306493 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a622408a-037e-47d8-b2fc-f486f7e0067e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b1f5e9cda7640b4b86b9383c103ae13, user_id=be78fa75b4a248f39c76a21c5af6cdb4, role_id=f157f905c9c94ccfbfb46e52d443e8f2)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:07.309118 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a622408a-037e-47d8-b2fc-f486f7e0067e admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:07.321796 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1361/2722] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:21:07 2022] PUT /identity/v3/projects/6b1f5e9cda7640b4b86b9383c103ae13/users/be78fa75b4a248f39c76a21c5af6cdb4/roles/f157f905c9c94ccfbfb46e52d443e8f2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:21:07.332597 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bc6993-423c-4b1f-9d64-7c745f9b40db None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:07.332826 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bc6993-423c-4b1f-9d64-7c745f9b40db None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:07.333101 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bc6993-423c-4b1f-9d64-7c745f9b40db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:07.361102 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-a8bc6993-423c-4b1f-9d64-7c745f9b40db None None] MFA Rules not processed for user `be78fa75b4a248f39c76a21c5af6cdb4`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:21:07.362348 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-a8bc6993-423c-4b1f-9d64-7c745f9b40db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:21:07.426766 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1362/2723] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:21:07 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:21:07.431306 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a622408a-037e-47d8-b2fc-f486f7e0067e admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:07.492417 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a622408a-037e-47d8-b2fc-f486f7e0067e admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:07.497298 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c6b172-d5b5-43f6-840d-3c2edec81299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:07.498030 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c6b172-d5b5-43f6-840d-3c2edec81299 admin admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:07.498314 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c6b172-d5b5-43f6-840d-3c2edec81299 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:07.498593 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c6b172-d5b5-43f6-840d-3c2edec81299 admin admin] PATH_INFO: `/v3/projects` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:07.499213 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c6b172-d5b5-43f6-840d-3c2edec81299 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:07.501101 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c6b172-d5b5-43f6-840d-3c2edec81299 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:07.527135 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1362/2724] 10.222.0.49 () {60 vars in 1153 bytes} [Thu Sep 29 02:21:07 2022] POST /identity/v3/projects => generated 357 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:21:07.531180 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bc6993-423c-4b1f-9d64-7c745f9b40db None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:07.542214 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bc6993-423c-4b1f-9d64-7c745f9b40db None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:07.597509 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3fd278-1d91-4343-a995-20356107a6a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:07.598031 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3fd278-1d91-4343-a995-20356107a6a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:07.598305 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3fd278-1d91-4343-a995-20356107a6a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:07.598573 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3fd278-1d91-4343-a995-20356107a6a5 admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:07.599196 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3fd278-1d91-4343-a995-20356107a6a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:07.601078 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3fd278-1d91-4343-a995-20356107a6a5 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:07.624429 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1363/2725] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 02:21:07 2022] POST /identity/v3/users => generated 285 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 29 02:21:07.625599 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c6b172-d5b5-43f6-840d-3c2edec81299 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:07.636067 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c6b172-d5b5-43f6-840d-3c2edec81299 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:07.640515 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbd4838-9a4e-4dde-a951-8dc79ad21d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:07.641100 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbd4838-9a4e-4dde-a951-8dc79ad21d73 admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:07.641401 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbd4838-9a4e-4dde-a951-8dc79ad21d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:07.641673 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbd4838-9a4e-4dde-a951-8dc79ad21d73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:07.642300 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbd4838-9a4e-4dde-a951-8dc79ad21d73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:07.644536 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbd4838-9a4e-4dde-a951-8dc79ad21d73 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:07.654858 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1363/2726] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:21:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 29 02:21:07.658819 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3fd278-1d91-4343-a995-20356107a6a5 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:07.668694 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3fd278-1d91-4343-a995-20356107a6a5 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:07.673165 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8acefd-e455-420d-b16e-3040d64697f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:07.673830 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8acefd-e455-420d-b16e-3040d64697f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:07.674103 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8acefd-e455-420d-b16e-3040d64697f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:07.674372 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8acefd-e455-420d-b16e-3040d64697f8 admin admin] PATH_INFO: `/v3/projects/863121e3b79b4575bdad1e8dcb656d6f/users/1f84c0be82dc42768ab996c768409dc2/roles/fe9bbc67742f4f5893f39b18eb31d59a` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:07.689389 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8acefd-e455-420d-b16e-3040d64697f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=863121e3b79b4575bdad1e8dcb656d6f, user_id=1f84c0be82dc42768ab996c768409dc2, role_id=fe9bbc67742f4f5893f39b18eb31d59a)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:07.692685 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8acefd-e455-420d-b16e-3040d64697f8 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:07.704545 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1364/2727] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:21:07 2022] PUT /identity/v3/projects/863121e3b79b4575bdad1e8dcb656d6f/users/1f84c0be82dc42768ab996c768409dc2/roles/fe9bbc67742f4f5893f39b18eb31d59a => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:21:07.708552 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbd4838-9a4e-4dde-a951-8dc79ad21d73 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:07.718345 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbd4838-9a4e-4dde-a951-8dc79ad21d73 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:07.774175 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a5a631-1bb8-4f24-bf5e-c63ee866a590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:07.774832 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a5a631-1bb8-4f24-bf5e-c63ee866a590 admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:07.775048 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a5a631-1bb8-4f24-bf5e-c63ee866a590 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:07.775319 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a5a631-1bb8-4f24-bf5e-c63ee866a590 admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:07.775982 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a5a631-1bb8-4f24-bf5e-c63ee866a590 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:07.777614 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a5a631-1bb8-4f24-bf5e-c63ee866a590 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:07.787811 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1364/2728] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:21:07 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:21:07.792056 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8acefd-e455-420d-b16e-3040d64697f8 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:07.803119 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8acefd-e455-420d-b16e-3040d64697f8 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:07.807757 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1a7085-e3de-4106-afec-81179ddcb253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:07.808419 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1a7085-e3de-4106-afec-81179ddcb253 admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:07.808694 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1a7085-e3de-4106-afec-81179ddcb253 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:07.808987 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1a7085-e3de-4106-afec-81179ddcb253 admin admin] PATH_INFO: `/v3/projects/863121e3b79b4575bdad1e8dcb656d6f/users/1f84c0be82dc42768ab996c768409dc2/roles/fe9bbc67742f4f5893f39b18eb31d59a` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:07.810876 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1a7085-e3de-4106-afec-81179ddcb253 admin admin] RBAC: Authorizing `identity:create_grant(project_id=863121e3b79b4575bdad1e8dcb656d6f, user_id=1f84c0be82dc42768ab996c768409dc2, role_id=fe9bbc67742f4f5893f39b18eb31d59a)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:07.813504 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1a7085-e3de-4106-afec-81179ddcb253 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:07.824138 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1365/2729] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:21:07 2022] PUT /identity/v3/projects/863121e3b79b4575bdad1e8dcb656d6f/users/1f84c0be82dc42768ab996c768409dc2/roles/fe9bbc67742f4f5893f39b18eb31d59a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:21:07.835634 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75d598f-17be-4fd7-92c1-9328524d6487 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:07.835925 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75d598f-17be-4fd7-92c1-9328524d6487 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:07.836200 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75d598f-17be-4fd7-92c1-9328524d6487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:07.865719 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-b75d598f-17be-4fd7-92c1-9328524d6487 None None] MFA Rules not processed for user `1f84c0be82dc42768ab996c768409dc2`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:21:07.866869 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-b75d598f-17be-4fd7-92c1-9328524d6487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:21:07.885881 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:21:07.937836 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1365/2730] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:21:07 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:21:07.949657 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1a7085-e3de-4106-afec-81179ddcb253 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:07.951345 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-ac1a7085-e3de-4106-afec-81179ddcb253 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:21:07.974233 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:21:08.031780 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1a7085-e3de-4106-afec-81179ddcb253 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:08.036327 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0545b743-9cad-4540-88f0-55e2dab4afc0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75135b856134ba4b9ccac337886f682', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:08.036987 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0545b743-9cad-4540-88f0-55e2dab4afc0 service cinder] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:08.037265 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0545b743-9cad-4540-88f0-55e2dab4afc0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:08.037569 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0545b743-9cad-4540-88f0-55e2dab4afc0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:08.046945 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0545b743-9cad-4540-88f0-55e2dab4afc0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:08.048374 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0545b743-9cad-4540-88f0-55e2dab4afc0 service cinder] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:08.058762 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1366/2731] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:21:07 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:21:08.135449 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75d598f-17be-4fd7-92c1-9328524d6487 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:08.144988 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75d598f-17be-4fd7-92c1-9328524d6487 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:08.148538 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a5b9d6-2230-481c-b1f5-6ff80cf39c2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75135b856134ba4b9ccac337886f682', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:08.149130 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a5b9d6-2230-481c-b1f5-6ff80cf39c2e service cinder] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:08.149542 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a5b9d6-2230-481c-b1f5-6ff80cf39c2e service cinder] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:08.149726 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a5b9d6-2230-481c-b1f5-6ff80cf39c2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:08.204991 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a5b9d6-2230-481c-b1f5-6ff80cf39c2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:08.206486 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a5b9d6-2230-481c-b1f5-6ff80cf39c2e service cinder] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:08.215887 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1366/2732] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:21:08 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:21:18.054455 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=26 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:21:18.211817 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=48 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:21:23.062596 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0545b743-9cad-4540-88f0-55e2dab4afc0 service cinder] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:23.126808 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0545b743-9cad-4540-88f0-55e2dab4afc0 service cinder] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:23.131832 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f6e39e-a728-41c8-9977-0f24e8bba1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:23.132449 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f6e39e-a728-41c8-9977-0f24e8bba1a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:23.132774 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f6e39e-a728-41c8-9977-0f24e8bba1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:23.133139 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f6e39e-a728-41c8-9977-0f24e8bba1a0 admin admin] PATH_INFO: `/v3/users/be78fa75b4a248f39c76a21c5af6cdb4` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:23.134868 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f6e39e-a728-41c8-9977-0f24e8bba1a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be78fa75b4a248f39c76a21c5af6cdb4)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:23.137490 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f6e39e-a728-41c8-9977-0f24e8bba1a0 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:23.185281 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-77f6e39e-a728-41c8-9977-0f24e8bba1a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be78fa75b4a248f39c76a21c5af6cdb4'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:23.185959 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-77f6e39e-a728-41c8-9977-0f24e8bba1a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be78fa75b4a248f39c76a21c5af6cdb4'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:23.198532 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-77f6e39e-a728-41c8-9977-0f24e8bba1a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be78fa75b4a248f39c76a21c5af6cdb4'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:23.206042 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-77f6e39e-a728-41c8-9977-0f24e8bba1a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be78fa75b4a248f39c76a21c5af6cdb4'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:23.206729 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-77f6e39e-a728-41c8-9977-0f24e8bba1a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be78fa75b4a248f39c76a21c5af6cdb4'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:23.218846 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1367/2733] 10.222.0.49 () {58 vars in 1224 bytes} [Thu Sep 29 02:21:23 2022] DELETE /identity/v3/users/be78fa75b4a248f39c76a21c5af6cdb4 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:21:23.224184 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e2b5d8-54d1-4ab5-a975-1583111b0d37 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:23.224694 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e2b5d8-54d1-4ab5-a975-1583111b0d37 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:23.224694 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e2b5d8-54d1-4ab5-a975-1583111b0d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:23.245942 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-b4e2b5d8-54d1-4ab5-a975-1583111b0d37 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:21:23.247212 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-b4e2b5d8-54d1-4ab5-a975-1583111b0d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:21:23.305971 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1367/2734] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:21:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:21:23.317663 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f6e39e-a728-41c8-9977-0f24e8bba1a0 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:23.319126 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-77f6e39e-a728-41c8-9977-0f24e8bba1a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:21:23.378119 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f6e39e-a728-41c8-9977-0f24e8bba1a0 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:23.381772 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6af68f6-b226-429c-8530-8593c0861673 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:23.382374 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af68f6-b226-429c-8530-8593c0861673 service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:23.382652 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af68f6-b226-429c-8530-8593c0861673 service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:23.382920 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af68f6-b226-429c-8530-8593c0861673 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:23.392271 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6af68f6-b226-429c-8530-8593c0861673 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:23.394275 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6af68f6-b226-429c-8530-8593c0861673 service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:23.403669 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1368/2735] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:21:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:21:23.674517 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e2b5d8-54d1-4ab5-a975-1583111b0d37 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:23.676785 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-b4e2b5d8-54d1-4ab5-a975-1583111b0d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:21:23.695423 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e2b5d8-54d1-4ab5-a975-1583111b0d37 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:23.701218 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa33ad39-5e5b-43e0-8877-d6103599712f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:23.702165 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33ad39-5e5b-43e0-8877-d6103599712f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:23.702628 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33ad39-5e5b-43e0-8877-d6103599712f admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:23.702994 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33ad39-5e5b-43e0-8877-d6103599712f admin admin] PATH_INFO: `/v3/projects/6b1f5e9cda7640b4b86b9383c103ae13` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:23.704246 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa33ad39-5e5b-43e0-8877-d6103599712f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b1f5e9cda7640b4b86b9383c103ae13)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:23.706247 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa33ad39-5e5b-43e0-8877-d6103599712f admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:23.754856 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-fa33ad39-5e5b-43e0-8877-d6103599712f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b1f5e9cda7640b4b86b9383c103ae13', 'request_id': 'req-fa33ad39-5e5b-43e0-8877-d6103599712f'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:23.760880 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-fa33ad39-5e5b-43e0-8877-d6103599712f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b1f5e9cda7640b4b86b9383c103ae13', 'request_id': 'req-fa33ad39-5e5b-43e0-8877-d6103599712f'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:23.769498 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-fa33ad39-5e5b-43e0-8877-d6103599712f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b1f5e9cda7640b4b86b9383c103ae13', 'request_id': 'req-fa33ad39-5e5b-43e0-8877-d6103599712f'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:23.779611 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-fa33ad39-5e5b-43e0-8877-d6103599712f admin admin] The token cache is being invalidate because project 6b1f5e9cda7640b4b86b9383c103ae13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81648) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:21:23.779897 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-fa33ad39-5e5b-43e0-8877-d6103599712f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:23.780504 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-fa33ad39-5e5b-43e0-8877-d6103599712f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:23.781999 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1368/2736] 10.222.0.49 () {58 vars in 1233 bytes} [Thu Sep 29 02:21:23 2022] DELETE /identity/v3/projects/6b1f5e9cda7640b4b86b9383c103ae13 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:21:23.786571 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6af68f6-b226-429c-8530-8593c0861673 service neutron] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:23.796185 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6af68f6-b226-429c-8530-8593c0861673 service neutron] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:23.814845 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:21:23.857627 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3abac13-f1b6-4e3d-888a-0aadfa6631a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:23.858112 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3abac13-f1b6-4e3d-888a-0aadfa6631a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:23.858337 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3abac13-f1b6-4e3d-888a-0aadfa6631a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:23.858611 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3abac13-f1b6-4e3d-888a-0aadfa6631a5 admin admin] PATH_INFO: `/v3/users/1f84c0be82dc42768ab996c768409dc2` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:23.859897 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3abac13-f1b6-4e3d-888a-0aadfa6631a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f84c0be82dc42768ab996c768409dc2)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:23.861762 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3abac13-f1b6-4e3d-888a-0aadfa6631a5 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:23.909833 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-d3abac13-f1b6-4e3d-888a-0aadfa6631a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f84c0be82dc42768ab996c768409dc2'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:23.910505 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-d3abac13-f1b6-4e3d-888a-0aadfa6631a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f84c0be82dc42768ab996c768409dc2'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:23.922152 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-d3abac13-f1b6-4e3d-888a-0aadfa6631a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f84c0be82dc42768ab996c768409dc2'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:23.930427 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-d3abac13-f1b6-4e3d-888a-0aadfa6631a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f84c0be82dc42768ab996c768409dc2'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:23.931079 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-d3abac13-f1b6-4e3d-888a-0aadfa6631a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f84c0be82dc42768ab996c768409dc2'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:23.943737 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1369/2737] 10.222.0.49 () {58 vars in 1224 bytes} [Thu Sep 29 02:21:23 2022] DELETE /identity/v3/users/1f84c0be82dc42768ab996c768409dc2 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:21:24.221622 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa33ad39-5e5b-43e0-8877-d6103599712f admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:24.223217 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-fa33ad39-5e5b-43e0-8877-d6103599712f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:21:24.236362 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa33ad39-5e5b-43e0-8877-d6103599712f admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:24.299017 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dc6b7f-ce1a-4054-b1f7-ebc3f1bfe503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:24.300220 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dc6b7f-ce1a-4054-b1f7-ebc3f1bfe503 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:24.300598 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dc6b7f-ce1a-4054-b1f7-ebc3f1bfe503 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:24.301607 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dc6b7f-ce1a-4054-b1f7-ebc3f1bfe503 admin admin] PATH_INFO: `/v3/projects/863121e3b79b4575bdad1e8dcb656d6f` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:24.303226 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dc6b7f-ce1a-4054-b1f7-ebc3f1bfe503 admin admin] RBAC: Authorizing `identity:delete_project(project_id=863121e3b79b4575bdad1e8dcb656d6f)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:24.305120 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dc6b7f-ce1a-4054-b1f7-ebc3f1bfe503 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:24.335670 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:21:24.353720 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-f7dc6b7f-ce1a-4054-b1f7-ebc3f1bfe503 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '863121e3b79b4575bdad1e8dcb656d6f', 'request_id': 'req-f7dc6b7f-ce1a-4054-b1f7-ebc3f1bfe503'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:24.359800 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-f7dc6b7f-ce1a-4054-b1f7-ebc3f1bfe503 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '863121e3b79b4575bdad1e8dcb656d6f', 'request_id': 'req-f7dc6b7f-ce1a-4054-b1f7-ebc3f1bfe503'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:24.367977 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-f7dc6b7f-ce1a-4054-b1f7-ebc3f1bfe503 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '863121e3b79b4575bdad1e8dcb656d6f', 'request_id': 'req-f7dc6b7f-ce1a-4054-b1f7-ebc3f1bfe503'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:24.379896 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-f7dc6b7f-ce1a-4054-b1f7-ebc3f1bfe503 admin admin] The token cache is being invalidate because project 863121e3b79b4575bdad1e8dcb656d6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81648) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:21:24.380186 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-f7dc6b7f-ce1a-4054-b1f7-ebc3f1bfe503 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:24.380821 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-f7dc6b7f-ce1a-4054-b1f7-ebc3f1bfe503 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:24.382662 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1369/2738] 10.222.0.49 () {58 vars in 1233 bytes} [Thu Sep 29 02:21:24 2022] DELETE /identity/v3/projects/863121e3b79b4575bdad1e8dcb656d6f => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:21:24.387548 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b58fe6-48c8-4aed-bbb7-298c485f9797 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:24.388027 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b58fe6-48c8-4aed-bbb7-298c485f9797 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:24.388134 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b58fe6-48c8-4aed-bbb7-298c485f9797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:24.407275 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-e2b58fe6-48c8-4aed-bbb7-298c485f9797 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:21:24.408403 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-e2b58fe6-48c8-4aed-bbb7-298c485f9797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:21:24.469805 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1370/2739] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:21:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:21:24.478334 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33889511-fefd-4610-9974-5dc6e6c78b11 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:24.478619 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33889511-fefd-4610-9974-5dc6e6c78b11 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:24.478892 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33889511-fefd-4610-9974-5dc6e6c78b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:24.499389 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-33889511-fefd-4610-9974-5dc6e6c78b11 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:21:24.500598 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-33889511-fefd-4610-9974-5dc6e6c78b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:21:24.508899 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1370/2740] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:21:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:21:24.513006 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b58fe6-48c8-4aed-bbb7-298c485f9797 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:24.522751 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b58fe6-48c8-4aed-bbb7-298c485f9797 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:24.527290 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4717fbc5-cff4-4bad-ba6c-14b7d02f2d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:24.527880 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4717fbc5-cff4-4bad-ba6c-14b7d02f2d06 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:24.528153 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4717fbc5-cff4-4bad-ba6c-14b7d02f2d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:24.528420 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4717fbc5-cff4-4bad-ba6c-14b7d02f2d06 admin admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:24.529058 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4717fbc5-cff4-4bad-ba6c-14b7d02f2d06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:21:24.529388 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4717fbc5-cff4-4bad-ba6c-14b7d02f2d06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:24.530970 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4717fbc5-cff4-4bad-ba6c-14b7d02f2d06 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:24.542957 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1371/2741] 10.222.0.49 () {58 vars in 1153 bytes} [Thu Sep 29 02:21:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:21:24.547302 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33889511-fefd-4610-9974-5dc6e6c78b11 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:24.558179 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33889511-fefd-4610-9974-5dc6e6c78b11 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:24.562815 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b8ff6d-9ea3-4601-a592-367a38c4c0e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:24.563401 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b8ff6d-9ea3-4601-a592-367a38c4c0e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:24.563678 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b8ff6d-9ea3-4601-a592-367a38c4c0e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:24.563947 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b8ff6d-9ea3-4601-a592-367a38c4c0e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:24.564580 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b8ff6d-9ea3-4601-a592-367a38c4c0e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:24.567011 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b8ff6d-9ea3-4601-a592-367a38c4c0e0 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:24.595793 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1371/2742] 10.222.0.49 () {60 vars in 1153 bytes} [Thu Sep 29 02:21:24 2022] POST /identity/v3/projects => generated 387 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:21:24.600177 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4717fbc5-cff4-4bad-ba6c-14b7d02f2d06 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:24.610040 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4717fbc5-cff4-4bad-ba6c-14b7d02f2d06 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:24.636284 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:21:24.669466 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fb7b13-1b68-4aa5-86e1-c499fc2ff2ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:24.670012 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fb7b13-1b68-4aa5-86e1-c499fc2ff2ae admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:24.670289 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fb7b13-1b68-4aa5-86e1-c499fc2ff2ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:24.670580 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fb7b13-1b68-4aa5-86e1-c499fc2ff2ae admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:24.671195 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fb7b13-1b68-4aa5-86e1-c499fc2ff2ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:24.673111 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fb7b13-1b68-4aa5-86e1-c499fc2ff2ae admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:24.696234 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1372/2743] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 02:21:24 2022] POST /identity/v3/users => generated 294 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:21:24.700590 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b8ff6d-9ea3-4601-a592-367a38c4c0e0 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:24.711010 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b8ff6d-9ea3-4601-a592-367a38c4c0e0 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:24.715603 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47bf4c8-8419-44b5-bf3b-7fcdd214048c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:24.716196 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47bf4c8-8419-44b5-bf3b-7fcdd214048c admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:24.716475 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47bf4c8-8419-44b5-bf3b-7fcdd214048c admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:24.716745 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47bf4c8-8419-44b5-bf3b-7fcdd214048c admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:24.717415 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47bf4c8-8419-44b5-bf3b-7fcdd214048c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:24.719007 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47bf4c8-8419-44b5-bf3b-7fcdd214048c admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:24.729735 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1372/2744] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:21:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 29 02:21:24.733638 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fb7b13-1b68-4aa5-86e1-c499fc2ff2ae admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:24.744337 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fb7b13-1b68-4aa5-86e1-c499fc2ff2ae admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:24.749181 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7afe3e5-8760-4d2e-8575-89bfea22adba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:24.749788 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7afe3e5-8760-4d2e-8575-89bfea22adba admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:24.750062 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7afe3e5-8760-4d2e-8575-89bfea22adba admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:24.750331 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7afe3e5-8760-4d2e-8575-89bfea22adba admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:24.750962 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7afe3e5-8760-4d2e-8575-89bfea22adba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:24.752523 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7afe3e5-8760-4d2e-8575-89bfea22adba admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:24.763837 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1373/2745] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:21:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:21:24.768005 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47bf4c8-8419-44b5-bf3b-7fcdd214048c admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:24.779442 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47bf4c8-8419-44b5-bf3b-7fcdd214048c admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:24.784963 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b90a2c-5da9-4fb9-8a87-85e61eca5c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:24.785642 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b90a2c-5da9-4fb9-8a87-85e61eca5c96 admin admin] REQUEST_METHOD: `PUT` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:24.785919 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b90a2c-5da9-4fb9-8a87-85e61eca5c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:24.786189 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b90a2c-5da9-4fb9-8a87-85e61eca5c96 admin admin] PATH_INFO: `/v3/projects/bd23c5dce1ca44fc8a208b4b0ade5491/users/aea7c4d93c724ce5b3d82a53bc990ec9/roles/f157f905c9c94ccfbfb46e52d443e8f2` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:24.802776 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b90a2c-5da9-4fb9-8a87-85e61eca5c96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd23c5dce1ca44fc8a208b4b0ade5491, user_id=aea7c4d93c724ce5b3d82a53bc990ec9, role_id=f157f905c9c94ccfbfb46e52d443e8f2)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:24.805421 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b90a2c-5da9-4fb9-8a87-85e61eca5c96 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:24.818502 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1373/2746] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:21:24 2022] PUT /identity/v3/projects/bd23c5dce1ca44fc8a208b4b0ade5491/users/aea7c4d93c724ce5b3d82a53bc990ec9/roles/f157f905c9c94ccfbfb46e52d443e8f2 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:21:24.830023 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458820c5-b99f-4850-a213-5b0438665d2e None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:24.830307 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458820c5-b99f-4850-a213-5b0438665d2e None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:24.830576 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458820c5-b99f-4850-a213-5b0438665d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:24.858501 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-458820c5-b99f-4850-a213-5b0438665d2e None None] MFA Rules not processed for user `aea7c4d93c724ce5b3d82a53bc990ec9`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:21:24.859730 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-458820c5-b99f-4850-a213-5b0438665d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:21:24.932598 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1374/2747] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:21:24 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:21:24.937028 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b90a2c-5da9-4fb9-8a87-85e61eca5c96 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:25.002538 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b90a2c-5da9-4fb9-8a87-85e61eca5c96 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:25.007959 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3433df-6b83-4893-9b92-71f26e22bab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:25.008565 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3433df-6b83-4893-9b92-71f26e22bab3 admin admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:25.008839 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3433df-6b83-4893-9b92-71f26e22bab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:25.009103 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3433df-6b83-4893-9b92-71f26e22bab3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:25.009819 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3433df-6b83-4893-9b92-71f26e22bab3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:25.011702 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3433df-6b83-4893-9b92-71f26e22bab3 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:25.039274 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1374/2748] 10.222.0.49 () {60 vars in 1153 bytes} [Thu Sep 29 02:21:24 2022] POST /identity/v3/projects => generated 385 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:21:25.043511 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458820c5-b99f-4850-a213-5b0438665d2e None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:25.054883 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458820c5-b99f-4850-a213-5b0438665d2e None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:25.109573 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e09ca6b-d45e-44b8-804c-87b9eab51bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:25.110174 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e09ca6b-d45e-44b8-804c-87b9eab51bb8 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:25.110449 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e09ca6b-d45e-44b8-804c-87b9eab51bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:25.110727 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e09ca6b-d45e-44b8-804c-87b9eab51bb8 admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:25.111336 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e09ca6b-d45e-44b8-804c-87b9eab51bb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:25.113893 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e09ca6b-d45e-44b8-804c-87b9eab51bb8 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:25.135395 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1375/2749] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 02:21:25 2022] POST /identity/v3/users => generated 299 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 29 02:21:25.140316 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3433df-6b83-4893-9b92-71f26e22bab3 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:25.150886 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3433df-6b83-4893-9b92-71f26e22bab3 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:25.159395 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a2ece7-efe6-49c1-a2e3-b06cf3914a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:25.160000 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a2ece7-efe6-49c1-a2e3-b06cf3914a17 admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:25.160423 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a2ece7-efe6-49c1-a2e3-b06cf3914a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:25.160811 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a2ece7-efe6-49c1-a2e3-b06cf3914a17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:25.161665 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a2ece7-efe6-49c1-a2e3-b06cf3914a17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:25.163336 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a2ece7-efe6-49c1-a2e3-b06cf3914a17 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:25.176470 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1375/2750] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:21:25 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:21:25.180597 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e09ca6b-d45e-44b8-804c-87b9eab51bb8 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:25.190541 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e09ca6b-d45e-44b8-804c-87b9eab51bb8 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:25.195748 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4c4086-eea4-4071-8344-b465107192d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:25.196383 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4c4086-eea4-4071-8344-b465107192d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:25.196659 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4c4086-eea4-4071-8344-b465107192d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:25.196957 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4c4086-eea4-4071-8344-b465107192d4 admin admin] PATH_INFO: `/v3/projects/ee24b699b96d47d89c0cabf40cc2740c/users/102e248b6f2649c7aef0b2215fd4663b/roles/fe9bbc67742f4f5893f39b18eb31d59a` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:25.212321 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4c4086-eea4-4071-8344-b465107192d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee24b699b96d47d89c0cabf40cc2740c, user_id=102e248b6f2649c7aef0b2215fd4663b, role_id=fe9bbc67742f4f5893f39b18eb31d59a)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:25.214945 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4c4086-eea4-4071-8344-b465107192d4 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:25.228473 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1376/2751] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:21:25 2022] PUT /identity/v3/projects/ee24b699b96d47d89c0cabf40cc2740c/users/102e248b6f2649c7aef0b2215fd4663b/roles/fe9bbc67742f4f5893f39b18eb31d59a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:21:25.232465 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a2ece7-efe6-49c1-a2e3-b06cf3914a17 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:25.242850 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a2ece7-efe6-49c1-a2e3-b06cf3914a17 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:25.263087 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:21:25.301455 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0bafa8-b487-42cc-ae07-60f58186a539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:25.302054 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0bafa8-b487-42cc-ae07-60f58186a539 admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:25.302330 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0bafa8-b487-42cc-ae07-60f58186a539 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:25.302600 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0bafa8-b487-42cc-ae07-60f58186a539 admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:25.303233 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0bafa8-b487-42cc-ae07-60f58186a539 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:25.304794 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0bafa8-b487-42cc-ae07-60f58186a539 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:25.314173 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1376/2752] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:21:25 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:21:25.318867 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4c4086-eea4-4071-8344-b465107192d4 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:25.324251 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:21:25.330675 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4c4086-eea4-4071-8344-b465107192d4 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:25.336155 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a60cf31-5bf5-43e2-bc81-3b5dd77fcd44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:25.336794 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a60cf31-5bf5-43e2-bc81-3b5dd77fcd44 admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:25.337067 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a60cf31-5bf5-43e2-bc81-3b5dd77fcd44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:25.337360 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a60cf31-5bf5-43e2-bc81-3b5dd77fcd44 admin admin] PATH_INFO: `/v3/projects/ee24b699b96d47d89c0cabf40cc2740c/users/102e248b6f2649c7aef0b2215fd4663b/roles/fe9bbc67742f4f5893f39b18eb31d59a` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:25.339229 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a60cf31-5bf5-43e2-bc81-3b5dd77fcd44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee24b699b96d47d89c0cabf40cc2740c, user_id=102e248b6f2649c7aef0b2215fd4663b, role_id=fe9bbc67742f4f5893f39b18eb31d59a)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:25.341852 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a60cf31-5bf5-43e2-bc81-3b5dd77fcd44 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:25.352806 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1377/2753] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:21:25 2022] PUT /identity/v3/projects/ee24b699b96d47d89c0cabf40cc2740c/users/102e248b6f2649c7aef0b2215fd4663b/roles/fe9bbc67742f4f5893f39b18eb31d59a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:21:25.362999 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1f91ae-f7f5-48e3-bd03-1bd10b241908 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:25.363277 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1f91ae-f7f5-48e3-bd03-1bd10b241908 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:25.363555 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1f91ae-f7f5-48e3-bd03-1bd10b241908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:25.391217 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-ff1f91ae-f7f5-48e3-bd03-1bd10b241908 None None] MFA Rules not processed for user `102e248b6f2649c7aef0b2215fd4663b`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:21:25.392418 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-ff1f91ae-f7f5-48e3-bd03-1bd10b241908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:21:25.458907 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1377/2754] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:21:25 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:21:25.470238 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a60cf31-5bf5-43e2-bc81-3b5dd77fcd44 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:25.472063 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-4a60cf31-5bf5-43e2-bc81-3b5dd77fcd44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:21:25.528706 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a60cf31-5bf5-43e2-bc81-3b5dd77fcd44 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:25.532284 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92f79a9-1ffe-4db8-a202-10aa637a2c87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75135b856134ba4b9ccac337886f682', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:25.532870 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92f79a9-1ffe-4db8-a202-10aa637a2c87 service cinder] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:25.533142 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92f79a9-1ffe-4db8-a202-10aa637a2c87 service cinder] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:25.533434 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92f79a9-1ffe-4db8-a202-10aa637a2c87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:25.542292 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92f79a9-1ffe-4db8-a202-10aa637a2c87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:25.543694 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92f79a9-1ffe-4db8-a202-10aa637a2c87 service cinder] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:25.553014 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1378/2755] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:21:25 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:21:25.621709 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1f91ae-f7f5-48e3-bd03-1bd10b241908 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:25.687576 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1f91ae-f7f5-48e3-bd03-1bd10b241908 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:25.693189 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa783fb1-1b7e-430b-8c2d-f08c40e433d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:25.693838 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa783fb1-1b7e-430b-8c2d-f08c40e433d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:25.694111 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa783fb1-1b7e-430b-8c2d-f08c40e433d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:25.694377 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa783fb1-1b7e-430b-8c2d-f08c40e433d3 admin admin] PATH_INFO: `/v3/users/aea7c4d93c724ce5b3d82a53bc990ec9` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:25.695490 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa783fb1-1b7e-430b-8c2d-f08c40e433d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aea7c4d93c724ce5b3d82a53bc990ec9)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:25.697420 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa783fb1-1b7e-430b-8c2d-f08c40e433d3 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:25.744852 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-fa783fb1-1b7e-430b-8c2d-f08c40e433d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aea7c4d93c724ce5b3d82a53bc990ec9'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:25.746088 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-fa783fb1-1b7e-430b-8c2d-f08c40e433d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aea7c4d93c724ce5b3d82a53bc990ec9'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:25.747708 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:21:25.759541 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-fa783fb1-1b7e-430b-8c2d-f08c40e433d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aea7c4d93c724ce5b3d82a53bc990ec9'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:25.769135 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-fa783fb1-1b7e-430b-8c2d-f08c40e433d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aea7c4d93c724ce5b3d82a53bc990ec9'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:25.769792 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-fa783fb1-1b7e-430b-8c2d-f08c40e433d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aea7c4d93c724ce5b3d82a53bc990ec9'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:25.782222 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1378/2756] 10.222.0.49 () {58 vars in 1224 bytes} [Thu Sep 29 02:21:25 2022] DELETE /identity/v3/users/aea7c4d93c724ce5b3d82a53bc990ec9 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:21:25.787212 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edacd2b-a5c8-4c2d-ad77-6b97bb8c2495 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:25.787510 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edacd2b-a5c8-4c2d-ad77-6b97bb8c2495 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:25.787801 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edacd2b-a5c8-4c2d-ad77-6b97bb8c2495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:25.808178 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-2edacd2b-a5c8-4c2d-ad77-6b97bb8c2495 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:21:25.809399 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-2edacd2b-a5c8-4c2d-ad77-6b97bb8c2495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:21:25.870745 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1379/2757] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:21:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:21:25.881060 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa783fb1-1b7e-430b-8c2d-f08c40e433d3 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:25.882583 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-fa783fb1-1b7e-430b-8c2d-f08c40e433d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:21:25.941165 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa783fb1-1b7e-430b-8c2d-f08c40e433d3 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:25.944814 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67ce57c-7227-4a00-a9bb-0a732f0c4472 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:25.945437 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ce57c-7227-4a00-a9bb-0a732f0c4472 service neutron] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:25.945711 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ce57c-7227-4a00-a9bb-0a732f0c4472 service neutron] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:25.945980 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ce57c-7227-4a00-a9bb-0a732f0c4472 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:25.954844 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67ce57c-7227-4a00-a9bb-0a732f0c4472 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:25.956294 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67ce57c-7227-4a00-a9bb-0a732f0c4472 service neutron] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:25.966773 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1379/2758] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:21:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:21:26.244175 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edacd2b-a5c8-4c2d-ad77-6b97bb8c2495 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:26.245986 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-2edacd2b-a5c8-4c2d-ad77-6b97bb8c2495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:21:26.259118 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edacd2b-a5c8-4c2d-ad77-6b97bb8c2495 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:26.263705 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49742c5f-ce56-4c9b-aed0-892e733fe552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:26.264334 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49742c5f-ce56-4c9b-aed0-892e733fe552 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:26.264612 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49742c5f-ce56-4c9b-aed0-892e733fe552 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:26.264882 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49742c5f-ce56-4c9b-aed0-892e733fe552 admin admin] PATH_INFO: `/v3/projects/bd23c5dce1ca44fc8a208b4b0ade5491` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:26.266168 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49742c5f-ce56-4c9b-aed0-892e733fe552 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd23c5dce1ca44fc8a208b4b0ade5491)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:26.268070 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49742c5f-ce56-4c9b-aed0-892e733fe552 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:26.314503 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-49742c5f-ce56-4c9b-aed0-892e733fe552 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd23c5dce1ca44fc8a208b4b0ade5491', 'request_id': 'req-49742c5f-ce56-4c9b-aed0-892e733fe552'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:26.321399 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-49742c5f-ce56-4c9b-aed0-892e733fe552 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd23c5dce1ca44fc8a208b4b0ade5491', 'request_id': 'req-49742c5f-ce56-4c9b-aed0-892e733fe552'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:26.329411 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-49742c5f-ce56-4c9b-aed0-892e733fe552 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd23c5dce1ca44fc8a208b4b0ade5491', 'request_id': 'req-49742c5f-ce56-4c9b-aed0-892e733fe552'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:26.340272 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-49742c5f-ce56-4c9b-aed0-892e733fe552 admin admin] The token cache is being invalidate because project bd23c5dce1ca44fc8a208b4b0ade5491 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81649) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:21:26.340561 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-49742c5f-ce56-4c9b-aed0-892e733fe552 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:26.341190 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-49742c5f-ce56-4c9b-aed0-892e733fe552 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:26.342696 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1380/2759] 10.222.0.49 () {58 vars in 1233 bytes} [Thu Sep 29 02:21:26 2022] DELETE /identity/v3/projects/bd23c5dce1ca44fc8a208b4b0ade5491 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:21:26.346832 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67ce57c-7227-4a00-a9bb-0a732f0c4472 service neutron] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:26.356478 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67ce57c-7227-4a00-a9bb-0a732f0c4472 service neutron] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:26.413285 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c21ad0-b72c-4d25-bb46-cb624f030f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:26.413933 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c21ad0-b72c-4d25-bb46-cb624f030f40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:26.414208 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c21ad0-b72c-4d25-bb46-cb624f030f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:26.414475 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c21ad0-b72c-4d25-bb46-cb624f030f40 admin admin] PATH_INFO: `/v3/users/102e248b6f2649c7aef0b2215fd4663b` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:26.415575 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c21ad0-b72c-4d25-bb46-cb624f030f40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=102e248b6f2649c7aef0b2215fd4663b)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:26.417503 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c21ad0-b72c-4d25-bb46-cb624f030f40 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:26.462241 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-01c21ad0-b72c-4d25-bb46-cb624f030f40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '102e248b6f2649c7aef0b2215fd4663b'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:26.462875 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-01c21ad0-b72c-4d25-bb46-cb624f030f40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '102e248b6f2649c7aef0b2215fd4663b'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:26.474762 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-01c21ad0-b72c-4d25-bb46-cb624f030f40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '102e248b6f2649c7aef0b2215fd4663b'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:26.478258 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:21:26.482219 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-01c21ad0-b72c-4d25-bb46-cb624f030f40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '102e248b6f2649c7aef0b2215fd4663b'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:26.483108 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-01c21ad0-b72c-4d25-bb46-cb624f030f40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '102e248b6f2649c7aef0b2215fd4663b'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:26.497853 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1380/2760] 10.222.0.49 () {58 vars in 1224 bytes} [Thu Sep 29 02:21:26 2022] DELETE /identity/v3/users/102e248b6f2649c7aef0b2215fd4663b => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:21:26.779831 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49742c5f-ce56-4c9b-aed0-892e733fe552 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:26.781853 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-49742c5f-ce56-4c9b-aed0-892e733fe552 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:21:26.797612 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49742c5f-ce56-4c9b-aed0-892e733fe552 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:26.811473 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:21:26.864040 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9768e7-3ccf-4a00-b0a4-b1d48800232d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:26.864592 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9768e7-3ccf-4a00-b0a4-b1d48800232d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:26.864867 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9768e7-3ccf-4a00-b0a4-b1d48800232d admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:26.865140 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9768e7-3ccf-4a00-b0a4-b1d48800232d admin admin] PATH_INFO: `/v3/projects/ee24b699b96d47d89c0cabf40cc2740c` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:26.866678 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9768e7-3ccf-4a00-b0a4-b1d48800232d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee24b699b96d47d89c0cabf40cc2740c)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:26.868209 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9768e7-3ccf-4a00-b0a4-b1d48800232d admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:26.926408 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-5e9768e7-3ccf-4a00-b0a4-b1d48800232d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee24b699b96d47d89c0cabf40cc2740c', 'request_id': 'req-5e9768e7-3ccf-4a00-b0a4-b1d48800232d'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:26.933000 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-5e9768e7-3ccf-4a00-b0a4-b1d48800232d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee24b699b96d47d89c0cabf40cc2740c', 'request_id': 'req-5e9768e7-3ccf-4a00-b0a4-b1d48800232d'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:26.941016 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-5e9768e7-3ccf-4a00-b0a4-b1d48800232d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee24b699b96d47d89c0cabf40cc2740c', 'request_id': 'req-5e9768e7-3ccf-4a00-b0a4-b1d48800232d'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:26.951646 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-5e9768e7-3ccf-4a00-b0a4-b1d48800232d admin admin] The token cache is being invalidate because project ee24b699b96d47d89c0cabf40cc2740c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81649) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:21:26.951936 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-5e9768e7-3ccf-4a00-b0a4-b1d48800232d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:26.952585 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-5e9768e7-3ccf-4a00-b0a4-b1d48800232d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:26.954162 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1381/2761] 10.222.0.49 () {58 vars in 1233 bytes} [Thu Sep 29 02:21:26 2022] DELETE /identity/v3/projects/ee24b699b96d47d89c0cabf40cc2740c => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:21:26.959131 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7058e9-fe57-4cb0-a27c-1fa20c9cd4a7 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:26.959493 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7058e9-fe57-4cb0-a27c-1fa20c9cd4a7 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:26.959839 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7058e9-fe57-4cb0-a27c-1fa20c9cd4a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:26.980631 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-0e7058e9-fe57-4cb0-a27c-1fa20c9cd4a7 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:21:26.981917 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-0e7058e9-fe57-4cb0-a27c-1fa20c9cd4a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:21:27.043846 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1381/2762] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:21:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:21:27.051926 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe75cd-eaf3-4600-8ec6-8b5514155603 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:27.052213 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe75cd-eaf3-4600-8ec6-8b5514155603 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:27.052512 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe75cd-eaf3-4600-8ec6-8b5514155603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:27.072676 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-6efe75cd-eaf3-4600-8ec6-8b5514155603 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:21:27.073908 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-6efe75cd-eaf3-4600-8ec6-8b5514155603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:21:27.082436 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1382/2763] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:21:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:21:27.086784 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7058e9-fe57-4cb0-a27c-1fa20c9cd4a7 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:27.096335 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7058e9-fe57-4cb0-a27c-1fa20c9cd4a7 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:27.100985 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9b06a3-e42e-49b2-ac3a-ab4a29644e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:27.101603 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b06a3-e42e-49b2-ac3a-ab4a29644e00 admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:27.101879 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b06a3-e42e-49b2-ac3a-ab4a29644e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:27.102145 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b06a3-e42e-49b2-ac3a-ab4a29644e00 admin admin] PATH_INFO: `/v3/domains` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:27.102778 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9b06a3-e42e-49b2-ac3a-ab4a29644e00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:21:27.103075 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9b06a3-e42e-49b2-ac3a-ab4a29644e00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:27.104648 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9b06a3-e42e-49b2-ac3a-ab4a29644e00 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:27.116686 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1382/2764] 10.222.0.49 () {58 vars in 1153 bytes} [Thu Sep 29 02:21:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:21:27.121029 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efe75cd-eaf3-4600-8ec6-8b5514155603 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:27.130812 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efe75cd-eaf3-4600-8ec6-8b5514155603 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:27.135462 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708e65de-7597-4cd2-b8c5-d0708c230f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:27.136044 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708e65de-7597-4cd2-b8c5-d0708c230f6b admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:27.136320 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708e65de-7597-4cd2-b8c5-d0708c230f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:27.136583 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708e65de-7597-4cd2-b8c5-d0708c230f6b admin admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:27.137194 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708e65de-7597-4cd2-b8c5-d0708c230f6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:27.139123 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708e65de-7597-4cd2-b8c5-d0708c230f6b admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:27.166526 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1383/2765] 10.222.0.49 () {60 vars in 1153 bytes} [Thu Sep 29 02:21:27 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:21:27.170689 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9b06a3-e42e-49b2-ac3a-ab4a29644e00 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:27.180856 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9b06a3-e42e-49b2-ac3a-ab4a29644e00 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:27.237698 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0e70f0-0b27-4edd-a0dc-d8e88a54081f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:27.238292 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e70f0-0b27-4edd-a0dc-d8e88a54081f admin admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:27.238569 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e70f0-0b27-4edd-a0dc-d8e88a54081f admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:27.238836 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e70f0-0b27-4edd-a0dc-d8e88a54081f admin admin] PATH_INFO: `/v3/users` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:27.239451 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0e70f0-0b27-4edd-a0dc-d8e88a54081f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:27.241357 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0e70f0-0b27-4edd-a0dc-d8e88a54081f admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:27.260916 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1383/2766] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 02:21:27 2022] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 29 02:21:27.265055 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708e65de-7597-4cd2-b8c5-d0708c230f6b admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:27.275966 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708e65de-7597-4cd2-b8c5-d0708c230f6b admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:27.280652 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4848f83d-d83c-4409-bd15-898136bcbe0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:27.281239 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848f83d-d83c-4409-bd15-898136bcbe0a admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:27.281549 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848f83d-d83c-4409-bd15-898136bcbe0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:27.281822 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848f83d-d83c-4409-bd15-898136bcbe0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:27.282457 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4848f83d-d83c-4409-bd15-898136bcbe0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:27.284961 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4848f83d-d83c-4409-bd15-898136bcbe0a admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:27.294816 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1384/2767] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:21:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:21:27.298847 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0e70f0-0b27-4edd-a0dc-d8e88a54081f admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:27.308741 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0e70f0-0b27-4edd-a0dc-d8e88a54081f admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:27.313379 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c0c99c-f01f-4424-88b9-69169de4c0d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:27.313967 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0c99c-f01f-4424-88b9-69169de4c0d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:27.314247 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0c99c-f01f-4424-88b9-69169de4c0d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:27.314520 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0c99c-f01f-4424-88b9-69169de4c0d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:27.315198 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c0c99c-f01f-4424-88b9-69169de4c0d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:27.316945 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c0c99c-f01f-4424-88b9-69169de4c0d2 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:27.326814 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1384/2768] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:21:27 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:21:27.331436 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4848f83d-d83c-4409-bd15-898136bcbe0a admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:27.341523 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4848f83d-d83c-4409-bd15-898136bcbe0a admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:27.347351 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42733c1a-14e0-4af2-b113-648ed004054c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:27.347983 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42733c1a-14e0-4af2-b113-648ed004054c admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:27.348287 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42733c1a-14e0-4af2-b113-648ed004054c admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:27.348556 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42733c1a-14e0-4af2-b113-648ed004054c admin admin] PATH_INFO: `/v3/projects/a92f09b9cfe640f695f9511f9bcb7e8e/users/1254faef68054610aa2219d5b28e1262/roles/f157f905c9c94ccfbfb46e52d443e8f2` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:27.362937 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42733c1a-14e0-4af2-b113-648ed004054c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a92f09b9cfe640f695f9511f9bcb7e8e, user_id=1254faef68054610aa2219d5b28e1262, role_id=f157f905c9c94ccfbfb46e52d443e8f2)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:27.365577 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42733c1a-14e0-4af2-b113-648ed004054c admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:27.378521 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1385/2769] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:21:27 2022] PUT /identity/v3/projects/a92f09b9cfe640f695f9511f9bcb7e8e/users/1254faef68054610aa2219d5b28e1262/roles/f157f905c9c94ccfbfb46e52d443e8f2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:21:27.389542 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc01589-3ed4-4779-9445-01a35da952a0 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:27.390045 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc01589-3ed4-4779-9445-01a35da952a0 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:27.390149 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc01589-3ed4-4779-9445-01a35da952a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:27.418237 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-1bc01589-3ed4-4779-9445-01a35da952a0 None None] MFA Rules not processed for user `1254faef68054610aa2219d5b28e1262`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:21:27.419446 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-1bc01589-3ed4-4779-9445-01a35da952a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:21:27.460265 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:21:27.483501 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1385/2770] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:21:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:21:27.488342 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42733c1a-14e0-4af2-b113-648ed004054c admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:27.533108 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:21:27.551803 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42733c1a-14e0-4af2-b113-648ed004054c admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:27.556537 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6f3743-a129-4b43-86ca-c8e10ea45879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:27.557135 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f3743-a129-4b43-86ca-c8e10ea45879 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:27.557452 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f3743-a129-4b43-86ca-c8e10ea45879 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:27.557726 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f3743-a129-4b43-86ca-c8e10ea45879 admin admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:27.558351 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6f3743-a129-4b43-86ca-c8e10ea45879 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:27.560239 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6f3743-a129-4b43-86ca-c8e10ea45879 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:27.587033 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1386/2771] 10.222.0.49 () {60 vars in 1153 bytes} [Thu Sep 29 02:21:27 2022] POST /identity/v3/projects => generated 381 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 29 02:21:27.591150 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc01589-3ed4-4779-9445-01a35da952a0 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:27.601669 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc01589-3ed4-4779-9445-01a35da952a0 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:27.657561 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a337f256-0069-4402-9b05-190835663d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:27.658085 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a337f256-0069-4402-9b05-190835663d95 admin admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:27.658359 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a337f256-0069-4402-9b05-190835663d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:27.658627 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a337f256-0069-4402-9b05-190835663d95 admin admin] PATH_INFO: `/v3/users` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:27.659551 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a337f256-0069-4402-9b05-190835663d95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:27.661517 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a337f256-0069-4402-9b05-190835663d95 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:27.683231 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1386/2772] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 02:21:27 2022] POST /identity/v3/users => generated 297 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:21:27.687676 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6f3743-a129-4b43-86ca-c8e10ea45879 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:27.699141 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6f3743-a129-4b43-86ca-c8e10ea45879 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:27.703860 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349370d9-6afc-4148-8b2c-056433f5a399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:27.704477 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349370d9-6afc-4148-8b2c-056433f5a399 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:27.704757 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349370d9-6afc-4148-8b2c-056433f5a399 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:27.705030 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349370d9-6afc-4148-8b2c-056433f5a399 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:27.706469 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349370d9-6afc-4148-8b2c-056433f5a399 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:27.708312 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349370d9-6afc-4148-8b2c-056433f5a399 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:27.719783 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1387/2773] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:21:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:21:27.724049 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a337f256-0069-4402-9b05-190835663d95 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:27.734152 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a337f256-0069-4402-9b05-190835663d95 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:27.739050 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bc2199-7176-4a8b-9618-c1b058ff2c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:27.739704 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc2199-7176-4a8b-9618-c1b058ff2c04 admin admin] REQUEST_METHOD: `PUT` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:27.740001 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc2199-7176-4a8b-9618-c1b058ff2c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:27.740267 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc2199-7176-4a8b-9618-c1b058ff2c04 admin admin] PATH_INFO: `/v3/projects/27f53ad501b143a1a6ef5d10f7cf573e/users/f04b177fb0834f0fbcbfdd67424b2990/roles/fe9bbc67742f4f5893f39b18eb31d59a` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:27.755804 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bc2199-7176-4a8b-9618-c1b058ff2c04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27f53ad501b143a1a6ef5d10f7cf573e, user_id=f04b177fb0834f0fbcbfdd67424b2990, role_id=fe9bbc67742f4f5893f39b18eb31d59a)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:27.758492 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bc2199-7176-4a8b-9618-c1b058ff2c04 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:27.771853 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1387/2774] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:21:27 2022] PUT /identity/v3/projects/27f53ad501b143a1a6ef5d10f7cf573e/users/f04b177fb0834f0fbcbfdd67424b2990/roles/fe9bbc67742f4f5893f39b18eb31d59a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:21:27.775498 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349370d9-6afc-4148-8b2c-056433f5a399 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:27.785828 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349370d9-6afc-4148-8b2c-056433f5a399 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:27.840958 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5fc02b-a181-4866-933b-3175aeb591da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:27.841582 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5fc02b-a181-4866-933b-3175aeb591da admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:27.841856 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5fc02b-a181-4866-933b-3175aeb591da admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:27.842122 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5fc02b-a181-4866-933b-3175aeb591da admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:27.842748 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5fc02b-a181-4866-933b-3175aeb591da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:27.844322 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5fc02b-a181-4866-933b-3175aeb591da admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:27.854562 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1388/2775] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:21:27 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:21:27.858829 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bc2199-7176-4a8b-9618-c1b058ff2c04 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:27.869469 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bc2199-7176-4a8b-9618-c1b058ff2c04 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:27.874399 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830f72f3-1cf9-466c-91da-563d284e453f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:27.875035 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830f72f3-1cf9-466c-91da-563d284e453f admin admin] REQUEST_METHOD: `PUT` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:27.875309 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830f72f3-1cf9-466c-91da-563d284e453f admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:27.875576 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830f72f3-1cf9-466c-91da-563d284e453f admin admin] PATH_INFO: `/v3/projects/27f53ad501b143a1a6ef5d10f7cf573e/users/f04b177fb0834f0fbcbfdd67424b2990/roles/fe9bbc67742f4f5893f39b18eb31d59a` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:27.878130 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830f72f3-1cf9-466c-91da-563d284e453f admin admin] RBAC: Authorizing `identity:create_grant(project_id=27f53ad501b143a1a6ef5d10f7cf573e, user_id=f04b177fb0834f0fbcbfdd67424b2990, role_id=fe9bbc67742f4f5893f39b18eb31d59a)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:27.880760 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830f72f3-1cf9-466c-91da-563d284e453f admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:27.890870 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1388/2776] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:21:27 2022] PUT /identity/v3/projects/27f53ad501b143a1a6ef5d10f7cf573e/users/f04b177fb0834f0fbcbfdd67424b2990/roles/fe9bbc67742f4f5893f39b18eb31d59a => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:21:27.900893 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef777b5-9208-4398-b712-ca887f9b67fd None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:27.901186 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef777b5-9208-4398-b712-ca887f9b67fd None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:27.901498 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef777b5-9208-4398-b712-ca887f9b67fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:27.931021 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-aef777b5-9208-4398-b712-ca887f9b67fd None None] MFA Rules not processed for user `f04b177fb0834f0fbcbfdd67424b2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:21:27.932168 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-aef777b5-9208-4398-b712-ca887f9b67fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:21:28.000139 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1389/2777] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:21:27 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:21:28.012236 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830f72f3-1cf9-466c-91da-563d284e453f admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:28.013939 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-830f72f3-1cf9-466c-91da-563d284e453f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:21:28.082211 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830f72f3-1cf9-466c-91da-563d284e453f admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:28.085873 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0002084-0541-4ae5-ae12-f958518f52a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75135b856134ba4b9ccac337886f682', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:28.086475 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0002084-0541-4ae5-ae12-f958518f52a2 service cinder] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:28.086750 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0002084-0541-4ae5-ae12-f958518f52a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:28.087050 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0002084-0541-4ae5-ae12-f958518f52a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:28.096289 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0002084-0541-4ae5-ae12-f958518f52a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:28.097934 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0002084-0541-4ae5-ae12-f958518f52a2 service cinder] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:28.107717 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1389/2778] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:21:28 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:21:28.182293 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef777b5-9208-4398-b712-ca887f9b67fd None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:28.192638 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef777b5-9208-4398-b712-ca887f9b67fd None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:28.196419 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aea7427-b77b-41f7-a936-c49ead50cbe3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75135b856134ba4b9ccac337886f682', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:28.197092 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aea7427-b77b-41f7-a936-c49ead50cbe3 service cinder] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:28.197511 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aea7427-b77b-41f7-a936-c49ead50cbe3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:28.197853 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aea7427-b77b-41f7-a936-c49ead50cbe3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:28.246450 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:21:28.262222 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aea7427-b77b-41f7-a936-c49ead50cbe3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:28.263693 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aea7427-b77b-41f7-a936-c49ead50cbe3 service cinder] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:28.272891 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1390/2779] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:21:28 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:21:28.540646 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0002084-0541-4ae5-ae12-f958518f52a2 service cinder] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:28.582333 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:21:28.604611 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0002084-0541-4ae5-ae12-f958518f52a2 service cinder] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:28.609280 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6477b6a4-1aab-45ef-ab71-f24a5a4bbb7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:28.609969 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6477b6a4-1aab-45ef-ab71-f24a5a4bbb7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:28.610249 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6477b6a4-1aab-45ef-ab71-f24a5a4bbb7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:28.610607 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6477b6a4-1aab-45ef-ab71-f24a5a4bbb7f admin admin] PATH_INFO: `/v3/users/1254faef68054610aa2219d5b28e1262` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:28.612335 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6477b6a4-1aab-45ef-ab71-f24a5a4bbb7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1254faef68054610aa2219d5b28e1262)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:28.614473 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6477b6a4-1aab-45ef-ab71-f24a5a4bbb7f admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:28.664848 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-6477b6a4-1aab-45ef-ab71-f24a5a4bbb7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1254faef68054610aa2219d5b28e1262'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:28.665534 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-6477b6a4-1aab-45ef-ab71-f24a5a4bbb7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1254faef68054610aa2219d5b28e1262'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:28.678106 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-6477b6a4-1aab-45ef-ab71-f24a5a4bbb7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1254faef68054610aa2219d5b28e1262'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:28.687110 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-6477b6a4-1aab-45ef-ab71-f24a5a4bbb7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1254faef68054610aa2219d5b28e1262'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:28.687986 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-6477b6a4-1aab-45ef-ab71-f24a5a4bbb7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1254faef68054610aa2219d5b28e1262'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:28.700894 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1390/2780] 10.222.0.49 () {58 vars in 1224 bytes} [Thu Sep 29 02:21:28 2022] DELETE /identity/v3/users/1254faef68054610aa2219d5b28e1262 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:21:28.705227 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2629c23-688e-4587-b24f-a87b0ecfb74a None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:28.706075 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2629c23-688e-4587-b24f-a87b0ecfb74a None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:28.706346 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2629c23-688e-4587-b24f-a87b0ecfb74a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:28.727591 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-f2629c23-688e-4587-b24f-a87b0ecfb74a None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:21:28.728810 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-f2629c23-688e-4587-b24f-a87b0ecfb74a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:21:28.789783 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1391/2781] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:21:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:21:28.799926 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6477b6a4-1aab-45ef-ab71-f24a5a4bbb7f admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:28.801359 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-6477b6a4-1aab-45ef-ab71-f24a5a4bbb7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:21:28.862970 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6477b6a4-1aab-45ef-ab71-f24a5a4bbb7f admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:28.866759 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff534b05-1b18-49b9-944f-fd5a4a5f0556 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:28.867386 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff534b05-1b18-49b9-944f-fd5a4a5f0556 service neutron] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:28.867667 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff534b05-1b18-49b9-944f-fd5a4a5f0556 service neutron] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:28.867937 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff534b05-1b18-49b9-944f-fd5a4a5f0556 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:28.877554 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff534b05-1b18-49b9-944f-fd5a4a5f0556 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:28.878999 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff534b05-1b18-49b9-944f-fd5a4a5f0556 service neutron] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:28.889825 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1391/2782] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:21:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:21:29.175974 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2629c23-688e-4587-b24f-a87b0ecfb74a None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:29.177339 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-f2629c23-688e-4587-b24f-a87b0ecfb74a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:21:29.191361 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2629c23-688e-4587-b24f-a87b0ecfb74a None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:29.196208 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d970b6-5b55-4307-bb20-f399a922efb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:29.196984 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d970b6-5b55-4307-bb20-f399a922efb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:29.197268 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d970b6-5b55-4307-bb20-f399a922efb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:29.197576 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d970b6-5b55-4307-bb20-f399a922efb8 admin admin] PATH_INFO: `/v3/projects/a92f09b9cfe640f695f9511f9bcb7e8e` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:29.199243 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d970b6-5b55-4307-bb20-f399a922efb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a92f09b9cfe640f695f9511f9bcb7e8e)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:29.201163 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d970b6-5b55-4307-bb20-f399a922efb8 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:29.281838 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-05d970b6-5b55-4307-bb20-f399a922efb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a92f09b9cfe640f695f9511f9bcb7e8e', 'request_id': 'req-05d970b6-5b55-4307-bb20-f399a922efb8'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:29.290623 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-05d970b6-5b55-4307-bb20-f399a922efb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a92f09b9cfe640f695f9511f9bcb7e8e', 'request_id': 'req-05d970b6-5b55-4307-bb20-f399a922efb8'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:29.305619 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-05d970b6-5b55-4307-bb20-f399a922efb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a92f09b9cfe640f695f9511f9bcb7e8e', 'request_id': 'req-05d970b6-5b55-4307-bb20-f399a922efb8'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:29.331240 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-05d970b6-5b55-4307-bb20-f399a922efb8 admin admin] The token cache is being invalidate because project a92f09b9cfe640f695f9511f9bcb7e8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81649) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:21:29.331878 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-05d970b6-5b55-4307-bb20-f399a922efb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:29.332749 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-05d970b6-5b55-4307-bb20-f399a922efb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:29.339897 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff534b05-1b18-49b9-944f-fd5a4a5f0556 service neutron] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:29.348134 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1392/2783] 10.222.0.49 () {58 vars in 1233 bytes} [Thu Sep 29 02:21:29 2022] DELETE /identity/v3/projects/a92f09b9cfe640f695f9511f9bcb7e8e => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:21:29.356515 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff534b05-1b18-49b9-944f-fd5a4a5f0556 service neutron] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:29.456027 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e85323b-8e83-4228-bdd7-de86d22cd011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:29.456811 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e85323b-8e83-4228-bdd7-de86d22cd011 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:29.457087 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e85323b-8e83-4228-bdd7-de86d22cd011 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:29.457391 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e85323b-8e83-4228-bdd7-de86d22cd011 admin admin] PATH_INFO: `/v3/users/f04b177fb0834f0fbcbfdd67424b2990` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:29.458824 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e85323b-8e83-4228-bdd7-de86d22cd011 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f04b177fb0834f0fbcbfdd67424b2990)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:29.460858 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e85323b-8e83-4228-bdd7-de86d22cd011 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:29.462896 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:21:29.517058 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-7e85323b-8e83-4228-bdd7-de86d22cd011 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f04b177fb0834f0fbcbfdd67424b2990'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:29.517785 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-7e85323b-8e83-4228-bdd7-de86d22cd011 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f04b177fb0834f0fbcbfdd67424b2990'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:29.530298 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-7e85323b-8e83-4228-bdd7-de86d22cd011 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f04b177fb0834f0fbcbfdd67424b2990'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:29.538222 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-7e85323b-8e83-4228-bdd7-de86d22cd011 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f04b177fb0834f0fbcbfdd67424b2990'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:29.538937 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-7e85323b-8e83-4228-bdd7-de86d22cd011 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f04b177fb0834f0fbcbfdd67424b2990'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:29.551267 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1392/2784] 10.222.0.49 () {58 vars in 1224 bytes} [Thu Sep 29 02:21:29 2022] DELETE /identity/v3/users/f04b177fb0834f0fbcbfdd67424b2990 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:21:29.845411 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d970b6-5b55-4307-bb20-f399a922efb8 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:29.848494 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-05d970b6-5b55-4307-bb20-f399a922efb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:21:29.864881 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d970b6-5b55-4307-bb20-f399a922efb8 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:29.926762 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710759fd-104c-4cdb-a3be-cecb1b998252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:29.927594 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710759fd-104c-4cdb-a3be-cecb1b998252 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:29.927735 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710759fd-104c-4cdb-a3be-cecb1b998252 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:29.927933 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710759fd-104c-4cdb-a3be-cecb1b998252 admin admin] PATH_INFO: `/v3/projects/27f53ad501b143a1a6ef5d10f7cf573e` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:29.929150 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710759fd-104c-4cdb-a3be-cecb1b998252 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27f53ad501b143a1a6ef5d10f7cf573e)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:29.931071 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710759fd-104c-4cdb-a3be-cecb1b998252 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:29.932778 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:21:29.982935 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-710759fd-104c-4cdb-a3be-cecb1b998252 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27f53ad501b143a1a6ef5d10f7cf573e', 'request_id': 'req-710759fd-104c-4cdb-a3be-cecb1b998252'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:29.989293 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-710759fd-104c-4cdb-a3be-cecb1b998252 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27f53ad501b143a1a6ef5d10f7cf573e', 'request_id': 'req-710759fd-104c-4cdb-a3be-cecb1b998252'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:29.997914 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-710759fd-104c-4cdb-a3be-cecb1b998252 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27f53ad501b143a1a6ef5d10f7cf573e', 'request_id': 'req-710759fd-104c-4cdb-a3be-cecb1b998252'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:30.009992 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-710759fd-104c-4cdb-a3be-cecb1b998252 admin admin] The token cache is being invalidate because project 27f53ad501b143a1a6ef5d10f7cf573e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81649) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:21:30.010371 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-710759fd-104c-4cdb-a3be-cecb1b998252 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:30.011006 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-710759fd-104c-4cdb-a3be-cecb1b998252 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:30.012548 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1393/2785] 10.222.0.49 () {58 vars in 1233 bytes} [Thu Sep 29 02:21:29 2022] DELETE /identity/v3/projects/27f53ad501b143a1a6ef5d10f7cf573e => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:21:30.018731 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a93e74-712a-4a4d-b425-1bfa4d426d1c None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:30.019077 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a93e74-712a-4a4d-b425-1bfa4d426d1c None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:30.019406 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a93e74-712a-4a4d-b425-1bfa4d426d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:30.041238 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-99a93e74-712a-4a4d-b425-1bfa4d426d1c None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:21:30.042493 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-99a93e74-712a-4a4d-b425-1bfa4d426d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:21:30.104815 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1393/2786] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:21:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:21:30.113114 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb8e824-53f7-445c-aa97-7c320d10b385 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:30.113488 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb8e824-53f7-445c-aa97-7c320d10b385 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:30.113768 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb8e824-53f7-445c-aa97-7c320d10b385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:30.134699 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-bcb8e824-53f7-445c-aa97-7c320d10b385 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:21:30.135953 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-bcb8e824-53f7-445c-aa97-7c320d10b385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:21:30.144059 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1394/2787] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:21:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:21:30.148625 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a93e74-712a-4a4d-b425-1bfa4d426d1c None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:30.158588 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a93e74-712a-4a4d-b425-1bfa4d426d1c None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:30.163268 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387a40be-3681-45a4-ba26-ef3504a03b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:30.163878 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a40be-3681-45a4-ba26-ef3504a03b60 admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:30.164156 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a40be-3681-45a4-ba26-ef3504a03b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:30.164421 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a40be-3681-45a4-ba26-ef3504a03b60 admin admin] PATH_INFO: `/v3/domains` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:30.165097 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387a40be-3681-45a4-ba26-ef3504a03b60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:21:30.165430 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387a40be-3681-45a4-ba26-ef3504a03b60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:30.167045 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387a40be-3681-45a4-ba26-ef3504a03b60 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:30.180806 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1394/2788] 10.222.0.49 () {58 vars in 1153 bytes} [Thu Sep 29 02:21:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 29 02:21:30.185204 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb8e824-53f7-445c-aa97-7c320d10b385 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:30.195723 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb8e824-53f7-445c-aa97-7c320d10b385 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:30.200458 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147b1d11-76c3-47f9-ae33-937fdfad6884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:30.201130 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b1d11-76c3-47f9-ae33-937fdfad6884 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:30.201450 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b1d11-76c3-47f9-ae33-937fdfad6884 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:30.201732 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b1d11-76c3-47f9-ae33-937fdfad6884 admin admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:30.202366 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147b1d11-76c3-47f9-ae33-937fdfad6884 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:30.204266 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147b1d11-76c3-47f9-ae33-937fdfad6884 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:30.232552 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1395/2789] 10.222.0.49 () {60 vars in 1153 bytes} [Thu Sep 29 02:21:30 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:21:30.237703 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387a40be-3681-45a4-ba26-ef3504a03b60 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:30.249402 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387a40be-3681-45a4-ba26-ef3504a03b60 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:30.308174 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37723860-e770-4f7a-a7bd-8e97a9878945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:30.308789 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37723860-e770-4f7a-a7bd-8e97a9878945 admin admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:30.309070 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37723860-e770-4f7a-a7bd-8e97a9878945 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:30.309368 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37723860-e770-4f7a-a7bd-8e97a9878945 admin admin] PATH_INFO: `/v3/users` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:30.310012 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37723860-e770-4f7a-a7bd-8e97a9878945 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:30.311925 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37723860-e770-4f7a-a7bd-8e97a9878945 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:30.323747 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:21:30.335699 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1395/2790] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 02:21:30 2022] POST /identity/v3/users => generated 288 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 29 02:21:30.339632 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147b1d11-76c3-47f9-ae33-937fdfad6884 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:30.351987 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147b1d11-76c3-47f9-ae33-937fdfad6884 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:30.357049 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75d5d04-3e56-4e0a-a9c3-7b1a0d1c9076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:30.357762 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d5d04-3e56-4e0a-a9c3-7b1a0d1c9076 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:30.358035 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d5d04-3e56-4e0a-a9c3-7b1a0d1c9076 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:30.358303 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d5d04-3e56-4e0a-a9c3-7b1a0d1c9076 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:30.358945 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75d5d04-3e56-4e0a-a9c3-7b1a0d1c9076 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:30.360627 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75d5d04-3e56-4e0a-a9c3-7b1a0d1c9076 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:30.371645 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1396/2791] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:21:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:21:30.375673 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37723860-e770-4f7a-a7bd-8e97a9878945 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:30.386821 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37723860-e770-4f7a-a7bd-8e97a9878945 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:30.391600 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a3a806-18b7-42c8-b83d-f0ef9842ed81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:30.392206 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a3a806-18b7-42c8-b83d-f0ef9842ed81 admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:30.392488 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a3a806-18b7-42c8-b83d-f0ef9842ed81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:30.392761 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a3a806-18b7-42c8-b83d-f0ef9842ed81 admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:30.394283 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a3a806-18b7-42c8-b83d-f0ef9842ed81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:30.395926 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a3a806-18b7-42c8-b83d-f0ef9842ed81 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:30.406686 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1396/2792] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:21:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:21:30.411428 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75d5d04-3e56-4e0a-a9c3-7b1a0d1c9076 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:30.421586 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75d5d04-3e56-4e0a-a9c3-7b1a0d1c9076 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:30.426323 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28302a17-100d-4f9e-a523-cb55e4da61ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:30.426970 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28302a17-100d-4f9e-a523-cb55e4da61ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:30.427246 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28302a17-100d-4f9e-a523-cb55e4da61ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:30.427574 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28302a17-100d-4f9e-a523-cb55e4da61ba admin admin] PATH_INFO: `/v3/projects/cf9edf99524e4e61afbc2db1b247c34b/users/d61ea0f21167477f916dd76f1538ba71/roles/f157f905c9c94ccfbfb46e52d443e8f2` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:30.444519 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28302a17-100d-4f9e-a523-cb55e4da61ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf9edf99524e4e61afbc2db1b247c34b, user_id=d61ea0f21167477f916dd76f1538ba71, role_id=f157f905c9c94ccfbfb46e52d443e8f2)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:30.447200 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28302a17-100d-4f9e-a523-cb55e4da61ba admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:30.467992 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1397/2793] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:21:30 2022] PUT /identity/v3/projects/cf9edf99524e4e61afbc2db1b247c34b/users/d61ea0f21167477f916dd76f1538ba71/roles/f157f905c9c94ccfbfb46e52d443e8f2 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:21:30.481875 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e4801a-a718-451c-b74b-4ebfbf2833da None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:30.482251 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e4801a-a718-451c-b74b-4ebfbf2833da None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:30.482593 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e4801a-a718-451c-b74b-4ebfbf2833da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:30.512697 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-35e4801a-a718-451c-b74b-4ebfbf2833da None None] MFA Rules not processed for user `d61ea0f21167477f916dd76f1538ba71`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:21:30.513938 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-35e4801a-a718-451c-b74b-4ebfbf2833da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:21:30.579149 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1397/2794] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:21:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:21:30.590263 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28302a17-100d-4f9e-a523-cb55e4da61ba admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:30.591972 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-28302a17-100d-4f9e-a523-cb55e4da61ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:21:30.662369 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28302a17-100d-4f9e-a523-cb55e4da61ba admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:30.666285 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fd85ff-f6e6-4247-a16c-8580ef53e4c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75135b856134ba4b9ccac337886f682', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:30.666965 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd85ff-f6e6-4247-a16c-8580ef53e4c3 service cinder] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:30.667329 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd85ff-f6e6-4247-a16c-8580ef53e4c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:30.667678 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd85ff-f6e6-4247-a16c-8580ef53e4c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:30.676552 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fd85ff-f6e6-4247-a16c-8580ef53e4c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:30.678081 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fd85ff-f6e6-4247-a16c-8580ef53e4c3 service cinder] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:30.688273 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1398/2795] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:21:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:21:33.555854 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e4801a-a718-451c-b74b-4ebfbf2833da None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:33.557245 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-35e4801a-a718-451c-b74b-4ebfbf2833da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:21:33.614774 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e4801a-a718-451c-b74b-4ebfbf2833da None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:33.618289 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3083e961-428b-4a4d-8364-9c91086490dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:33.618998 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083e961-428b-4a4d-8364-9c91086490dc service neutron] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:33.619280 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083e961-428b-4a4d-8364-9c91086490dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:33.619547 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083e961-428b-4a4d-8364-9c91086490dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:33.621532 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-3083e961-428b-4a4d-8364-9c91086490dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:21:33.683293 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3083e961-428b-4a4d-8364-9c91086490dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:33.684895 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3083e961-428b-4a4d-8364-9c91086490dc service neutron] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:33.694819 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1398/2796] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:21:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:21:33.758430 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fd85ff-f6e6-4247-a16c-8580ef53e4c3 service cinder] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:33.769125 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fd85ff-f6e6-4247-a16c-8580ef53e4c3 service cinder] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:33.773602 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe387b6-4d78-4694-8b80-9e9440daa851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:33.774216 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe387b6-4d78-4694-8b80-9e9440daa851 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:33.774485 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe387b6-4d78-4694-8b80-9e9440daa851 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:33.775088 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe387b6-4d78-4694-8b80-9e9440daa851 admin admin] PATH_INFO: `/v3/users/d61ea0f21167477f916dd76f1538ba71` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:33.775861 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe387b6-4d78-4694-8b80-9e9440daa851 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d61ea0f21167477f916dd76f1538ba71)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:33.777784 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe387b6-4d78-4694-8b80-9e9440daa851 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:33.802266 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:21:33.828168 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-efe387b6-4d78-4694-8b80-9e9440daa851 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd61ea0f21167477f916dd76f1538ba71'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:33.828814 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-efe387b6-4d78-4694-8b80-9e9440daa851 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd61ea0f21167477f916dd76f1538ba71'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:33.844249 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-efe387b6-4d78-4694-8b80-9e9440daa851 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd61ea0f21167477f916dd76f1538ba71'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:33.853050 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-efe387b6-4d78-4694-8b80-9e9440daa851 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd61ea0f21167477f916dd76f1538ba71'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:33.853726 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-efe387b6-4d78-4694-8b80-9e9440daa851 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd61ea0f21167477f916dd76f1538ba71'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:33.869387 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1399/2797] 10.222.0.49 () {58 vars in 1224 bytes} [Thu Sep 29 02:21:33 2022] DELETE /identity/v3/users/d61ea0f21167477f916dd76f1538ba71 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:21:33.872649 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6dbfc8-68e4-43b7-b168-46a8d942feff None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:33.872977 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6dbfc8-68e4-43b7-b168-46a8d942feff None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:33.873252 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6dbfc8-68e4-43b7-b168-46a8d942feff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:33.893088 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-7a6dbfc8-68e4-43b7-b168-46a8d942feff None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:21:33.894331 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-7a6dbfc8-68e4-43b7-b168-46a8d942feff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:21:33.920764 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=100 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:21:33.963682 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1399/2798] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:21:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 29 02:21:33.973717 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe387b6-4d78-4694-8b80-9e9440daa851 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:33.975228 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-efe387b6-4d78-4694-8b80-9e9440daa851 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:21:34.044886 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe387b6-4d78-4694-8b80-9e9440daa851 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:34.050588 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a517272f-bf1f-4d74-a4b2-4703169293db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:34.051212 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a517272f-bf1f-4d74-a4b2-4703169293db service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:34.051488 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a517272f-bf1f-4d74-a4b2-4703169293db service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:34.051759 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a517272f-bf1f-4d74-a4b2-4703169293db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:34.061380 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a517272f-bf1f-4d74-a4b2-4703169293db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:34.062797 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a517272f-bf1f-4d74-a4b2-4703169293db service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:34.078254 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1400/2799] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:21:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 29 02:21:34.353839 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6dbfc8-68e4-43b7-b168-46a8d942feff None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:34.355333 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-7a6dbfc8-68e4-43b7-b168-46a8d942feff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:21:34.372039 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6dbfc8-68e4-43b7-b168-46a8d942feff None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:34.377655 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8776cd-0231-483b-a160-fd8215e2dc3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:34.378167 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8776cd-0231-483b-a160-fd8215e2dc3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:34.378477 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8776cd-0231-483b-a160-fd8215e2dc3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:34.378747 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8776cd-0231-483b-a160-fd8215e2dc3a admin admin] PATH_INFO: `/v3/projects/cf9edf99524e4e61afbc2db1b247c34b` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:34.379930 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8776cd-0231-483b-a160-fd8215e2dc3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf9edf99524e4e61afbc2db1b247c34b)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:34.381977 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8776cd-0231-483b-a160-fd8215e2dc3a admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:34.431807 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-5f8776cd-0231-483b-a160-fd8215e2dc3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf9edf99524e4e61afbc2db1b247c34b', 'request_id': 'req-5f8776cd-0231-483b-a160-fd8215e2dc3a'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:34.438499 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-5f8776cd-0231-483b-a160-fd8215e2dc3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf9edf99524e4e61afbc2db1b247c34b', 'request_id': 'req-5f8776cd-0231-483b-a160-fd8215e2dc3a'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:34.447234 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-5f8776cd-0231-483b-a160-fd8215e2dc3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf9edf99524e4e61afbc2db1b247c34b', 'request_id': 'req-5f8776cd-0231-483b-a160-fd8215e2dc3a'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:34.459543 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-5f8776cd-0231-483b-a160-fd8215e2dc3a admin admin] The token cache is being invalidate because project cf9edf99524e4e61afbc2db1b247c34b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81648) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:21:34.459838 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-5f8776cd-0231-483b-a160-fd8215e2dc3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:34.460486 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-5f8776cd-0231-483b-a160-fd8215e2dc3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:34.462059 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1400/2800] 10.222.0.49 () {58 vars in 1233 bytes} [Thu Sep 29 02:21:34 2022] DELETE /identity/v3/projects/cf9edf99524e4e61afbc2db1b247c34b => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:21:36.878778 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a517272f-bf1f-4d74-a4b2-4703169293db service neutron] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:36.880332 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-a517272f-bf1f-4d74-a4b2-4703169293db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:21:36.894655 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a517272f-bf1f-4d74-a4b2-4703169293db service neutron] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:36.952583 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6666ae-c3ad-4c6e-be9f-7077624b618a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:36.953211 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6666ae-c3ad-4c6e-be9f-7077624b618a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:36.953516 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6666ae-c3ad-4c6e-be9f-7077624b618a admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:36.953786 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6666ae-c3ad-4c6e-be9f-7077624b618a admin admin] PATH_INFO: `/v3/users/3a68abb5f8ab421cb6044c9a9f579ba6` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:36.955525 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6666ae-c3ad-4c6e-be9f-7077624b618a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a68abb5f8ab421cb6044c9a9f579ba6)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:36.957562 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6666ae-c3ad-4c6e-be9f-7077624b618a admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:37.002246 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:21:37.004024 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-8e6666ae-c3ad-4c6e-be9f-7077624b618a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a68abb5f8ab421cb6044c9a9f579ba6'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:37.004878 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-8e6666ae-c3ad-4c6e-be9f-7077624b618a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a68abb5f8ab421cb6044c9a9f579ba6'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:37.019692 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-8e6666ae-c3ad-4c6e-be9f-7077624b618a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a68abb5f8ab421cb6044c9a9f579ba6'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:37.029165 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-8e6666ae-c3ad-4c6e-be9f-7077624b618a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a68abb5f8ab421cb6044c9a9f579ba6'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:37.030233 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-8e6666ae-c3ad-4c6e-be9f-7077624b618a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a68abb5f8ab421cb6044c9a9f579ba6'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:37.043572 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1401/2801] 10.222.0.49 () {58 vars in 1224 bytes} [Thu Sep 29 02:21:36 2022] DELETE /identity/v3/users/3a68abb5f8ab421cb6044c9a9f579ba6 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:21:37.224343 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8776cd-0231-483b-a160-fd8215e2dc3a admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:37.225919 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-5f8776cd-0231-483b-a160-fd8215e2dc3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:21:37.240483 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8776cd-0231-483b-a160-fd8215e2dc3a admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:37.300529 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463dbca0-1e57-40e4-bd57-06ae381912f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:37.301248 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463dbca0-1e57-40e4-bd57-06ae381912f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:37.301560 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463dbca0-1e57-40e4-bd57-06ae381912f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:37.301836 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463dbca0-1e57-40e4-bd57-06ae381912f1 admin admin] PATH_INFO: `/v3/projects/bb1caf7cbae44c41bce39e486a20f6eb` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:37.312584 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463dbca0-1e57-40e4-bd57-06ae381912f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb1caf7cbae44c41bce39e486a20f6eb)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:37.314793 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463dbca0-1e57-40e4-bd57-06ae381912f1 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:37.356000 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:21:37.363428 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-463dbca0-1e57-40e4-bd57-06ae381912f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb1caf7cbae44c41bce39e486a20f6eb', 'request_id': 'req-463dbca0-1e57-40e4-bd57-06ae381912f1'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:37.370502 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-463dbca0-1e57-40e4-bd57-06ae381912f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb1caf7cbae44c41bce39e486a20f6eb', 'request_id': 'req-463dbca0-1e57-40e4-bd57-06ae381912f1'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:37.378816 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-463dbca0-1e57-40e4-bd57-06ae381912f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb1caf7cbae44c41bce39e486a20f6eb', 'request_id': 'req-463dbca0-1e57-40e4-bd57-06ae381912f1'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:37.388824 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-463dbca0-1e57-40e4-bd57-06ae381912f1 admin admin] The token cache is being invalidate because project bb1caf7cbae44c41bce39e486a20f6eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81648) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:21:37.389142 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-463dbca0-1e57-40e4-bd57-06ae381912f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:37.389799 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-463dbca0-1e57-40e4-bd57-06ae381912f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:21:37.391237 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1401/2802] 10.222.0.49 () {58 vars in 1233 bytes} [Thu Sep 29 02:21:37 2022] DELETE /identity/v3/projects/bb1caf7cbae44c41bce39e486a20f6eb => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:21:37.397120 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c57196f-4f45-47bd-9c31-eef504305fc4 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:37.397583 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c57196f-4f45-47bd-9c31-eef504305fc4 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:37.398015 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c57196f-4f45-47bd-9c31-eef504305fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:37.419926 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-1c57196f-4f45-47bd-9c31-eef504305fc4 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:21:37.421141 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-1c57196f-4f45-47bd-9c31-eef504305fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:21:37.480715 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1402/2803] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:21:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:21:37.488621 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c51d9-6d9f-4914-a40c-34029e80bb0c None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:37.488905 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c51d9-6d9f-4914-a40c-34029e80bb0c None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:37.489209 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c51d9-6d9f-4914-a40c-34029e80bb0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:37.509860 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-7a6c51d9-6d9f-4914-a40c-34029e80bb0c None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:21:37.511100 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-7a6c51d9-6d9f-4914-a40c-34029e80bb0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:21:37.519622 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1402/2804] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:21:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:21:37.523963 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c57196f-4f45-47bd-9c31-eef504305fc4 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:37.534063 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c57196f-4f45-47bd-9c31-eef504305fc4 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:37.538846 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1449599-618c-4609-bc39-defefec1ff6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:37.539471 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1449599-618c-4609-bc39-defefec1ff6a admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:37.539747 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1449599-618c-4609-bc39-defefec1ff6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:37.540014 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1449599-618c-4609-bc39-defefec1ff6a admin admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:37.540662 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1449599-618c-4609-bc39-defefec1ff6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:21:37.540959 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1449599-618c-4609-bc39-defefec1ff6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:37.542576 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1449599-618c-4609-bc39-defefec1ff6a admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:37.554470 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1403/2805] 10.222.0.49 () {58 vars in 1153 bytes} [Thu Sep 29 02:21:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:21:37.558578 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6c51d9-6d9f-4914-a40c-34029e80bb0c None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:37.568227 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6c51d9-6d9f-4914-a40c-34029e80bb0c None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:37.572733 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871ab1e5-0b64-4469-bf63-d2733895c43b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:37.573329 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871ab1e5-0b64-4469-bf63-d2733895c43b admin admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:37.573616 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871ab1e5-0b64-4469-bf63-d2733895c43b admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:37.573882 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871ab1e5-0b64-4469-bf63-d2733895c43b admin admin] PATH_INFO: `/v3/projects` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:37.574498 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871ab1e5-0b64-4469-bf63-d2733895c43b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:37.576393 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871ab1e5-0b64-4469-bf63-d2733895c43b admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:37.613369 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1403/2806] 10.222.0.49 () {60 vars in 1153 bytes} [Thu Sep 29 02:21:37 2022] POST /identity/v3/projects => generated 377 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:21:37.617398 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1449599-618c-4609-bc39-defefec1ff6a admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:37.628251 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1449599-618c-4609-bc39-defefec1ff6a admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:37.685848 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df9f4a8-fcd9-479e-8e04-d2fc2abf43b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:37.686509 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df9f4a8-fcd9-479e-8e04-d2fc2abf43b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:37.686790 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df9f4a8-fcd9-479e-8e04-d2fc2abf43b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:37.687083 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df9f4a8-fcd9-479e-8e04-d2fc2abf43b9 admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:37.687718 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df9f4a8-fcd9-479e-8e04-d2fc2abf43b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:37.689780 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df9f4a8-fcd9-479e-8e04-d2fc2abf43b9 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:37.711051 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1404/2807] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 02:21:37 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:21:37.715595 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871ab1e5-0b64-4469-bf63-d2733895c43b admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:37.726560 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871ab1e5-0b64-4469-bf63-d2733895c43b admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:37.731088 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f98213f-efad-45bf-ae2b-c0cc9cdd37de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:37.731671 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f98213f-efad-45bf-ae2b-c0cc9cdd37de admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:37.731945 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f98213f-efad-45bf-ae2b-c0cc9cdd37de admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:37.732213 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f98213f-efad-45bf-ae2b-c0cc9cdd37de admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:37.732845 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f98213f-efad-45bf-ae2b-c0cc9cdd37de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:37.734456 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f98213f-efad-45bf-ae2b-c0cc9cdd37de admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:37.744875 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1404/2808] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:21:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:21:37.749525 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df9f4a8-fcd9-479e-8e04-d2fc2abf43b9 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:37.759684 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df9f4a8-fcd9-479e-8e04-d2fc2abf43b9 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:37.764247 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f07261-2c40-4c0a-ac54-5bc28622dd47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:37.764833 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f07261-2c40-4c0a-ac54-5bc28622dd47 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:37.765111 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f07261-2c40-4c0a-ac54-5bc28622dd47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:37.765422 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f07261-2c40-4c0a-ac54-5bc28622dd47 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:37.766059 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f07261-2c40-4c0a-ac54-5bc28622dd47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:37.768439 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f07261-2c40-4c0a-ac54-5bc28622dd47 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:37.778889 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1405/2809] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:21:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 29 02:21:37.783696 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f98213f-efad-45bf-ae2b-c0cc9cdd37de admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:37.793646 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f98213f-efad-45bf-ae2b-c0cc9cdd37de admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:37.798153 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7951f233-31c6-4691-ab93-ecc771262a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:37.798787 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7951f233-31c6-4691-ab93-ecc771262a73 admin admin] REQUEST_METHOD: `PUT` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:37.799081 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7951f233-31c6-4691-ab93-ecc771262a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:37.799353 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7951f233-31c6-4691-ab93-ecc771262a73 admin admin] PATH_INFO: `/v3/projects/f44d9cbd3a954891bdeb4ad11ad9d535/users/7e2b986d2cc34fe98ffeead02e0ba9f3/roles/f157f905c9c94ccfbfb46e52d443e8f2` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:37.813614 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7951f233-31c6-4691-ab93-ecc771262a73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f44d9cbd3a954891bdeb4ad11ad9d535, user_id=7e2b986d2cc34fe98ffeead02e0ba9f3, role_id=f157f905c9c94ccfbfb46e52d443e8f2)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:37.816397 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7951f233-31c6-4691-ab93-ecc771262a73 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:37.829546 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1405/2810] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:21:37 2022] PUT /identity/v3/projects/f44d9cbd3a954891bdeb4ad11ad9d535/users/7e2b986d2cc34fe98ffeead02e0ba9f3/roles/f157f905c9c94ccfbfb46e52d443e8f2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:21:37.835187 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6b85c1-9afe-48aa-8842-cbd7246c6b27 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:37.835470 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6b85c1-9afe-48aa-8842-cbd7246c6b27 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:37.835732 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6b85c1-9afe-48aa-8842-cbd7246c6b27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:37.855708 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-7b6b85c1-9afe-48aa-8842-cbd7246c6b27 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:21:37.856934 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-7b6b85c1-9afe-48aa-8842-cbd7246c6b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:21:37.880822 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:21:37.918775 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1406/2811] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:21:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 29 02:21:37.929074 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7951f233-31c6-4691-ab93-ecc771262a73 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:37.931079 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-7951f233-31c6-4691-ab93-ecc771262a73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:21:37.988138 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7951f233-31c6-4691-ab93-ecc771262a73 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:37.991722 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c36429-005b-452c-a978-f2c3fd472c13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:37.992313 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c36429-005b-452c-a978-f2c3fd472c13 service neutron] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:37.992588 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c36429-005b-452c-a978-f2c3fd472c13 service neutron] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:37.992856 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c36429-005b-452c-a978-f2c3fd472c13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:38.002023 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c36429-005b-452c-a978-f2c3fd472c13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:38.003572 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c36429-005b-452c-a978-f2c3fd472c13 service neutron] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:38.013197 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1406/2812] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:21:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:21:41.956357 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b3be8-40a0-4f1b-be3a-b6f53664d303 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:41.956819 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b3be8-40a0-4f1b-be3a-b6f53664d303 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:41.956935 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b3be8-40a0-4f1b-be3a-b6f53664d303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:41.992875 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-cc6b3be8-40a0-4f1b-be3a-b6f53664d303 None None] MFA Rules not processed for user `7e2b986d2cc34fe98ffeead02e0ba9f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:21:41.994226 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-cc6b3be8-40a0-4f1b-be3a-b6f53664d303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:21:42.061737 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1407/2813] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:21:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:21:42.077375 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c36429-005b-452c-a978-f2c3fd472c13 service neutron] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:42.078878 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-30c36429-005b-452c-a978-f2c3fd472c13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:21:42.162017 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:21:42.181734 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c36429-005b-452c-a978-f2c3fd472c13 service neutron] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:42.189463 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bf96fe-1fac-466a-9ffa-1864e3ace7ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3325a7111d447f4a9cf00c672d5420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:42.190024 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf96fe-1fac-466a-9ffa-1864e3ace7ae service nova] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:42.190304 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf96fe-1fac-466a-9ffa-1864e3ace7ae service nova] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:42.190667 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf96fe-1fac-466a-9ffa-1864e3ace7ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:42.200098 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bf96fe-1fac-466a-9ffa-1864e3ace7ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:42.201839 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bf96fe-1fac-466a-9ffa-1864e3ace7ae service nova] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:42.214518 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1407/2814] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:21:42 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:21:43.535201 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed88ee0-95cd-4939-98e5-e023a0ebdc85 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:43.535920 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed88ee0-95cd-4939-98e5-e023a0ebdc85 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:43.535920 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed88ee0-95cd-4939-98e5-e023a0ebdc85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:43.556205 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-7ed88ee0-95cd-4939-98e5-e023a0ebdc85 None None] MFA Rules not processed for user `7e2b986d2cc34fe98ffeead02e0ba9f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:21:43.557298 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-7ed88ee0-95cd-4939-98e5-e023a0ebdc85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:21:43.564944 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1408/2815] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:21:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:21:44.211090 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bf96fe-1fac-466a-9ffa-1864e3ace7ae service nova] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:21:44.221472 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bf96fe-1fac-466a-9ffa-1864e3ace7ae service nova] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:21:44.227924 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8119d213-21b2-45c2-b240-db594b2f8b99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:21:44.228605 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8119d213-21b2-45c2-b240-db594b2f8b99 service neutron] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:21:44.228889 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8119d213-21b2-45c2-b240-db594b2f8b99 service neutron] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:21:44.229149 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8119d213-21b2-45c2-b240-db594b2f8b99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:21:44.231146 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-8119d213-21b2-45c2-b240-db594b2f8b99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:21:44.245411 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8119d213-21b2-45c2-b240-db594b2f8b99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:21:44.246840 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8119d213-21b2-45c2-b240-db594b2f8b99 service neutron] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:21:44.258890 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1408/2816] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:21:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:21:53.550363 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=49 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:21:54.254224 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=13 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:22:47.201566 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed88ee0-95cd-4939-98e5-e023a0ebdc85 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:22:47.211353 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed88ee0-95cd-4939-98e5-e023a0ebdc85 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:22:47.214948 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae34ebb-5251-484f-afeb-940000a37e1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:22:47.215544 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae34ebb-5251-484f-afeb-940000a37e1b service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:22:47.215818 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae34ebb-5251-484f-afeb-940000a37e1b service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:22:47.216084 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae34ebb-5251-484f-afeb-940000a37e1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:22:47.217978 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-cae34ebb-5251-484f-afeb-940000a37e1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:22:47.227277 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae34ebb-5251-484f-afeb-940000a37e1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:22:47.228696 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae34ebb-5251-484f-afeb-940000a37e1b service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:22:47.237076 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1409/2817] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:22:47 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:22:57.234403 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=6 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:24:52.088478 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8119d213-21b2-45c2-b240-db594b2f8b99 service neutron] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:24:52.089909 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-8119d213-21b2-45c2-b240-db594b2f8b99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:24:52.160987 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8119d213-21b2-45c2-b240-db594b2f8b99 service neutron] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:24:52.166760 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ced281-f6b9-46a3-8896-e4db07918198 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cbb39731a6b42e2a6647d6134b5c7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:24:52.167364 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ced281-f6b9-46a3-8896-e4db07918198 service placement] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:24:52.167647 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ced281-f6b9-46a3-8896-e4db07918198 service placement] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:24:52.167915 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ced281-f6b9-46a3-8896-e4db07918198 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:24:52.169668 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-91ced281-f6b9-46a3-8896-e4db07918198 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:24:52.181626 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ced281-f6b9-46a3-8896-e4db07918198 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:24:52.183200 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ced281-f6b9-46a3-8896-e4db07918198 service placement] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:24:52.192962 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1409/2818] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:24:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:25:02.188809 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=32 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:25:55.720758 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae34ebb-5251-484f-afeb-940000a37e1b service neutron] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:25:55.737769 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae34ebb-5251-484f-afeb-940000a37e1b service neutron] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:25:55.750713 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00faab25-011f-476f-9314-433d270c4b30 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3325a7111d447f4a9cf00c672d5420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:25:55.751437 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00faab25-011f-476f-9314-433d270c4b30 service nova] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:25:55.751802 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00faab25-011f-476f-9314-433d270c4b30 service nova] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:25:55.752244 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00faab25-011f-476f-9314-433d270c4b30 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:25:55.754126 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-00faab25-011f-476f-9314-433d270c4b30 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:25:55.770356 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00faab25-011f-476f-9314-433d270c4b30 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:25:55.772100 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00faab25-011f-476f-9314-433d270c4b30 service nova] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:25:55.785765 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1410/2819] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:25:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:25:58.206825 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ce60d-bb87-49fa-98ed-ed05b2313525 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:25:58.207374 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ce60d-bb87-49fa-98ed-ed05b2313525 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:25:58.207374 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ce60d-bb87-49fa-98ed-ed05b2313525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:25:58.226309 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-109ce60d-bb87-49fa-98ed-ed05b2313525 None None] MFA Rules not processed for user `7e2b986d2cc34fe98ffeead02e0ba9f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:25:58.227514 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-109ce60d-bb87-49fa-98ed-ed05b2313525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:25:58.235144 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1410/2820] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:25:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:25:58.542427 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00faab25-011f-476f-9314-433d270c4b30 service nova] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:25:58.552641 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00faab25-011f-476f-9314-433d270c4b30 service nova] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:25:58.556426 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5643305a-2b18-4577-b313-fabeb7f1ee73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:25:58.557025 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5643305a-2b18-4577-b313-fabeb7f1ee73 service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:25:58.557301 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5643305a-2b18-4577-b313-fabeb7f1ee73 service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:25:58.557606 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5643305a-2b18-4577-b313-fabeb7f1ee73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:25:58.559351 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-5643305a-2b18-4577-b313-fabeb7f1ee73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:25:58.568938 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5643305a-2b18-4577-b313-fabeb7f1ee73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:25:58.570382 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5643305a-2b18-4577-b313-fabeb7f1ee73 service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:25:58.578352 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1411/2821] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:25:58 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:25:58.910219 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109ce60d-bb87-49fa-98ed-ed05b2313525 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:25:58.911782 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-109ce60d-bb87-49fa-98ed-ed05b2313525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:25:58.926682 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109ce60d-bb87-49fa-98ed-ed05b2313525 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:25:58.931644 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a964b9-fadd-4670-9afe-7cde7c311433 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cbb39731a6b42e2a6647d6134b5c7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:25:58.932266 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a964b9-fadd-4670-9afe-7cde7c311433 service placement] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:25:58.932754 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a964b9-fadd-4670-9afe-7cde7c311433 service placement] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:25:58.933026 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a964b9-fadd-4670-9afe-7cde7c311433 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:25:58.934952 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-b7a964b9-fadd-4670-9afe-7cde7c311433 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:25:58.955200 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a964b9-fadd-4670-9afe-7cde7c311433 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:25:58.955200 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a964b9-fadd-4670-9afe-7cde7c311433 service placement] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:25:58.959182 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1411/2822] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:25:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:26:07.393381 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5643305a-2b18-4577-b313-fabeb7f1ee73 service neutron] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:26:07.410784 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5643305a-2b18-4577-b313-fabeb7f1ee73 service neutron] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:26:07.416489 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7182367e-72cd-4d00-9bac-ad83a8588205 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3325a7111d447f4a9cf00c672d5420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:26:07.417288 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7182367e-72cd-4d00-9bac-ad83a8588205 service nova] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:26:07.417697 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7182367e-72cd-4d00-9bac-ad83a8588205 service nova] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:26:07.417967 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7182367e-72cd-4d00-9bac-ad83a8588205 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:26:07.419920 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-7182367e-72cd-4d00-9bac-ad83a8588205 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:26:07.432909 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7182367e-72cd-4d00-9bac-ad83a8588205 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:26:07.434690 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7182367e-72cd-4d00-9bac-ad83a8588205 service nova] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:26:07.446722 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1412/2823] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:26:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:26:08.954796 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=9 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:26:17.442020 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=18 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:27:17.245901 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a964b9-fadd-4670-9afe-7cde7c311433 service placement] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:27:17.259410 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a964b9-fadd-4670-9afe-7cde7c311433 service placement] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:27:17.264801 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37893b2-bfad-4e73-b4fa-3248fb9c5231 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3325a7111d447f4a9cf00c672d5420f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:27:17.265422 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37893b2-bfad-4e73-b4fa-3248fb9c5231 service nova] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:27:17.265702 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37893b2-bfad-4e73-b4fa-3248fb9c5231 service nova] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:27:17.265970 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37893b2-bfad-4e73-b4fa-3248fb9c5231 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:27:17.274317 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37893b2-bfad-4e73-b4fa-3248fb9c5231 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:27:17.275895 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37893b2-bfad-4e73-b4fa-3248fb9c5231 service nova] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:27:17.284814 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1412/2824] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:27:17 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:27:18.694180 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7182367e-72cd-4d00-9bac-ad83a8588205 service nova] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:27:18.695576 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-7182367e-72cd-4d00-9bac-ad83a8588205 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:27:18.751190 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7182367e-72cd-4d00-9bac-ad83a8588205 service nova] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:27:18.755269 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da890270-aecc-4914-9ea2-7f20195fa088 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75135b856134ba4b9ccac337886f682', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:27:18.755861 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da890270-aecc-4914-9ea2-7f20195fa088 service cinder] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:27:18.756138 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da890270-aecc-4914-9ea2-7f20195fa088 service cinder] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:27:18.756409 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da890270-aecc-4914-9ea2-7f20195fa088 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:27:18.766531 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da890270-aecc-4914-9ea2-7f20195fa088 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:27:18.767967 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da890270-aecc-4914-9ea2-7f20195fa088 service cinder] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:27:18.779508 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1413/2825] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:27:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:27:27.280971 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=6 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:27:28.774729 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=26 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:27:36.298733 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37893b2-bfad-4e73-b4fa-3248fb9c5231 service nova] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:27:36.300117 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-d37893b2-bfad-4e73-b4fa-3248fb9c5231 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:27:36.312609 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37893b2-bfad-4e73-b4fa-3248fb9c5231 service nova] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:27:36.316429 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0ad34a-7a20-48c8-9ff8-3f52bb9de1da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:27:36.317025 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0ad34a-7a20-48c8-9ff8-3f52bb9de1da service neutron] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:27:36.317302 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0ad34a-7a20-48c8-9ff8-3f52bb9de1da service neutron] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:27:36.317599 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0ad34a-7a20-48c8-9ff8-3f52bb9de1da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:27:36.327101 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0ad34a-7a20-48c8-9ff8-3f52bb9de1da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:27:36.328549 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0ad34a-7a20-48c8-9ff8-3f52bb9de1da service neutron] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:27:36.337847 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1413/2826] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:27:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:27:39.385080 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da890270-aecc-4914-9ea2-7f20195fa088 service cinder] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:27:39.401517 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da890270-aecc-4914-9ea2-7f20195fa088 service cinder] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:27:39.407582 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422523b1-7ad0-4207-92bc-a18dbd48f6ee service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cbb39731a6b42e2a6647d6134b5c7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:27:39.408196 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422523b1-7ad0-4207-92bc-a18dbd48f6ee service placement] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:27:39.408500 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422523b1-7ad0-4207-92bc-a18dbd48f6ee service placement] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:27:39.408818 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422523b1-7ad0-4207-92bc-a18dbd48f6ee service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:27:39.411100 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-422523b1-7ad0-4207-92bc-a18dbd48f6ee service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:27:39.424892 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422523b1-7ad0-4207-92bc-a18dbd48f6ee service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:27:39.426522 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422523b1-7ad0-4207-92bc-a18dbd48f6ee service placement] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:27:39.439885 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1414/2827] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:27:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:27:39.453230 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0ad34a-7a20-48c8-9ff8-3f52bb9de1da service neutron] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:27:39.464120 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0ad34a-7a20-48c8-9ff8-3f52bb9de1da service neutron] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:27:39.469761 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a06042-0c8f-463b-a57e-4d0b4556b9d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:27:39.470823 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a06042-0c8f-463b-a57e-4d0b4556b9d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:27:39.471199 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a06042-0c8f-463b-a57e-4d0b4556b9d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:27:39.471603 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a06042-0c8f-463b-a57e-4d0b4556b9d1 admin admin] PATH_INFO: `/v3/users/7e2b986d2cc34fe98ffeead02e0ba9f3` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:27:39.472962 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a06042-0c8f-463b-a57e-4d0b4556b9d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e2b986d2cc34fe98ffeead02e0ba9f3)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:27:39.479434 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a06042-0c8f-463b-a57e-4d0b4556b9d1 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:27:39.524289 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-b2a06042-0c8f-463b-a57e-4d0b4556b9d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e2b986d2cc34fe98ffeead02e0ba9f3'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:27:39.524935 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-b2a06042-0c8f-463b-a57e-4d0b4556b9d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e2b986d2cc34fe98ffeead02e0ba9f3'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:27:39.537638 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-b2a06042-0c8f-463b-a57e-4d0b4556b9d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e2b986d2cc34fe98ffeead02e0ba9f3'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:27:39.545109 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-b2a06042-0c8f-463b-a57e-4d0b4556b9d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e2b986d2cc34fe98ffeead02e0ba9f3'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:27:39.545746 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-b2a06042-0c8f-463b-a57e-4d0b4556b9d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e2b986d2cc34fe98ffeead02e0ba9f3'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:27:39.558469 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1414/2828] 10.222.0.49 () {58 vars in 1224 bytes} [Thu Sep 29 02:27:39 2022] DELETE /identity/v3/users/7e2b986d2cc34fe98ffeead02e0ba9f3 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:27:39.727286 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422523b1-7ad0-4207-92bc-a18dbd48f6ee service placement] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:27:39.743017 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422523b1-7ad0-4207-92bc-a18dbd48f6ee service placement] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:27:39.801462 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda15f20-49f3-4e8c-968a-b51da1e7696d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:27:39.802092 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda15f20-49f3-4e8c-968a-b51da1e7696d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:27:39.802371 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda15f20-49f3-4e8c-968a-b51da1e7696d admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:27:39.803389 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda15f20-49f3-4e8c-968a-b51da1e7696d admin admin] PATH_INFO: `/v3/projects/f44d9cbd3a954891bdeb4ad11ad9d535` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:27:39.804507 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda15f20-49f3-4e8c-968a-b51da1e7696d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f44d9cbd3a954891bdeb4ad11ad9d535)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:27:39.806460 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda15f20-49f3-4e8c-968a-b51da1e7696d admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:27:39.851524 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-cda15f20-49f3-4e8c-968a-b51da1e7696d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f44d9cbd3a954891bdeb4ad11ad9d535', 'request_id': 'req-cda15f20-49f3-4e8c-968a-b51da1e7696d'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:27:39.857561 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-cda15f20-49f3-4e8c-968a-b51da1e7696d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f44d9cbd3a954891bdeb4ad11ad9d535', 'request_id': 'req-cda15f20-49f3-4e8c-968a-b51da1e7696d'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:27:39.864572 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-cda15f20-49f3-4e8c-968a-b51da1e7696d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f44d9cbd3a954891bdeb4ad11ad9d535', 'request_id': 'req-cda15f20-49f3-4e8c-968a-b51da1e7696d'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:27:39.875658 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-cda15f20-49f3-4e8c-968a-b51da1e7696d admin admin] The token cache is being invalidate because project f44d9cbd3a954891bdeb4ad11ad9d535 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81649) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:27:39.876061 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-cda15f20-49f3-4e8c-968a-b51da1e7696d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:27:39.876700 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-cda15f20-49f3-4e8c-968a-b51da1e7696d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:27:39.878179 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1415/2829] 10.222.0.49 () {58 vars in 1233 bytes} [Thu Sep 29 02:27:39 2022] DELETE /identity/v3/projects/f44d9cbd3a954891bdeb4ad11ad9d535 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:27:39.883031 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab6efb-ec48-4a5b-a9e3-b1acb1c6c299 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:27:39.883391 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab6efb-ec48-4a5b-a9e3-b1acb1c6c299 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:27:39.883754 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab6efb-ec48-4a5b-a9e3-b1acb1c6c299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:27:39.904064 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-ecab6efb-ec48-4a5b-a9e3-b1acb1c6c299 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:27:39.905225 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-ecab6efb-ec48-4a5b-a9e3-b1acb1c6c299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:27:39.966475 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1415/2830] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:27:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:27:39.974164 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebcd8c3-bcb1-4f0a-bb23-e7579cab44ef None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:27:39.975234 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebcd8c3-bcb1-4f0a-bb23-e7579cab44ef None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:27:39.975604 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebcd8c3-bcb1-4f0a-bb23-e7579cab44ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:27:39.995009 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-aebcd8c3-bcb1-4f0a-bb23-e7579cab44ef None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:27:39.996208 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-aebcd8c3-bcb1-4f0a-bb23-e7579cab44ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:27:40.003995 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1416/2831] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:27:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:27:40.008282 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecab6efb-ec48-4a5b-a9e3-b1acb1c6c299 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:27:40.017890 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecab6efb-ec48-4a5b-a9e3-b1acb1c6c299 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:27:40.023122 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801e846c-d1e2-4f05-8505-b2b6ffabf146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:27:40.023716 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801e846c-d1e2-4f05-8505-b2b6ffabf146 admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:27:40.023995 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801e846c-d1e2-4f05-8505-b2b6ffabf146 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:27:40.024266 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801e846c-d1e2-4f05-8505-b2b6ffabf146 admin admin] PATH_INFO: `/v3/domains` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:27:40.024901 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801e846c-d1e2-4f05-8505-b2b6ffabf146 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:27:40.025201 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801e846c-d1e2-4f05-8505-b2b6ffabf146 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:27:40.026832 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801e846c-d1e2-4f05-8505-b2b6ffabf146 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:27:40.039067 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1416/2832] 10.222.0.49 () {58 vars in 1153 bytes} [Thu Sep 29 02:27:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:27:40.043158 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebcd8c3-bcb1-4f0a-bb23-e7579cab44ef None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:27:40.052301 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebcd8c3-bcb1-4f0a-bb23-e7579cab44ef None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:27:40.057389 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6470a075-ab8f-4979-99d5-2725b80902d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:27:40.057975 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470a075-ab8f-4979-99d5-2725b80902d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:27:40.058245 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470a075-ab8f-4979-99d5-2725b80902d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:27:40.058508 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470a075-ab8f-4979-99d5-2725b80902d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:27:40.059130 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6470a075-ab8f-4979-99d5-2725b80902d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:27:40.061462 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6470a075-ab8f-4979-99d5-2725b80902d8 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:27:40.088645 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1417/2833] 10.222.0.49 () {60 vars in 1153 bytes} [Thu Sep 29 02:27:40 2022] POST /identity/v3/projects => generated 403 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:27:40.092766 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801e846c-d1e2-4f05-8505-b2b6ffabf146 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:27:40.102818 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801e846c-d1e2-4f05-8505-b2b6ffabf146 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:27:40.147089 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:27:40.161659 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d52915-0316-4d09-90f6-9f06085c67ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:27:40.162217 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d52915-0316-4d09-90f6-9f06085c67ac admin admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:27:40.162494 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d52915-0316-4d09-90f6-9f06085c67ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:27:40.162765 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d52915-0316-4d09-90f6-9f06085c67ac admin admin] PATH_INFO: `/v3/users` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:27:40.163403 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d52915-0316-4d09-90f6-9f06085c67ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:27:40.165325 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d52915-0316-4d09-90f6-9f06085c67ac admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:27:40.186070 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1417/2834] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 02:27:40 2022] POST /identity/v3/users => generated 302 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:27:40.190189 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6470a075-ab8f-4979-99d5-2725b80902d8 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:27:40.200946 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6470a075-ab8f-4979-99d5-2725b80902d8 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:27:40.205543 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3a42de-0443-4a10-b6ed-aaf8ed4865c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:27:40.206128 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a42de-0443-4a10-b6ed-aaf8ed4865c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:27:40.206402 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a42de-0443-4a10-b6ed-aaf8ed4865c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:27:40.206668 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a42de-0443-4a10-b6ed-aaf8ed4865c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:27:40.207296 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3a42de-0443-4a10-b6ed-aaf8ed4865c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:27:40.208867 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3a42de-0443-4a10-b6ed-aaf8ed4865c2 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:27:40.218491 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1418/2835] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:27:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:27:40.222289 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d52915-0316-4d09-90f6-9f06085c67ac admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:27:40.232402 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d52915-0316-4d09-90f6-9f06085c67ac admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:27:40.236961 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c3c9b5-618b-4267-9ecd-14ba438f6822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:27:40.237583 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c3c9b5-618b-4267-9ecd-14ba438f6822 admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:27:40.237866 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c3c9b5-618b-4267-9ecd-14ba438f6822 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:27:40.238135 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c3c9b5-618b-4267-9ecd-14ba438f6822 admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:27:40.238783 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c3c9b5-618b-4267-9ecd-14ba438f6822 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:27:40.240936 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c3c9b5-618b-4267-9ecd-14ba438f6822 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:27:40.251309 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1418/2836] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:27:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:27:40.255257 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3a42de-0443-4a10-b6ed-aaf8ed4865c2 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:27:40.265723 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3a42de-0443-4a10-b6ed-aaf8ed4865c2 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:27:40.270231 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0293e5f4-f4cf-4a64-b5b9-cfec450c1d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:27:40.270861 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0293e5f4-f4cf-4a64-b5b9-cfec450c1d7e admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:27:40.271133 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0293e5f4-f4cf-4a64-b5b9-cfec450c1d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:27:40.271400 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0293e5f4-f4cf-4a64-b5b9-cfec450c1d7e admin admin] PATH_INFO: `/v3/projects/ccf0a817350942a1b0ccd9f0b4038706/users/01505e9fbaa443dda7edb1bf45d493e3/roles/f157f905c9c94ccfbfb46e52d443e8f2` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:27:40.285831 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0293e5f4-f4cf-4a64-b5b9-cfec450c1d7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccf0a817350942a1b0ccd9f0b4038706, user_id=01505e9fbaa443dda7edb1bf45d493e3, role_id=f157f905c9c94ccfbfb46e52d443e8f2)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:27:40.289082 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0293e5f4-f4cf-4a64-b5b9-cfec450c1d7e admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:27:40.301666 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1419/2837] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:27:40 2022] PUT /identity/v3/projects/ccf0a817350942a1b0ccd9f0b4038706/users/01505e9fbaa443dda7edb1bf45d493e3/roles/f157f905c9c94ccfbfb46e52d443e8f2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:27:40.307326 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9187dd8-35e5-43a0-aefd-d0fb1c800bee None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:27:40.307636 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9187dd8-35e5-43a0-aefd-d0fb1c800bee None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:27:40.307907 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9187dd8-35e5-43a0-aefd-d0fb1c800bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:27:40.326781 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-a9187dd8-35e5-43a0-aefd-d0fb1c800bee None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:27:40.327979 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-a9187dd8-35e5-43a0-aefd-d0fb1c800bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:27:40.385961 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1419/2838] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:27:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:27:40.395714 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0293e5f4-f4cf-4a64-b5b9-cfec450c1d7e admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:27:40.397822 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-0293e5f4-f4cf-4a64-b5b9-cfec450c1d7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:27:40.412717 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:27:40.456328 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0293e5f4-f4cf-4a64-b5b9-cfec450c1d7e admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:27:40.460223 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd608d30-6ccb-4b01-b8ca-8aa822e1c478 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:27:40.460820 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd608d30-6ccb-4b01-b8ca-8aa822e1c478 service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:27:40.461097 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd608d30-6ccb-4b01-b8ca-8aa822e1c478 service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:27:40.461424 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd608d30-6ccb-4b01-b8ca-8aa822e1c478 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:27:40.470380 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd608d30-6ccb-4b01-b8ca-8aa822e1c478 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:27:40.471793 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd608d30-6ccb-4b01-b8ca-8aa822e1c478 service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:27:40.481616 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1420/2839] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:27:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:27:41.101188 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d6a99-f627-4d23-9b92-b8c1bfc15486 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:27:41.101826 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d6a99-f627-4d23-9b92-b8c1bfc15486 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:27:41.101826 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d6a99-f627-4d23-9b92-b8c1bfc15486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:27:41.129418 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-cb0d6a99-f627-4d23-9b92-b8c1bfc15486 None None] MFA Rules not processed for user `01505e9fbaa443dda7edb1bf45d493e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:27:41.130638 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-cb0d6a99-f627-4d23-9b92-b8c1bfc15486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:27:41.199840 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1420/2840] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:27:41 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:27:41.204767 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd608d30-6ccb-4b01-b8ca-8aa822e1c478 service neutron] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:27:41.214964 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd608d30-6ccb-4b01-b8ca-8aa822e1c478 service neutron] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:27:41.219610 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d235dca-2c44-4ed4-a949-8585307bfd5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:27:41.220228 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d235dca-2c44-4ed4-a949-8585307bfd5b admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:27:41.220506 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d235dca-2c44-4ed4-a949-8585307bfd5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:27:41.220781 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d235dca-2c44-4ed4-a949-8585307bfd5b admin admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:27:41.221494 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d235dca-2c44-4ed4-a949-8585307bfd5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:27:41.223463 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d235dca-2c44-4ed4-a949-8585307bfd5b admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:27:41.253651 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1421/2841] 10.222.0.49 () {60 vars in 1153 bytes} [Thu Sep 29 02:27:41 2022] POST /identity/v3/projects => generated 405 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:27:41.257811 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0d6a99-f627-4d23-9b92-b8c1bfc15486 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:27:41.269216 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0d6a99-f627-4d23-9b92-b8c1bfc15486 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:27:41.321784 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:27:41.329676 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c8238f-d745-4756-934e-f5feae7005bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:27:41.330286 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c8238f-d745-4756-934e-f5feae7005bd admin admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:27:41.330556 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c8238f-d745-4756-934e-f5feae7005bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:27:41.330841 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c8238f-d745-4756-934e-f5feae7005bd admin admin] PATH_INFO: `/v3/users` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:27:41.331477 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c8238f-d745-4756-934e-f5feae7005bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:27:41.333403 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c8238f-d745-4756-934e-f5feae7005bd admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:27:41.356155 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1421/2842] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 02:27:41 2022] POST /identity/v3/users => generated 309 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 29 02:27:41.360173 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d235dca-2c44-4ed4-a949-8585307bfd5b admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:27:41.371212 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d235dca-2c44-4ed4-a949-8585307bfd5b admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:27:41.375761 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3970346f-4c20-4e07-91bb-206bbabe1c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:27:41.376352 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3970346f-4c20-4e07-91bb-206bbabe1c0f admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:27:41.376627 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3970346f-4c20-4e07-91bb-206bbabe1c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:27:41.376895 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3970346f-4c20-4e07-91bb-206bbabe1c0f admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:27:41.377567 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3970346f-4c20-4e07-91bb-206bbabe1c0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:27:41.379138 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3970346f-4c20-4e07-91bb-206bbabe1c0f admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:27:41.391659 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1422/2843] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:27:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:27:41.395825 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c8238f-d745-4756-934e-f5feae7005bd admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:27:41.407074 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c8238f-d745-4756-934e-f5feae7005bd admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:27:41.411710 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f20849f-0ccf-4e21-abef-42cae4ea0f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:27:41.413003 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f20849f-0ccf-4e21-abef-42cae4ea0f06 admin admin] REQUEST_METHOD: `PUT` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:27:41.413277 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f20849f-0ccf-4e21-abef-42cae4ea0f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:27:41.413593 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f20849f-0ccf-4e21-abef-42cae4ea0f06 admin admin] PATH_INFO: `/v3/projects/ba606b81f4f0450696c0bb0ada561989/users/ea007a22365145bcb11fafa234287e8e/roles/fe9bbc67742f4f5893f39b18eb31d59a` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:27:41.428224 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f20849f-0ccf-4e21-abef-42cae4ea0f06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba606b81f4f0450696c0bb0ada561989, user_id=ea007a22365145bcb11fafa234287e8e, role_id=fe9bbc67742f4f5893f39b18eb31d59a)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:27:41.430901 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f20849f-0ccf-4e21-abef-42cae4ea0f06 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:27:41.443324 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1422/2844] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:27:41 2022] PUT /identity/v3/projects/ba606b81f4f0450696c0bb0ada561989/users/ea007a22365145bcb11fafa234287e8e/roles/fe9bbc67742f4f5893f39b18eb31d59a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:27:41.447417 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3970346f-4c20-4e07-91bb-206bbabe1c0f admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:27:41.457413 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3970346f-4c20-4e07-91bb-206bbabe1c0f admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:27:41.512734 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25645e22-90b5-4633-ad52-ed15311fe8ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:27:41.513259 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25645e22-90b5-4633-ad52-ed15311fe8ea admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:27:41.513564 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25645e22-90b5-4633-ad52-ed15311fe8ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:27:41.513834 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25645e22-90b5-4633-ad52-ed15311fe8ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:27:41.514468 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25645e22-90b5-4633-ad52-ed15311fe8ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:27:41.516043 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25645e22-90b5-4633-ad52-ed15311fe8ea admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:27:41.526008 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1423/2845] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:27:41 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 29 02:27:41.530192 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f20849f-0ccf-4e21-abef-42cae4ea0f06 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:27:41.541212 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f20849f-0ccf-4e21-abef-42cae4ea0f06 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:27:41.545753 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4104cc45-2821-4166-8fad-d8bc91fef1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:27:41.546389 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4104cc45-2821-4166-8fad-d8bc91fef1bb admin admin] REQUEST_METHOD: `PUT` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:27:41.546666 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4104cc45-2821-4166-8fad-d8bc91fef1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:27:41.546936 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4104cc45-2821-4166-8fad-d8bc91fef1bb admin admin] PATH_INFO: `/v3/projects/ba606b81f4f0450696c0bb0ada561989/users/ea007a22365145bcb11fafa234287e8e/roles/fe9bbc67742f4f5893f39b18eb31d59a` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:27:41.548803 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4104cc45-2821-4166-8fad-d8bc91fef1bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba606b81f4f0450696c0bb0ada561989, user_id=ea007a22365145bcb11fafa234287e8e, role_id=fe9bbc67742f4f5893f39b18eb31d59a)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:27:41.551429 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4104cc45-2821-4166-8fad-d8bc91fef1bb admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:27:41.561473 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1423/2846] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:27:41 2022] PUT /identity/v3/projects/ba606b81f4f0450696c0bb0ada561989/users/ea007a22365145bcb11fafa234287e8e/roles/fe9bbc67742f4f5893f39b18eb31d59a => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:27:42.211549 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e820133-b0e5-414a-8314-3fe3c3305ce0 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:27:42.211840 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e820133-b0e5-414a-8314-3fe3c3305ce0 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:27:42.212118 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e820133-b0e5-414a-8314-3fe3c3305ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:27:42.244317 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-3e820133-b0e5-414a-8314-3fe3c3305ce0 None None] MFA Rules not processed for user `ea007a22365145bcb11fafa234287e8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:27:42.245584 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-3e820133-b0e5-414a-8314-3fe3c3305ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:27:42.317576 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1424/2847] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:27:42 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:27:42.763673 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4104cc45-2821-4166-8fad-d8bc91fef1bb admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:27:42.765410 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-4104cc45-2821-4166-8fad-d8bc91fef1bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:27:42.849652 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4104cc45-2821-4166-8fad-d8bc91fef1bb admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:27:42.854774 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1457488-adca-4ba4-bbb2-412215d8d80f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cbb39731a6b42e2a6647d6134b5c7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:27:42.855387 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1457488-adca-4ba4-bbb2-412215d8d80f service placement] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:27:42.855673 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1457488-adca-4ba4-bbb2-412215d8d80f service placement] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:27:42.855954 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1457488-adca-4ba4-bbb2-412215d8d80f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:27:42.857761 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-d1457488-adca-4ba4-bbb2-412215d8d80f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:27:42.870400 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1457488-adca-4ba4-bbb2-412215d8d80f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:27:42.871912 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1457488-adca-4ba4-bbb2-412215d8d80f service placement] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:27:42.883501 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1424/2848] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:27:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:27:43.333234 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e820133-b0e5-414a-8314-3fe3c3305ce0 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:27:43.339470 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:27:43.399065 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e820133-b0e5-414a-8314-3fe3c3305ce0 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:27:43.404557 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a35ceee-9cd1-459c-b6f2-3826c8f624a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:27:43.405195 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a35ceee-9cd1-459c-b6f2-3826c8f624a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:27:43.405501 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a35ceee-9cd1-459c-b6f2-3826c8f624a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:27:43.406080 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a35ceee-9cd1-459c-b6f2-3826c8f624a5 admin admin] PATH_INFO: `/v3/users/01505e9fbaa443dda7edb1bf45d493e3` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:27:43.407231 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a35ceee-9cd1-459c-b6f2-3826c8f624a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01505e9fbaa443dda7edb1bf45d493e3)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:27:43.409159 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a35ceee-9cd1-459c-b6f2-3826c8f624a5 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:27:43.454740 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-6a35ceee-9cd1-459c-b6f2-3826c8f624a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01505e9fbaa443dda7edb1bf45d493e3'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:27:43.455340 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-6a35ceee-9cd1-459c-b6f2-3826c8f624a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01505e9fbaa443dda7edb1bf45d493e3'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:27:43.467616 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-6a35ceee-9cd1-459c-b6f2-3826c8f624a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01505e9fbaa443dda7edb1bf45d493e3'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:27:43.474074 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-6a35ceee-9cd1-459c-b6f2-3826c8f624a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01505e9fbaa443dda7edb1bf45d493e3'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:27:43.474934 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-6a35ceee-9cd1-459c-b6f2-3826c8f624a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01505e9fbaa443dda7edb1bf45d493e3'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:27:43.487488 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1425/2849] 10.222.0.49 () {58 vars in 1224 bytes} [Thu Sep 29 02:27:43 2022] DELETE /identity/v3/users/01505e9fbaa443dda7edb1bf45d493e3 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:27:43.657196 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1457488-adca-4ba4-bbb2-412215d8d80f service placement] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:27:43.673158 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1457488-adca-4ba4-bbb2-412215d8d80f service placement] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:27:43.730751 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1a83e2-eedd-4847-af51-0efcfeb1c629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:27:43.731305 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a83e2-eedd-4847-af51-0efcfeb1c629 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:27:43.731585 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a83e2-eedd-4847-af51-0efcfeb1c629 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:27:43.731857 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a83e2-eedd-4847-af51-0efcfeb1c629 admin admin] PATH_INFO: `/v3/projects/ccf0a817350942a1b0ccd9f0b4038706` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:27:43.732966 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1a83e2-eedd-4847-af51-0efcfeb1c629 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccf0a817350942a1b0ccd9f0b4038706)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:27:43.734938 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1a83e2-eedd-4847-af51-0efcfeb1c629 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:27:43.775285 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:27:43.784093 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-df1a83e2-eedd-4847-af51-0efcfeb1c629 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccf0a817350942a1b0ccd9f0b4038706', 'request_id': 'req-df1a83e2-eedd-4847-af51-0efcfeb1c629'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:27:43.790720 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-df1a83e2-eedd-4847-af51-0efcfeb1c629 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccf0a817350942a1b0ccd9f0b4038706', 'request_id': 'req-df1a83e2-eedd-4847-af51-0efcfeb1c629'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:27:43.797962 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-df1a83e2-eedd-4847-af51-0efcfeb1c629 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccf0a817350942a1b0ccd9f0b4038706', 'request_id': 'req-df1a83e2-eedd-4847-af51-0efcfeb1c629'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:27:43.808793 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-df1a83e2-eedd-4847-af51-0efcfeb1c629 admin admin] The token cache is being invalidate because project ccf0a817350942a1b0ccd9f0b4038706 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81648) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:27:43.809077 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-df1a83e2-eedd-4847-af51-0efcfeb1c629 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:27:43.809725 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-df1a83e2-eedd-4847-af51-0efcfeb1c629 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:27:43.811193 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1425/2850] 10.222.0.49 () {58 vars in 1233 bytes} [Thu Sep 29 02:27:43 2022] DELETE /identity/v3/projects/ccf0a817350942a1b0ccd9f0b4038706 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:27:43.815181 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a35ceee-9cd1-459c-b6f2-3826c8f624a5 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:27:43.816573 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-6a35ceee-9cd1-459c-b6f2-3826c8f624a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:27:43.830195 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a35ceee-9cd1-459c-b6f2-3826c8f624a5 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:27:43.888532 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1836324c-3549-4dae-ad18-2427dfd27581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:27:43.889170 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1836324c-3549-4dae-ad18-2427dfd27581 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:27:43.889651 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1836324c-3549-4dae-ad18-2427dfd27581 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:27:43.889983 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1836324c-3549-4dae-ad18-2427dfd27581 admin admin] PATH_INFO: `/v3/users/ea007a22365145bcb11fafa234287e8e` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:27:43.891107 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1836324c-3549-4dae-ad18-2427dfd27581 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea007a22365145bcb11fafa234287e8e)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:27:43.893003 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1836324c-3549-4dae-ad18-2427dfd27581 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:27:43.922281 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:27:43.941861 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-1836324c-3549-4dae-ad18-2427dfd27581 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea007a22365145bcb11fafa234287e8e'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:27:43.942505 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-1836324c-3549-4dae-ad18-2427dfd27581 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea007a22365145bcb11fafa234287e8e'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:27:43.954364 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-1836324c-3549-4dae-ad18-2427dfd27581 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea007a22365145bcb11fafa234287e8e'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:27:43.962703 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-1836324c-3549-4dae-ad18-2427dfd27581 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea007a22365145bcb11fafa234287e8e'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:27:43.963356 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-1836324c-3549-4dae-ad18-2427dfd27581 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea007a22365145bcb11fafa234287e8e'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:27:43.977247 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1426/2851] 10.222.0.49 () {58 vars in 1224 bytes} [Thu Sep 29 02:27:43 2022] DELETE /identity/v3/users/ea007a22365145bcb11fafa234287e8e => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:27:44.161219 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1a83e2-eedd-4847-af51-0efcfeb1c629 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:27:44.163028 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-df1a83e2-eedd-4847-af51-0efcfeb1c629 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:27:44.185552 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1a83e2-eedd-4847-af51-0efcfeb1c629 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:27:44.243450 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0068ce0-6927-46df-a1d1-c2533c2ddf83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:27:44.244076 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0068ce0-6927-46df-a1d1-c2533c2ddf83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:27:44.244355 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0068ce0-6927-46df-a1d1-c2533c2ddf83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:27:44.244628 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0068ce0-6927-46df-a1d1-c2533c2ddf83 admin admin] PATH_INFO: `/v3/projects/ba606b81f4f0450696c0bb0ada561989` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:27:44.245758 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0068ce0-6927-46df-a1d1-c2533c2ddf83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba606b81f4f0450696c0bb0ada561989)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:27:44.247652 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0068ce0-6927-46df-a1d1-c2533c2ddf83 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:27:44.294548 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-a0068ce0-6927-46df-a1d1-c2533c2ddf83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba606b81f4f0450696c0bb0ada561989', 'request_id': 'req-a0068ce0-6927-46df-a1d1-c2533c2ddf83'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:27:44.300709 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-a0068ce0-6927-46df-a1d1-c2533c2ddf83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba606b81f4f0450696c0bb0ada561989', 'request_id': 'req-a0068ce0-6927-46df-a1d1-c2533c2ddf83'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:27:44.308894 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-a0068ce0-6927-46df-a1d1-c2533c2ddf83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba606b81f4f0450696c0bb0ada561989', 'request_id': 'req-a0068ce0-6927-46df-a1d1-c2533c2ddf83'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:27:44.320106 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-a0068ce0-6927-46df-a1d1-c2533c2ddf83 admin admin] The token cache is being invalidate because project ba606b81f4f0450696c0bb0ada561989 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81648) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:27:44.320393 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-a0068ce0-6927-46df-a1d1-c2533c2ddf83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:27:44.321052 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-a0068ce0-6927-46df-a1d1-c2533c2ddf83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:27:44.322563 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1426/2852] 10.222.0.49 () {58 vars in 1233 bytes} [Thu Sep 29 02:27:44 2022] DELETE /identity/v3/projects/ba606b81f4f0450696c0bb0ada561989 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:27:44.327537 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e63fa8-2614-45ce-aeb5-429313b6067d None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:27:44.327825 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e63fa8-2614-45ce-aeb5-429313b6067d None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:27:44.328101 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e63fa8-2614-45ce-aeb5-429313b6067d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:27:44.348426 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-f7e63fa8-2614-45ce-aeb5-429313b6067d None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:27:44.349692 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-f7e63fa8-2614-45ce-aeb5-429313b6067d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:27:44.408636 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1427/2853] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:27:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:27:44.416316 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c40758-beb7-48dc-9a5f-6b9ccb1370fb None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:27:44.416602 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c40758-beb7-48dc-9a5f-6b9ccb1370fb None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:27:44.416875 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c40758-beb7-48dc-9a5f-6b9ccb1370fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:27:44.436825 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-a4c40758-beb7-48dc-9a5f-6b9ccb1370fb None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:27:44.438080 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-a4c40758-beb7-48dc-9a5f-6b9ccb1370fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:27:44.446933 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1427/2854] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:27:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:27:44.451038 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e63fa8-2614-45ce-aeb5-429313b6067d None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:27:44.460501 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e63fa8-2614-45ce-aeb5-429313b6067d None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:27:44.464969 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e326b433-5681-4661-a878-fe014f0615f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:27:44.465585 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e326b433-5681-4661-a878-fe014f0615f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:27:44.465861 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e326b433-5681-4661-a878-fe014f0615f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:27:44.466128 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e326b433-5681-4661-a878-fe014f0615f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:27:44.466766 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e326b433-5681-4661-a878-fe014f0615f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:27:44.467063 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e326b433-5681-4661-a878-fe014f0615f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:27:44.468631 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e326b433-5681-4661-a878-fe014f0615f8 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:27:44.479889 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1428/2855] 10.222.0.49 () {58 vars in 1153 bytes} [Thu Sep 29 02:27:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:27:44.484100 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c40758-beb7-48dc-9a5f-6b9ccb1370fb None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:27:44.493850 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c40758-beb7-48dc-9a5f-6b9ccb1370fb None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:27:44.498460 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f8698d-6b34-4b01-a2d2-a7f45c0a730d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:27:44.499048 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f8698d-6b34-4b01-a2d2-a7f45c0a730d admin admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:27:44.499327 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f8698d-6b34-4b01-a2d2-a7f45c0a730d admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:27:44.499599 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f8698d-6b34-4b01-a2d2-a7f45c0a730d admin admin] PATH_INFO: `/v3/projects` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:27:44.500218 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f8698d-6b34-4b01-a2d2-a7f45c0a730d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:27:44.502139 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f8698d-6b34-4b01-a2d2-a7f45c0a730d admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:27:44.530837 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1428/2856] 10.222.0.49 () {60 vars in 1153 bytes} [Thu Sep 29 02:27:44 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:27:44.534963 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e326b433-5681-4661-a878-fe014f0615f8 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:27:44.545072 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e326b433-5681-4661-a878-fe014f0615f8 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:27:44.600284 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016d9913-0b64-46fc-b5c8-c863a237bf52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:27:44.601136 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016d9913-0b64-46fc-b5c8-c863a237bf52 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:27:44.601451 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016d9913-0b64-46fc-b5c8-c863a237bf52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:27:44.601723 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016d9913-0b64-46fc-b5c8-c863a237bf52 admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:27:44.602351 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016d9913-0b64-46fc-b5c8-c863a237bf52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:27:44.604250 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016d9913-0b64-46fc-b5c8-c863a237bf52 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:27:44.624697 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1429/2857] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 02:27:44 2022] POST /identity/v3/users => generated 288 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:27:44.628753 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f8698d-6b34-4b01-a2d2-a7f45c0a730d admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:27:44.639808 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f8698d-6b34-4b01-a2d2-a7f45c0a730d admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:27:44.644381 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3c18e1-ba07-4adf-939f-d30111b8156f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:27:44.644970 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c18e1-ba07-4adf-939f-d30111b8156f admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:27:44.645247 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c18e1-ba07-4adf-939f-d30111b8156f admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:27:44.645544 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c18e1-ba07-4adf-939f-d30111b8156f admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:27:44.646180 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3c18e1-ba07-4adf-939f-d30111b8156f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:27:44.647985 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3c18e1-ba07-4adf-939f-d30111b8156f admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:27:44.657986 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1429/2858] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:27:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:27:44.661703 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016d9913-0b64-46fc-b5c8-c863a237bf52 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:27:44.671939 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016d9913-0b64-46fc-b5c8-c863a237bf52 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:27:44.676648 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fb22f2-89f2-4094-adb9-78032ad1a234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:27:44.677231 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb22f2-89f2-4094-adb9-78032ad1a234 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:27:44.677538 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb22f2-89f2-4094-adb9-78032ad1a234 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:27:44.677810 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb22f2-89f2-4094-adb9-78032ad1a234 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:27:44.678447 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fb22f2-89f2-4094-adb9-78032ad1a234 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:27:44.680691 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fb22f2-89f2-4094-adb9-78032ad1a234 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:27:44.691091 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1430/2859] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:27:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:27:44.695939 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3c18e1-ba07-4adf-939f-d30111b8156f admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:27:44.705914 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3c18e1-ba07-4adf-939f-d30111b8156f admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:27:44.710621 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6c5997-a6ad-4da8-b450-22e0d09ff82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:27:44.711291 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6c5997-a6ad-4da8-b450-22e0d09ff82b admin admin] REQUEST_METHOD: `PUT` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:27:44.711623 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6c5997-a6ad-4da8-b450-22e0d09ff82b admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:27:44.711818 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6c5997-a6ad-4da8-b450-22e0d09ff82b admin admin] PATH_INFO: `/v3/projects/2ba144d013d64631942e536bb5e05791/users/2ca9810f23ca40b386ed70cd7d52554a/roles/f157f905c9c94ccfbfb46e52d443e8f2` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:27:44.726994 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6c5997-a6ad-4da8-b450-22e0d09ff82b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ba144d013d64631942e536bb5e05791, user_id=2ca9810f23ca40b386ed70cd7d52554a, role_id=f157f905c9c94ccfbfb46e52d443e8f2)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:27:44.729643 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6c5997-a6ad-4da8-b450-22e0d09ff82b admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:27:44.731821 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:27:44.744415 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1430/2860] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:27:44 2022] PUT /identity/v3/projects/2ba144d013d64631942e536bb5e05791/users/2ca9810f23ca40b386ed70cd7d52554a/roles/f157f905c9c94ccfbfb46e52d443e8f2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:27:44.755749 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d538fca8-2f84-41bb-9dd2-b5eb07b32c6b None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:27:44.756039 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d538fca8-2f84-41bb-9dd2-b5eb07b32c6b None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:27:44.756313 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d538fca8-2f84-41bb-9dd2-b5eb07b32c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:27:44.775513 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:27:44.787570 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-d538fca8-2f84-41bb-9dd2-b5eb07b32c6b None None] MFA Rules not processed for user `2ca9810f23ca40b386ed70cd7d52554a`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:27:44.789518 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-d538fca8-2f84-41bb-9dd2-b5eb07b32c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:27:44.853192 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1431/2861] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:27:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:27:44.857768 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6c5997-a6ad-4da8-b450-22e0d09ff82b admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:27:44.920745 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6c5997-a6ad-4da8-b450-22e0d09ff82b admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:27:44.925419 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb4e2fb-8b85-4cd2-af78-400bf5d43ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:27:44.926023 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb4e2fb-8b85-4cd2-af78-400bf5d43ba2 admin admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:27:44.926302 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb4e2fb-8b85-4cd2-af78-400bf5d43ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:27:44.926581 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb4e2fb-8b85-4cd2-af78-400bf5d43ba2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:27:44.927205 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb4e2fb-8b85-4cd2-af78-400bf5d43ba2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:27:44.929729 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb4e2fb-8b85-4cd2-af78-400bf5d43ba2 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:27:44.955587 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1431/2862] 10.222.0.49 () {60 vars in 1153 bytes} [Thu Sep 29 02:27:44 2022] POST /identity/v3/projects => generated 375 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:27:44.959668 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d538fca8-2f84-41bb-9dd2-b5eb07b32c6b None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:27:44.970294 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d538fca8-2f84-41bb-9dd2-b5eb07b32c6b None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:27:45.027445 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da63ac7b-7cd6-499d-b3f8-93d465d3c51f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:27:45.028043 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da63ac7b-7cd6-499d-b3f8-93d465d3c51f admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:27:45.028318 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da63ac7b-7cd6-499d-b3f8-93d465d3c51f admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:27:45.028586 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da63ac7b-7cd6-499d-b3f8-93d465d3c51f admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:27:45.029200 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da63ac7b-7cd6-499d-b3f8-93d465d3c51f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:27:45.031586 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da63ac7b-7cd6-499d-b3f8-93d465d3c51f admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:27:45.052602 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1432/2863] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 02:27:44 2022] POST /identity/v3/users => generated 294 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:27:45.057350 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb4e2fb-8b85-4cd2-af78-400bf5d43ba2 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:27:45.067543 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb4e2fb-8b85-4cd2-af78-400bf5d43ba2 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:27:45.072387 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db20d5f3-55b1-4f2b-af96-f8cee1fdd9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:27:45.072978 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db20d5f3-55b1-4f2b-af96-f8cee1fdd9fd admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:27:45.073256 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db20d5f3-55b1-4f2b-af96-f8cee1fdd9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:27:45.073556 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db20d5f3-55b1-4f2b-af96-f8cee1fdd9fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:27:45.074228 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db20d5f3-55b1-4f2b-af96-f8cee1fdd9fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:27:45.075811 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db20d5f3-55b1-4f2b-af96-f8cee1fdd9fd admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:27:45.086713 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1432/2864] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:27:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:27:45.090820 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da63ac7b-7cd6-499d-b3f8-93d465d3c51f admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:27:45.101704 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da63ac7b-7cd6-499d-b3f8-93d465d3c51f admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:27:45.106313 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9cc77c-59a6-4e89-8e8c-143b244f0ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:27:45.106892 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9cc77c-59a6-4e89-8e8c-143b244f0ede admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:27:45.107163 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9cc77c-59a6-4e89-8e8c-143b244f0ede admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:27:45.107427 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9cc77c-59a6-4e89-8e8c-143b244f0ede admin admin] PATH_INFO: `/v3/projects/b43d2c3691d142b4ac23b9a481733a69/users/c7ad564c300c48f59fa7c289d62dc6e9/roles/fe9bbc67742f4f5893f39b18eb31d59a` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:27:45.121932 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9cc77c-59a6-4e89-8e8c-143b244f0ede admin admin] RBAC: Authorizing `identity:create_grant(project_id=b43d2c3691d142b4ac23b9a481733a69, user_id=c7ad564c300c48f59fa7c289d62dc6e9, role_id=fe9bbc67742f4f5893f39b18eb31d59a)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:27:45.124537 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9cc77c-59a6-4e89-8e8c-143b244f0ede admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:27:45.137280 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1433/2865] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:27:45 2022] PUT /identity/v3/projects/b43d2c3691d142b4ac23b9a481733a69/users/c7ad564c300c48f59fa7c289d62dc6e9/roles/fe9bbc67742f4f5893f39b18eb31d59a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:27:45.141104 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db20d5f3-55b1-4f2b-af96-f8cee1fdd9fd admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:27:45.151563 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db20d5f3-55b1-4f2b-af96-f8cee1fdd9fd admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:27:45.207315 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c608529f-2d88-4c94-9632-66dedf8a98dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:27:45.207922 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c608529f-2d88-4c94-9632-66dedf8a98dc admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:27:45.208205 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c608529f-2d88-4c94-9632-66dedf8a98dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:27:45.208477 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c608529f-2d88-4c94-9632-66dedf8a98dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:27:45.209126 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c608529f-2d88-4c94-9632-66dedf8a98dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:27:45.210774 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c608529f-2d88-4c94-9632-66dedf8a98dc admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:27:45.220276 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1433/2866] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:27:45 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:27:45.224356 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9cc77c-59a6-4e89-8e8c-143b244f0ede admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:27:45.234553 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9cc77c-59a6-4e89-8e8c-143b244f0ede admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:27:45.239125 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c826743f-1ee5-45fa-ace8-e82bc8c8ff97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:27:45.239761 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826743f-1ee5-45fa-ace8-e82bc8c8ff97 admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:27:45.240034 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826743f-1ee5-45fa-ace8-e82bc8c8ff97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:27:45.240301 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826743f-1ee5-45fa-ace8-e82bc8c8ff97 admin admin] PATH_INFO: `/v3/projects/b43d2c3691d142b4ac23b9a481733a69/users/c7ad564c300c48f59fa7c289d62dc6e9/roles/fe9bbc67742f4f5893f39b18eb31d59a` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:27:45.242802 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c826743f-1ee5-45fa-ace8-e82bc8c8ff97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b43d2c3691d142b4ac23b9a481733a69, user_id=c7ad564c300c48f59fa7c289d62dc6e9, role_id=fe9bbc67742f4f5893f39b18eb31d59a)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:27:45.245418 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c826743f-1ee5-45fa-ace8-e82bc8c8ff97 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:27:45.255512 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1434/2867] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:27:45 2022] PUT /identity/v3/projects/b43d2c3691d142b4ac23b9a481733a69/users/c7ad564c300c48f59fa7c289d62dc6e9/roles/fe9bbc67742f4f5893f39b18eb31d59a => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:27:45.266071 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403052ad-b9e0-41dc-9c83-dd15b1f15db9 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:27:45.266383 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403052ad-b9e0-41dc-9c83-dd15b1f15db9 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:27:45.266659 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403052ad-b9e0-41dc-9c83-dd15b1f15db9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:27:45.294111 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-403052ad-b9e0-41dc-9c83-dd15b1f15db9 None None] MFA Rules not processed for user `c7ad564c300c48f59fa7c289d62dc6e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:27:45.295326 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-403052ad-b9e0-41dc-9c83-dd15b1f15db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:27:45.345248 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:27:45.364117 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1434/2868] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:27:45 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:27:45.375318 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c826743f-1ee5-45fa-ace8-e82bc8c8ff97 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:27:45.377094 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-c826743f-1ee5-45fa-ace8-e82bc8c8ff97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:27:45.435034 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c826743f-1ee5-45fa-ace8-e82bc8c8ff97 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:27:45.438663 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a188e7-f596-456e-a166-79b94c34599a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75135b856134ba4b9ccac337886f682', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:27:45.439258 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a188e7-f596-456e-a166-79b94c34599a service cinder] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:27:45.439535 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a188e7-f596-456e-a166-79b94c34599a service cinder] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:27:45.439803 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a188e7-f596-456e-a166-79b94c34599a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:27:45.443781 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:27:45.497552 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a188e7-f596-456e-a166-79b94c34599a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:27:45.499110 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a188e7-f596-456e-a166-79b94c34599a service cinder] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:27:45.508274 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1435/2869] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:27:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:27:48.064970 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403052ad-b9e0-41dc-9c83-dd15b1f15db9 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:27:48.075040 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403052ad-b9e0-41dc-9c83-dd15b1f15db9 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:27:48.078603 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8732ec55-22b6-4e38-8bd6-f95becf1cc82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75135b856134ba4b9ccac337886f682', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:27:48.079205 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8732ec55-22b6-4e38-8bd6-f95becf1cc82 service cinder] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:27:48.079483 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8732ec55-22b6-4e38-8bd6-f95becf1cc82 service cinder] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:27:48.079751 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8732ec55-22b6-4e38-8bd6-f95becf1cc82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:27:48.089016 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8732ec55-22b6-4e38-8bd6-f95becf1cc82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:27:48.090716 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8732ec55-22b6-4e38-8bd6-f95becf1cc82 service cinder] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:27:48.100213 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1435/2870] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:27:48 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:27:55.504052 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=25 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:27:58.095919 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=11 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:28:00.556372 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a188e7-f596-456e-a166-79b94c34599a service cinder] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:28:00.618548 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a188e7-f596-456e-a166-79b94c34599a service cinder] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:28:00.623991 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5565f2-fddd-4965-a30c-0e81a02ea307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:28:00.624633 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5565f2-fddd-4965-a30c-0e81a02ea307 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:28:00.624916 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5565f2-fddd-4965-a30c-0e81a02ea307 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:28:00.625190 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5565f2-fddd-4965-a30c-0e81a02ea307 admin admin] PATH_INFO: `/v3/users/2ca9810f23ca40b386ed70cd7d52554a` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:28:00.626348 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5565f2-fddd-4965-a30c-0e81a02ea307 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ca9810f23ca40b386ed70cd7d52554a)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:28:00.628248 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5565f2-fddd-4965-a30c-0e81a02ea307 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:28:00.674410 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-ec5565f2-fddd-4965-a30c-0e81a02ea307 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ca9810f23ca40b386ed70cd7d52554a'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:28:00.675052 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-ec5565f2-fddd-4965-a30c-0e81a02ea307 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ca9810f23ca40b386ed70cd7d52554a'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:28:00.687590 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-ec5565f2-fddd-4965-a30c-0e81a02ea307 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ca9810f23ca40b386ed70cd7d52554a'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:28:00.694980 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-ec5565f2-fddd-4965-a30c-0e81a02ea307 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ca9810f23ca40b386ed70cd7d52554a'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:28:00.695654 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-ec5565f2-fddd-4965-a30c-0e81a02ea307 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ca9810f23ca40b386ed70cd7d52554a'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:28:00.709141 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1436/2871] 10.222.0.49 () {58 vars in 1224 bytes} [Thu Sep 29 02:28:00 2022] DELETE /identity/v3/users/2ca9810f23ca40b386ed70cd7d52554a => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:28:00.713979 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d1b37b-cd6b-4ee2-bba7-036915db2d62 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:28:00.714451 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d1b37b-cd6b-4ee2-bba7-036915db2d62 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:28:00.714723 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d1b37b-cd6b-4ee2-bba7-036915db2d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:28:00.735342 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-55d1b37b-cd6b-4ee2-bba7-036915db2d62 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:28:00.736568 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-55d1b37b-cd6b-4ee2-bba7-036915db2d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:28:00.794390 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1436/2872] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:28:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:28:00.804783 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5565f2-fddd-4965-a30c-0e81a02ea307 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:28:00.806241 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-ec5565f2-fddd-4965-a30c-0e81a02ea307 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:28:00.862870 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5565f2-fddd-4965-a30c-0e81a02ea307 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:28:00.866511 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd78902f-b66d-433e-82e4-0b5887e637c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:28:00.867105 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd78902f-b66d-433e-82e4-0b5887e637c2 service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:28:00.867384 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd78902f-b66d-433e-82e4-0b5887e637c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:28:00.867656 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd78902f-b66d-433e-82e4-0b5887e637c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:28:00.876665 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd78902f-b66d-433e-82e4-0b5887e637c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:28:00.878110 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd78902f-b66d-433e-82e4-0b5887e637c2 service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:28:00.887384 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1437/2873] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:28:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:28:01.156945 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d1b37b-cd6b-4ee2-bba7-036915db2d62 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:28:01.158380 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-55d1b37b-cd6b-4ee2-bba7-036915db2d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:28:01.173503 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d1b37b-cd6b-4ee2-bba7-036915db2d62 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:28:01.178789 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cab618f-1f6c-4a18-b9b6-8d40d05b161a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:28:01.179445 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab618f-1f6c-4a18-b9b6-8d40d05b161a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:28:01.179723 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab618f-1f6c-4a18-b9b6-8d40d05b161a admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:28:01.180058 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab618f-1f6c-4a18-b9b6-8d40d05b161a admin admin] PATH_INFO: `/v3/projects/2ba144d013d64631942e536bb5e05791` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:28:01.181572 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cab618f-1f6c-4a18-b9b6-8d40d05b161a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ba144d013d64631942e536bb5e05791)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:28:01.183413 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cab618f-1f6c-4a18-b9b6-8d40d05b161a admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:28:01.231640 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-3cab618f-1f6c-4a18-b9b6-8d40d05b161a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ba144d013d64631942e536bb5e05791', 'request_id': 'req-3cab618f-1f6c-4a18-b9b6-8d40d05b161a'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:28:01.238799 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-3cab618f-1f6c-4a18-b9b6-8d40d05b161a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ba144d013d64631942e536bb5e05791', 'request_id': 'req-3cab618f-1f6c-4a18-b9b6-8d40d05b161a'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:28:01.247338 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-3cab618f-1f6c-4a18-b9b6-8d40d05b161a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ba144d013d64631942e536bb5e05791', 'request_id': 'req-3cab618f-1f6c-4a18-b9b6-8d40d05b161a'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:28:01.258146 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-3cab618f-1f6c-4a18-b9b6-8d40d05b161a admin admin] The token cache is being invalidate because project 2ba144d013d64631942e536bb5e05791 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81648) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:28:01.258441 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-3cab618f-1f6c-4a18-b9b6-8d40d05b161a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:28:01.259067 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-3cab618f-1f6c-4a18-b9b6-8d40d05b161a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:28:01.260551 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1437/2874] 10.222.0.49 () {58 vars in 1233 bytes} [Thu Sep 29 02:28:01 2022] DELETE /identity/v3/projects/2ba144d013d64631942e536bb5e05791 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:28:01.265219 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd78902f-b66d-433e-82e4-0b5887e637c2 service neutron] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:28:01.274737 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd78902f-b66d-433e-82e4-0b5887e637c2 service neutron] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:28:01.292909 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:28:01.333377 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044338b1-a2de-42bc-bdff-89481eacbfd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:28:01.334065 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044338b1-a2de-42bc-bdff-89481eacbfd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:28:01.334283 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044338b1-a2de-42bc-bdff-89481eacbfd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:28:01.334554 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044338b1-a2de-42bc-bdff-89481eacbfd3 admin admin] PATH_INFO: `/v3/users/c7ad564c300c48f59fa7c289d62dc6e9` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:28:01.335692 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044338b1-a2de-42bc-bdff-89481eacbfd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7ad564c300c48f59fa7c289d62dc6e9)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:28:01.337632 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044338b1-a2de-42bc-bdff-89481eacbfd3 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:28:01.381708 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-044338b1-a2de-42bc-bdff-89481eacbfd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7ad564c300c48f59fa7c289d62dc6e9'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:28:01.382347 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-044338b1-a2de-42bc-bdff-89481eacbfd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7ad564c300c48f59fa7c289d62dc6e9'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:28:01.394627 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-044338b1-a2de-42bc-bdff-89481eacbfd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7ad564c300c48f59fa7c289d62dc6e9'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:28:01.401901 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-044338b1-a2de-42bc-bdff-89481eacbfd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7ad564c300c48f59fa7c289d62dc6e9'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:28:01.402503 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-044338b1-a2de-42bc-bdff-89481eacbfd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7ad564c300c48f59fa7c289d62dc6e9'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:28:01.415522 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1438/2875] 10.222.0.49 () {58 vars in 1224 bytes} [Thu Sep 29 02:28:01 2022] DELETE /identity/v3/users/c7ad564c300c48f59fa7c289d62dc6e9 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:28:01.682021 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cab618f-1f6c-4a18-b9b6-8d40d05b161a admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:28:01.683582 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-3cab618f-1f6c-4a18-b9b6-8d40d05b161a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:28:01.697329 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cab618f-1f6c-4a18-b9b6-8d40d05b161a admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:28:01.760685 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0853058f-e7a9-40c7-8afb-58667c0cacd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:28:01.761420 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0853058f-e7a9-40c7-8afb-58667c0cacd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:28:01.761604 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0853058f-e7a9-40c7-8afb-58667c0cacd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:28:01.761871 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0853058f-e7a9-40c7-8afb-58667c0cacd1 admin admin] PATH_INFO: `/v3/projects/b43d2c3691d142b4ac23b9a481733a69` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:28:01.762987 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0853058f-e7a9-40c7-8afb-58667c0cacd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b43d2c3691d142b4ac23b9a481733a69)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:28:01.765475 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0853058f-e7a9-40c7-8afb-58667c0cacd1 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:28:01.794502 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:28:01.812841 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-0853058f-e7a9-40c7-8afb-58667c0cacd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b43d2c3691d142b4ac23b9a481733a69', 'request_id': 'req-0853058f-e7a9-40c7-8afb-58667c0cacd1'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:28:01.818865 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-0853058f-e7a9-40c7-8afb-58667c0cacd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b43d2c3691d142b4ac23b9a481733a69', 'request_id': 'req-0853058f-e7a9-40c7-8afb-58667c0cacd1'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:28:01.825836 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-0853058f-e7a9-40c7-8afb-58667c0cacd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b43d2c3691d142b4ac23b9a481733a69', 'request_id': 'req-0853058f-e7a9-40c7-8afb-58667c0cacd1'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:28:01.836085 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-0853058f-e7a9-40c7-8afb-58667c0cacd1 admin admin] The token cache is being invalidate because project b43d2c3691d142b4ac23b9a481733a69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81648) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:28:01.836368 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-0853058f-e7a9-40c7-8afb-58667c0cacd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:28:01.836975 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-0853058f-e7a9-40c7-8afb-58667c0cacd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:28:01.838432 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1438/2876] 10.222.0.49 () {58 vars in 1233 bytes} [Thu Sep 29 02:28:01 2022] DELETE /identity/v3/projects/b43d2c3691d142b4ac23b9a481733a69 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:28:01.843301 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf8c7d-a727-4cff-aa32-b6edfbcdc3ab None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:28:01.843789 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf8c7d-a727-4cff-aa32-b6edfbcdc3ab None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:28:01.843905 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf8c7d-a727-4cff-aa32-b6edfbcdc3ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:28:01.863623 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-54cf8c7d-a727-4cff-aa32-b6edfbcdc3ab None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:28:01.864779 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-54cf8c7d-a727-4cff-aa32-b6edfbcdc3ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:28:01.923833 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1439/2877] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:28:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:28:01.933500 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99299a71-3ae9-4a81-8e4c-96bc038c887b None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:28:01.933786 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99299a71-3ae9-4a81-8e4c-96bc038c887b None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:28:01.934058 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99299a71-3ae9-4a81-8e4c-96bc038c887b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:28:01.953833 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-99299a71-3ae9-4a81-8e4c-96bc038c887b None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:28:01.955032 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-99299a71-3ae9-4a81-8e4c-96bc038c887b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:28:01.962757 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1439/2878] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:28:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:28:01.967509 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cf8c7d-a727-4cff-aa32-b6edfbcdc3ab None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:28:01.977181 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cf8c7d-a727-4cff-aa32-b6edfbcdc3ab None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:28:01.981667 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7ee3ad-1791-4e27-a752-0d753a09e63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:28:01.982297 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ee3ad-1791-4e27-a752-0d753a09e63b admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:28:01.982568 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ee3ad-1791-4e27-a752-0d753a09e63b admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:28:01.982831 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ee3ad-1791-4e27-a752-0d753a09e63b admin admin] PATH_INFO: `/v3/domains` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:28:01.983473 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7ee3ad-1791-4e27-a752-0d753a09e63b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81649) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:28:01.983770 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7ee3ad-1791-4e27-a752-0d753a09e63b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:28:01.985361 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7ee3ad-1791-4e27-a752-0d753a09e63b admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:28:01.996662 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1440/2879] 10.222.0.49 () {58 vars in 1153 bytes} [Thu Sep 29 02:28:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:28:02.000764 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99299a71-3ae9-4a81-8e4c-96bc038c887b None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:28:02.009887 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99299a71-3ae9-4a81-8e4c-96bc038c887b None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:28:02.015142 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1461e1d-f361-420f-b670-52119fdae4bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:28:02.015719 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1461e1d-f361-420f-b670-52119fdae4bd admin admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:28:02.015994 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1461e1d-f361-420f-b670-52119fdae4bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:28:02.016258 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1461e1d-f361-420f-b670-52119fdae4bd admin admin] PATH_INFO: `/v3/projects` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:28:02.016876 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1461e1d-f361-420f-b670-52119fdae4bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:28:02.018791 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1461e1d-f361-420f-b670-52119fdae4bd admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:28:02.045971 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1440/2880] 10.222.0.49 () {60 vars in 1153 bytes} [Thu Sep 29 02:28:01 2022] POST /identity/v3/projects => generated 387 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:28:02.050098 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7ee3ad-1791-4e27-a752-0d753a09e63b admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:28:02.059939 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7ee3ad-1791-4e27-a752-0d753a09e63b admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:28:02.087627 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:28:02.120102 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a068e5c3-29f7-4910-a338-95efccaf1404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:28:02.120636 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a068e5c3-29f7-4910-a338-95efccaf1404 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:28:02.120910 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a068e5c3-29f7-4910-a338-95efccaf1404 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:28:02.121177 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a068e5c3-29f7-4910-a338-95efccaf1404 admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:28:02.121823 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a068e5c3-29f7-4910-a338-95efccaf1404 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:28:02.123751 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a068e5c3-29f7-4910-a338-95efccaf1404 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:28:02.149605 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1441/2881] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 02:28:02 2022] POST /identity/v3/users => generated 294 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:28:02.153778 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1461e1d-f361-420f-b670-52119fdae4bd admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:28:02.164952 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1461e1d-f361-420f-b670-52119fdae4bd admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:28:02.169858 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed75c391-e531-4f24-a958-98f2b1c1a8c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:28:02.170554 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed75c391-e531-4f24-a958-98f2b1c1a8c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:28:02.170831 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed75c391-e531-4f24-a958-98f2b1c1a8c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:28:02.171101 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed75c391-e531-4f24-a958-98f2b1c1a8c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:28:02.171739 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed75c391-e531-4f24-a958-98f2b1c1a8c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:28:02.173351 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed75c391-e531-4f24-a958-98f2b1c1a8c6 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:28:02.187955 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1441/2882] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:28:02 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:28:02.191949 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a068e5c3-29f7-4910-a338-95efccaf1404 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:28:02.202611 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a068e5c3-29f7-4910-a338-95efccaf1404 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:28:02.207207 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3611e114-8690-4226-aa18-4a235505670b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:28:02.207793 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3611e114-8690-4226-aa18-4a235505670b admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:28:02.208072 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3611e114-8690-4226-aa18-4a235505670b admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:28:02.208342 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3611e114-8690-4226-aa18-4a235505670b admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:28:02.208978 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3611e114-8690-4226-aa18-4a235505670b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:28:02.210584 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3611e114-8690-4226-aa18-4a235505670b admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:28:02.221075 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1442/2883] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:28:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:28:02.225200 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed75c391-e531-4f24-a958-98f2b1c1a8c6 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:28:02.235914 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed75c391-e531-4f24-a958-98f2b1c1a8c6 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:28:02.240650 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eff311-541e-4c01-9b1a-3a7bec854891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:28:02.241475 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eff311-541e-4c01-9b1a-3a7bec854891 admin admin] REQUEST_METHOD: `PUT` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:28:02.241758 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eff311-541e-4c01-9b1a-3a7bec854891 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:28:02.242032 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eff311-541e-4c01-9b1a-3a7bec854891 admin admin] PATH_INFO: `/v3/projects/735f1cc3bd1d437ab727f60bb4907c5c/users/93e03484cccc49a788f297eac236f6ff/roles/f157f905c9c94ccfbfb46e52d443e8f2` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:28:02.257331 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eff311-541e-4c01-9b1a-3a7bec854891 admin admin] RBAC: Authorizing `identity:create_grant(project_id=735f1cc3bd1d437ab727f60bb4907c5c, user_id=93e03484cccc49a788f297eac236f6ff, role_id=f157f905c9c94ccfbfb46e52d443e8f2)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:28:02.259966 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eff311-541e-4c01-9b1a-3a7bec854891 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:28:02.273194 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1442/2884] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:28:02 2022] PUT /identity/v3/projects/735f1cc3bd1d437ab727f60bb4907c5c/users/93e03484cccc49a788f297eac236f6ff/roles/f157f905c9c94ccfbfb46e52d443e8f2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:28:02.284137 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4fa09c-71c9-4380-9db7-0ef02d80e55f None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:28:02.284428 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4fa09c-71c9-4380-9db7-0ef02d80e55f None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:28:02.284703 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4fa09c-71c9-4380-9db7-0ef02d80e55f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:28:02.312421 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-9d4fa09c-71c9-4380-9db7-0ef02d80e55f None None] MFA Rules not processed for user `93e03484cccc49a788f297eac236f6ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:28:02.313786 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-9d4fa09c-71c9-4380-9db7-0ef02d80e55f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:28:02.376576 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1443/2885] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:28:02 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:28:02.381016 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eff311-541e-4c01-9b1a-3a7bec854891 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:28:02.445562 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eff311-541e-4c01-9b1a-3a7bec854891 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:28:02.450222 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db097d6-4832-4709-9e41-d4ebfce218a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:28:02.450826 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db097d6-4832-4709-9e41-d4ebfce218a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:28:02.451155 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db097d6-4832-4709-9e41-d4ebfce218a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:28:02.451670 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db097d6-4832-4709-9e41-d4ebfce218a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:28:02.452345 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db097d6-4832-4709-9e41-d4ebfce218a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:28:02.454312 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db097d6-4832-4709-9e41-d4ebfce218a1 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:28:02.481729 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1443/2886] 10.222.0.49 () {60 vars in 1153 bytes} [Thu Sep 29 02:28:02 2022] POST /identity/v3/projects => generated 387 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:28:02.486515 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4fa09c-71c9-4380-9db7-0ef02d80e55f None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:28:02.497081 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4fa09c-71c9-4380-9db7-0ef02d80e55f None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:28:02.552556 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073fb78c-6a98-42e4-a3ad-91f341bb4cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:28:02.553156 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073fb78c-6a98-42e4-a3ad-91f341bb4cf6 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:28:02.553466 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073fb78c-6a98-42e4-a3ad-91f341bb4cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:28:02.553744 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073fb78c-6a98-42e4-a3ad-91f341bb4cf6 admin admin] PATH_INFO: `/v3/users` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:28:02.554373 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073fb78c-6a98-42e4-a3ad-91f341bb4cf6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:28:02.556269 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073fb78c-6a98-42e4-a3ad-91f341bb4cf6 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:28:02.577435 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1444/2887] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 02:28:02 2022] POST /identity/v3/users => generated 300 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 29 02:28:02.581690 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db097d6-4832-4709-9e41-d4ebfce218a1 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:28:02.592611 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db097d6-4832-4709-9e41-d4ebfce218a1 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:28:02.597217 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bca3f9-995d-4bd7-bc68-399c61fd1444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:28:02.597833 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bca3f9-995d-4bd7-bc68-399c61fd1444 admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:28:02.598109 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bca3f9-995d-4bd7-bc68-399c61fd1444 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:28:02.598377 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bca3f9-995d-4bd7-bc68-399c61fd1444 admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:28:02.599035 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bca3f9-995d-4bd7-bc68-399c61fd1444 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:28:02.600609 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bca3f9-995d-4bd7-bc68-399c61fd1444 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:28:02.611511 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1444/2888] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:28:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:28:02.615564 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073fb78c-6a98-42e4-a3ad-91f341bb4cf6 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:28:02.625541 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073fb78c-6a98-42e4-a3ad-91f341bb4cf6 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:28:02.630149 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd9e4ec-e4f4-42b0-8989-28cb6cd6f3fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:28:02.630722 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd9e4ec-e4f4-42b0-8989-28cb6cd6f3fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:28:02.630995 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd9e4ec-e4f4-42b0-8989-28cb6cd6f3fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:28:02.631262 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd9e4ec-e4f4-42b0-8989-28cb6cd6f3fb admin admin] PATH_INFO: `/v3/projects/051fd1d72cc54aa795bb4d6653084797/users/d79e1638209e407a924f78cad2b7474d/roles/fe9bbc67742f4f5893f39b18eb31d59a` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:28:02.646498 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd9e4ec-e4f4-42b0-8989-28cb6cd6f3fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=051fd1d72cc54aa795bb4d6653084797, user_id=d79e1638209e407a924f78cad2b7474d, role_id=fe9bbc67742f4f5893f39b18eb31d59a)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:28:02.649131 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd9e4ec-e4f4-42b0-8989-28cb6cd6f3fb admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:28:02.663227 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1445/2889] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:28:02 2022] PUT /identity/v3/projects/051fd1d72cc54aa795bb4d6653084797/users/d79e1638209e407a924f78cad2b7474d/roles/fe9bbc67742f4f5893f39b18eb31d59a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:28:02.667259 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bca3f9-995d-4bd7-bc68-399c61fd1444 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:28:02.677244 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bca3f9-995d-4bd7-bc68-399c61fd1444 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:28:02.696688 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:28:02.736565 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2bc9c0-d0bb-4975-b222-d44fcb2de92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:28:02.737171 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2bc9c0-d0bb-4975-b222-d44fcb2de92b admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:28:02.737514 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2bc9c0-d0bb-4975-b222-d44fcb2de92b admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:28:02.737790 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2bc9c0-d0bb-4975-b222-d44fcb2de92b admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:28:02.738434 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2bc9c0-d0bb-4975-b222-d44fcb2de92b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:28:02.740076 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2bc9c0-d0bb-4975-b222-d44fcb2de92b admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:28:02.750144 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1445/2890] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:28:02 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:28:02.754237 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd9e4ec-e4f4-42b0-8989-28cb6cd6f3fb admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:28:02.759684 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:28:02.766634 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd9e4ec-e4f4-42b0-8989-28cb6cd6f3fb admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:28:02.771455 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46e73ca-23bf-4374-92d4-76dc7c356e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:28:02.772094 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46e73ca-23bf-4374-92d4-76dc7c356e54 admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:28:02.772368 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46e73ca-23bf-4374-92d4-76dc7c356e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:28:02.772634 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46e73ca-23bf-4374-92d4-76dc7c356e54 admin admin] PATH_INFO: `/v3/projects/051fd1d72cc54aa795bb4d6653084797/users/d79e1638209e407a924f78cad2b7474d/roles/fe9bbc67742f4f5893f39b18eb31d59a` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:28:02.774510 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46e73ca-23bf-4374-92d4-76dc7c356e54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=051fd1d72cc54aa795bb4d6653084797, user_id=d79e1638209e407a924f78cad2b7474d, role_id=fe9bbc67742f4f5893f39b18eb31d59a)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:28:02.777106 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46e73ca-23bf-4374-92d4-76dc7c356e54 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:28:02.788233 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1446/2891] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:28:02 2022] PUT /identity/v3/projects/051fd1d72cc54aa795bb4d6653084797/users/d79e1638209e407a924f78cad2b7474d/roles/fe9bbc67742f4f5893f39b18eb31d59a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:28:02.798718 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4239a33-dad1-408c-8a10-6b4325be8ae1 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:28:02.799228 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4239a33-dad1-408c-8a10-6b4325be8ae1 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:28:02.799338 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4239a33-dad1-408c-8a10-6b4325be8ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:28:02.827233 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-e4239a33-dad1-408c-8a10-6b4325be8ae1 None None] MFA Rules not processed for user `d79e1638209e407a924f78cad2b7474d`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:28:02.828432 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-e4239a33-dad1-408c-8a10-6b4325be8ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:28:02.895578 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1446/2892] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:28:02 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:28:02.907297 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46e73ca-23bf-4374-92d4-76dc7c356e54 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:28:02.909067 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-f46e73ca-23bf-4374-92d4-76dc7c356e54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:28:02.965132 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46e73ca-23bf-4374-92d4-76dc7c356e54 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:28:02.968862 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c878701e-7402-4fe2-8c81-cc73ced517a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75135b856134ba4b9ccac337886f682', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:28:02.969481 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c878701e-7402-4fe2-8c81-cc73ced517a1 service cinder] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:28:02.969757 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c878701e-7402-4fe2-8c81-cc73ced517a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:28:02.970025 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c878701e-7402-4fe2-8c81-cc73ced517a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:28:02.978791 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c878701e-7402-4fe2-8c81-cc73ced517a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:28:02.980185 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c878701e-7402-4fe2-8c81-cc73ced517a1 service cinder] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:28:02.989625 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1447/2893] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:28:02 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:28:03.122297 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4239a33-dad1-408c-8a10-6b4325be8ae1 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:28:03.184048 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4239a33-dad1-408c-8a10-6b4325be8ae1 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:28:03.189126 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b0aa49-78ef-4df5-932e-3c625be014bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:28:03.189782 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b0aa49-78ef-4df5-932e-3c625be014bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:28:03.190058 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b0aa49-78ef-4df5-932e-3c625be014bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:28:03.190327 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b0aa49-78ef-4df5-932e-3c625be014bc admin admin] PATH_INFO: `/v3/users/93e03484cccc49a788f297eac236f6ff` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:28:03.191433 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b0aa49-78ef-4df5-932e-3c625be014bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=93e03484cccc49a788f297eac236f6ff)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:28:03.193363 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b0aa49-78ef-4df5-932e-3c625be014bc admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:28:03.244540 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-d6b0aa49-78ef-4df5-932e-3c625be014bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93e03484cccc49a788f297eac236f6ff'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:28:03.245179 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-d6b0aa49-78ef-4df5-932e-3c625be014bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93e03484cccc49a788f297eac236f6ff'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:28:03.246335 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:28:03.259021 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-d6b0aa49-78ef-4df5-932e-3c625be014bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93e03484cccc49a788f297eac236f6ff'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:28:03.266547 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-d6b0aa49-78ef-4df5-932e-3c625be014bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93e03484cccc49a788f297eac236f6ff'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:28:03.267242 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-d6b0aa49-78ef-4df5-932e-3c625be014bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93e03484cccc49a788f297eac236f6ff'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:28:03.279339 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1447/2894] 10.222.0.49 () {58 vars in 1224 bytes} [Thu Sep 29 02:28:03 2022] DELETE /identity/v3/users/93e03484cccc49a788f297eac236f6ff => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:28:03.284045 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55186176-9014-4f78-8b57-63a22c0df45f None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:28:03.284326 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55186176-9014-4f78-8b57-63a22c0df45f None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:28:03.284595 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55186176-9014-4f78-8b57-63a22c0df45f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:28:03.303543 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-55186176-9014-4f78-8b57-63a22c0df45f None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:28:03.304724 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-55186176-9014-4f78-8b57-63a22c0df45f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:28:03.362139 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1448/2895] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:28:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:28:03.371756 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b0aa49-78ef-4df5-932e-3c625be014bc admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:28:03.373801 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-d6b0aa49-78ef-4df5-932e-3c625be014bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:28:03.430374 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b0aa49-78ef-4df5-932e-3c625be014bc admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:28:03.434176 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce366478-66c5-43ba-9964-6b9139256d4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:28:03.434729 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce366478-66c5-43ba-9964-6b9139256d4d service neutron] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:28:03.435012 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce366478-66c5-43ba-9964-6b9139256d4d service neutron] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:28:03.435278 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce366478-66c5-43ba-9964-6b9139256d4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:28:03.445141 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce366478-66c5-43ba-9964-6b9139256d4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:28:03.446607 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce366478-66c5-43ba-9964-6b9139256d4d service neutron] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:28:03.456188 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1448/2896] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:28:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:28:03.717479 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55186176-9014-4f78-8b57-63a22c0df45f None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:28:03.719426 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-55186176-9014-4f78-8b57-63a22c0df45f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:28:03.733529 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55186176-9014-4f78-8b57-63a22c0df45f None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:28:03.738290 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9adf88-447c-405d-a35a-e763bb062e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:28:03.738936 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9adf88-447c-405d-a35a-e763bb062e41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:28:03.740129 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9adf88-447c-405d-a35a-e763bb062e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:28:03.740418 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9adf88-447c-405d-a35a-e763bb062e41 admin admin] PATH_INFO: `/v3/projects/735f1cc3bd1d437ab727f60bb4907c5c` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:28:03.741709 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9adf88-447c-405d-a35a-e763bb062e41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=735f1cc3bd1d437ab727f60bb4907c5c)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:28:03.743525 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9adf88-447c-405d-a35a-e763bb062e41 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:28:03.790585 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-0d9adf88-447c-405d-a35a-e763bb062e41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '735f1cc3bd1d437ab727f60bb4907c5c', 'request_id': 'req-0d9adf88-447c-405d-a35a-e763bb062e41'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:28:03.797535 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-0d9adf88-447c-405d-a35a-e763bb062e41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '735f1cc3bd1d437ab727f60bb4907c5c', 'request_id': 'req-0d9adf88-447c-405d-a35a-e763bb062e41'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:28:03.804737 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-0d9adf88-447c-405d-a35a-e763bb062e41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '735f1cc3bd1d437ab727f60bb4907c5c', 'request_id': 'req-0d9adf88-447c-405d-a35a-e763bb062e41'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:28:03.815695 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-0d9adf88-447c-405d-a35a-e763bb062e41 admin admin] The token cache is being invalidate because project 735f1cc3bd1d437ab727f60bb4907c5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81649) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:28:03.815984 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-0d9adf88-447c-405d-a35a-e763bb062e41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:28:03.816609 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-0d9adf88-447c-405d-a35a-e763bb062e41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:28:03.818110 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1449/2897] 10.222.0.49 () {58 vars in 1233 bytes} [Thu Sep 29 02:28:03 2022] DELETE /identity/v3/projects/735f1cc3bd1d437ab727f60bb4907c5c => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:28:03.822124 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce366478-66c5-43ba-9964-6b9139256d4d service neutron] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:28:03.831671 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce366478-66c5-43ba-9964-6b9139256d4d service neutron] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:28:03.889710 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990a0da8-36b3-4cd9-aef9-812c4d3fad49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:28:03.890341 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990a0da8-36b3-4cd9-aef9-812c4d3fad49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:28:03.890619 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990a0da8-36b3-4cd9-aef9-812c4d3fad49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:28:03.890891 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990a0da8-36b3-4cd9-aef9-812c4d3fad49 admin admin] PATH_INFO: `/v3/users/d79e1638209e407a924f78cad2b7474d` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:28:03.891996 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990a0da8-36b3-4cd9-aef9-812c4d3fad49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d79e1638209e407a924f78cad2b7474d)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:28:03.893948 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990a0da8-36b3-4cd9-aef9-812c4d3fad49 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:28:03.940750 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-990a0da8-36b3-4cd9-aef9-812c4d3fad49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd79e1638209e407a924f78cad2b7474d'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:28:03.941429 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-990a0da8-36b3-4cd9-aef9-812c4d3fad49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd79e1638209e407a924f78cad2b7474d'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:28:03.954219 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-990a0da8-36b3-4cd9-aef9-812c4d3fad49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd79e1638209e407a924f78cad2b7474d'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:28:03.958384 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:28:03.962230 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-990a0da8-36b3-4cd9-aef9-812c4d3fad49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd79e1638209e407a924f78cad2b7474d'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:28:03.963322 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-990a0da8-36b3-4cd9-aef9-812c4d3fad49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd79e1638209e407a924f78cad2b7474d'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:28:03.977247 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1449/2898] 10.222.0.49 () {58 vars in 1224 bytes} [Thu Sep 29 02:28:03 2022] DELETE /identity/v3/users/d79e1638209e407a924f78cad2b7474d => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:28:04.244869 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9adf88-447c-405d-a35a-e763bb062e41 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:28:04.246599 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-0d9adf88-447c-405d-a35a-e763bb062e41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:28:04.265774 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9adf88-447c-405d-a35a-e763bb062e41 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:28:04.277535 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:28:04.323516 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692d1951-7d32-445e-bd86-454cd23f15f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:28:04.324142 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692d1951-7d32-445e-bd86-454cd23f15f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:28:04.324420 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692d1951-7d32-445e-bd86-454cd23f15f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:28:04.324691 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692d1951-7d32-445e-bd86-454cd23f15f6 admin admin] PATH_INFO: `/v3/projects/051fd1d72cc54aa795bb4d6653084797` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:28:04.325839 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692d1951-7d32-445e-bd86-454cd23f15f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=051fd1d72cc54aa795bb4d6653084797)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:28:04.328342 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692d1951-7d32-445e-bd86-454cd23f15f6 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:28:04.373928 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-692d1951-7d32-445e-bd86-454cd23f15f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '051fd1d72cc54aa795bb4d6653084797', 'request_id': 'req-692d1951-7d32-445e-bd86-454cd23f15f6'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:28:04.379878 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-692d1951-7d32-445e-bd86-454cd23f15f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '051fd1d72cc54aa795bb4d6653084797', 'request_id': 'req-692d1951-7d32-445e-bd86-454cd23f15f6'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:28:04.386924 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-692d1951-7d32-445e-bd86-454cd23f15f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '051fd1d72cc54aa795bb4d6653084797', 'request_id': 'req-692d1951-7d32-445e-bd86-454cd23f15f6'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:28:04.397841 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-692d1951-7d32-445e-bd86-454cd23f15f6 admin admin] The token cache is being invalidate because project 051fd1d72cc54aa795bb4d6653084797 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81649) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:28:04.398127 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-692d1951-7d32-445e-bd86-454cd23f15f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:28:04.398754 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-692d1951-7d32-445e-bd86-454cd23f15f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:28:04.400211 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1450/2899] 10.222.0.49 () {58 vars in 1233 bytes} [Thu Sep 29 02:28:04 2022] DELETE /identity/v3/projects/051fd1d72cc54aa795bb4d6653084797 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:28:04.405880 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1850be9-bf94-4bf2-b8ef-5e1ae5adc497 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:28:04.406454 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1850be9-bf94-4bf2-b8ef-5e1ae5adc497 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:28:04.406719 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1850be9-bf94-4bf2-b8ef-5e1ae5adc497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:28:04.426272 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-b1850be9-bf94-4bf2-b8ef-5e1ae5adc497 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:28:04.427492 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-b1850be9-bf94-4bf2-b8ef-5e1ae5adc497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:28:04.485237 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1450/2900] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:28:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:28:04.546574 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7898002b-df19-4bce-8a5b-c69d2cdfc529 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:28:04.546813 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7898002b-df19-4bce-8a5b-c69d2cdfc529 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:28:04.547052 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7898002b-df19-4bce-8a5b-c69d2cdfc529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:28:04.566977 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-7898002b-df19-4bce-8a5b-c69d2cdfc529 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:28:04.568168 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-7898002b-df19-4bce-8a5b-c69d2cdfc529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:28:04.576548 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1451/2901] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:28:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:28:04.580615 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1850be9-bf94-4bf2-b8ef-5e1ae5adc497 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:28:04.590466 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1850be9-bf94-4bf2-b8ef-5e1ae5adc497 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:28:04.594957 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0936773-a1c5-48ee-a511-d43109f75e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:28:04.595544 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0936773-a1c5-48ee-a511-d43109f75e15 admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:28:04.595823 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0936773-a1c5-48ee-a511-d43109f75e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:28:04.596091 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0936773-a1c5-48ee-a511-d43109f75e15 admin admin] PATH_INFO: `/v3/domains` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:28:04.596751 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0936773-a1c5-48ee-a511-d43109f75e15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:28:04.597047 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0936773-a1c5-48ee-a511-d43109f75e15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:28:04.598814 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0936773-a1c5-48ee-a511-d43109f75e15 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:28:04.610068 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1451/2902] 10.222.0.49 () {58 vars in 1153 bytes} [Thu Sep 29 02:28:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:28:04.614095 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7898002b-df19-4bce-8a5b-c69d2cdfc529 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:28:04.623833 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7898002b-df19-4bce-8a5b-c69d2cdfc529 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:28:04.628566 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01341d70-9f4a-46dd-9e14-41efb576d6d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:28:04.629153 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01341d70-9f4a-46dd-9e14-41efb576d6d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:28:04.629461 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01341d70-9f4a-46dd-9e14-41efb576d6d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:28:04.629729 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01341d70-9f4a-46dd-9e14-41efb576d6d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:28:04.630368 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01341d70-9f4a-46dd-9e14-41efb576d6d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:28:04.632270 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01341d70-9f4a-46dd-9e14-41efb576d6d9 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:28:04.659918 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1452/2903] 10.222.0.49 () {60 vars in 1153 bytes} [Thu Sep 29 02:28:04 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:28:04.663989 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0936773-a1c5-48ee-a511-d43109f75e15 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:28:04.673708 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0936773-a1c5-48ee-a511-d43109f75e15 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:28:04.730460 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6840cc-593c-4c4f-9160-6859a5fd9bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:28:04.731067 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6840cc-593c-4c4f-9160-6859a5fd9bb3 admin admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:28:04.731349 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6840cc-593c-4c4f-9160-6859a5fd9bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:28:04.731621 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6840cc-593c-4c4f-9160-6859a5fd9bb3 admin admin] PATH_INFO: `/v3/users` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:28:04.732280 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6840cc-593c-4c4f-9160-6859a5fd9bb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:28:04.734229 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6840cc-593c-4c4f-9160-6859a5fd9bb3 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:28:04.755851 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1452/2904] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 02:28:04 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:28:04.760114 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01341d70-9f4a-46dd-9e14-41efb576d6d9 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:28:04.771181 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01341d70-9f4a-46dd-9e14-41efb576d6d9 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:28:04.775875 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1b1740-0a2b-40d0-b8db-f76121e19982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:28:04.776470 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b1740-0a2b-40d0-b8db-f76121e19982 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:28:04.776746 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b1740-0a2b-40d0-b8db-f76121e19982 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:28:04.777015 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b1740-0a2b-40d0-b8db-f76121e19982 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:28:04.777690 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1b1740-0a2b-40d0-b8db-f76121e19982 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:28:04.779279 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1b1740-0a2b-40d0-b8db-f76121e19982 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:28:04.789671 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1453/2905] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:28:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:28:04.793577 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6840cc-593c-4c4f-9160-6859a5fd9bb3 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:28:04.803883 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6840cc-593c-4c4f-9160-6859a5fd9bb3 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:28:04.808499 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e89f66-c301-414b-a542-059b0f9bda42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:28:04.809087 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e89f66-c301-414b-a542-059b0f9bda42 admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:28:04.809400 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e89f66-c301-414b-a542-059b0f9bda42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:28:04.809677 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e89f66-c301-414b-a542-059b0f9bda42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:28:04.810346 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e89f66-c301-414b-a542-059b0f9bda42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:28:04.812656 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e89f66-c301-414b-a542-059b0f9bda42 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:28:04.823133 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1453/2906] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:28:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:28:04.827164 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1b1740-0a2b-40d0-b8db-f76121e19982 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:28:04.837031 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1b1740-0a2b-40d0-b8db-f76121e19982 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:28:04.841704 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6480a68c-3f1b-4543-ad06-4fbdfb69c01a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:28:04.842337 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6480a68c-3f1b-4543-ad06-4fbdfb69c01a admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:28:04.842611 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6480a68c-3f1b-4543-ad06-4fbdfb69c01a admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:28:04.842882 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6480a68c-3f1b-4543-ad06-4fbdfb69c01a admin admin] PATH_INFO: `/v3/projects/5143aff4489440fa9adf9c64125f09bf/users/0910a1b88a99431d8408f562d614df6b/roles/f157f905c9c94ccfbfb46e52d443e8f2` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:28:04.856949 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6480a68c-3f1b-4543-ad06-4fbdfb69c01a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5143aff4489440fa9adf9c64125f09bf, user_id=0910a1b88a99431d8408f562d614df6b, role_id=f157f905c9c94ccfbfb46e52d443e8f2)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:28:04.860110 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6480a68c-3f1b-4543-ad06-4fbdfb69c01a admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:28:04.872578 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1454/2907] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:28:04 2022] PUT /identity/v3/projects/5143aff4489440fa9adf9c64125f09bf/users/0910a1b88a99431d8408f562d614df6b/roles/f157f905c9c94ccfbfb46e52d443e8f2 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:28:04.882974 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bfe916-413b-4a78-85fa-092515f0da73 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:28:04.883258 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bfe916-413b-4a78-85fa-092515f0da73 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:28:04.883529 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bfe916-413b-4a78-85fa-092515f0da73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:28:04.912990 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-74bfe916-413b-4a78-85fa-092515f0da73 None None] MFA Rules not processed for user `0910a1b88a99431d8408f562d614df6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:28:04.914231 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-74bfe916-413b-4a78-85fa-092515f0da73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:28:04.955352 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:28:04.978812 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1454/2908] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:28:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 29 02:28:04.984125 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6480a68c-3f1b-4543-ad06-4fbdfb69c01a admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:28:05.029645 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:28:05.049168 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6480a68c-3f1b-4543-ad06-4fbdfb69c01a admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:28:05.053800 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedee17f-25d4-4d8a-a37a-00422c48bf28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:28:05.054441 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedee17f-25d4-4d8a-a37a-00422c48bf28 admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:28:05.054663 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedee17f-25d4-4d8a-a37a-00422c48bf28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:28:05.054930 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedee17f-25d4-4d8a-a37a-00422c48bf28 admin admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:28:05.055556 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedee17f-25d4-4d8a-a37a-00422c48bf28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:28:05.057456 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedee17f-25d4-4d8a-a37a-00422c48bf28 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:28:05.083398 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1455/2909] 10.222.0.49 () {60 vars in 1153 bytes} [Thu Sep 29 02:28:04 2022] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:28:05.087466 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bfe916-413b-4a78-85fa-092515f0da73 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:28:05.098540 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bfe916-413b-4a78-85fa-092515f0da73 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:28:05.154927 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18acaeb-cb79-4a31-b7f4-191fdd8e1e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:28:05.155532 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18acaeb-cb79-4a31-b7f4-191fdd8e1e05 admin admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:28:05.155810 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18acaeb-cb79-4a31-b7f4-191fdd8e1e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:28:05.156078 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18acaeb-cb79-4a31-b7f4-191fdd8e1e05 admin admin] PATH_INFO: `/v3/users` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:28:05.156951 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18acaeb-cb79-4a31-b7f4-191fdd8e1e05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:28:05.158885 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18acaeb-cb79-4a31-b7f4-191fdd8e1e05 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:28:05.179972 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1455/2910] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 02:28:05 2022] POST /identity/v3/users => generated 299 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:28:05.184117 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedee17f-25d4-4d8a-a37a-00422c48bf28 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:28:05.194944 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedee17f-25d4-4d8a-a37a-00422c48bf28 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:28:05.199545 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9645ffbc-284e-446a-a6b4-b4de68107184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:28:05.200127 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9645ffbc-284e-446a-a6b4-b4de68107184 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:28:05.200407 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9645ffbc-284e-446a-a6b4-b4de68107184 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:28:05.200676 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9645ffbc-284e-446a-a6b4-b4de68107184 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:28:05.201536 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9645ffbc-284e-446a-a6b4-b4de68107184 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:28:05.203118 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9645ffbc-284e-446a-a6b4-b4de68107184 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:28:05.213623 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1456/2911] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:28:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:28:05.218171 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18acaeb-cb79-4a31-b7f4-191fdd8e1e05 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:28:05.228116 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18acaeb-cb79-4a31-b7f4-191fdd8e1e05 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:28:05.233286 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179ad7d5-1193-438b-aeb4-f2a3f8c77b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:28:05.233973 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179ad7d5-1193-438b-aeb4-f2a3f8c77b54 admin admin] REQUEST_METHOD: `PUT` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:28:05.234250 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179ad7d5-1193-438b-aeb4-f2a3f8c77b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:28:05.234537 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179ad7d5-1193-438b-aeb4-f2a3f8c77b54 admin admin] PATH_INFO: `/v3/projects/78f23ec66aba4f11a1ece35043953105/users/42fa994f6838453a88fb19b1f6fd86bc/roles/fe9bbc67742f4f5893f39b18eb31d59a` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:28:05.248854 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179ad7d5-1193-438b-aeb4-f2a3f8c77b54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78f23ec66aba4f11a1ece35043953105, user_id=42fa994f6838453a88fb19b1f6fd86bc, role_id=fe9bbc67742f4f5893f39b18eb31d59a)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:28:05.251497 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179ad7d5-1193-438b-aeb4-f2a3f8c77b54 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:28:05.265150 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1456/2912] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:28:05 2022] PUT /identity/v3/projects/78f23ec66aba4f11a1ece35043953105/users/42fa994f6838453a88fb19b1f6fd86bc/roles/fe9bbc67742f4f5893f39b18eb31d59a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:28:05.269080 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9645ffbc-284e-446a-a6b4-b4de68107184 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:28:05.278950 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9645ffbc-284e-446a-a6b4-b4de68107184 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:28:05.337218 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52398e69-5e14-4681-a978-4b6c07649929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:28:05.337785 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52398e69-5e14-4681-a978-4b6c07649929 admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:28:05.338067 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52398e69-5e14-4681-a978-4b6c07649929 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:28:05.338341 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52398e69-5e14-4681-a978-4b6c07649929 admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:28:05.339007 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52398e69-5e14-4681-a978-4b6c07649929 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:28:05.340602 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52398e69-5e14-4681-a978-4b6c07649929 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:28:05.351003 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1457/2913] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:28:05 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:28:05.355052 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179ad7d5-1193-438b-aeb4-f2a3f8c77b54 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:28:05.366237 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179ad7d5-1193-438b-aeb4-f2a3f8c77b54 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:28:05.370845 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72663cf7-5336-44e0-bf02-2b7c5ab2c816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:28:05.371486 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72663cf7-5336-44e0-bf02-2b7c5ab2c816 admin admin] REQUEST_METHOD: `PUT` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:28:05.371765 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72663cf7-5336-44e0-bf02-2b7c5ab2c816 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:28:05.372041 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72663cf7-5336-44e0-bf02-2b7c5ab2c816 admin admin] PATH_INFO: `/v3/projects/78f23ec66aba4f11a1ece35043953105/users/42fa994f6838453a88fb19b1f6fd86bc/roles/fe9bbc67742f4f5893f39b18eb31d59a` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:28:05.374268 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72663cf7-5336-44e0-bf02-2b7c5ab2c816 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78f23ec66aba4f11a1ece35043953105, user_id=42fa994f6838453a88fb19b1f6fd86bc, role_id=fe9bbc67742f4f5893f39b18eb31d59a)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:28:05.376887 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72663cf7-5336-44e0-bf02-2b7c5ab2c816 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:28:05.386979 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1457/2914] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:28:05 2022] PUT /identity/v3/projects/78f23ec66aba4f11a1ece35043953105/users/42fa994f6838453a88fb19b1f6fd86bc/roles/fe9bbc67742f4f5893f39b18eb31d59a => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:28:05.398455 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9498c927-44d3-4f0e-9a98-f0d35435a34c None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:28:05.398742 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9498c927-44d3-4f0e-9a98-f0d35435a34c None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:28:05.399013 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9498c927-44d3-4f0e-9a98-f0d35435a34c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:28:05.427610 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-9498c927-44d3-4f0e-9a98-f0d35435a34c None None] MFA Rules not processed for user `42fa994f6838453a88fb19b1f6fd86bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:28:05.428810 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-9498c927-44d3-4f0e-9a98-f0d35435a34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:28:05.495177 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1458/2915] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:28:05 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:28:05.506381 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72663cf7-5336-44e0-bf02-2b7c5ab2c816 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:28:05.508048 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-72663cf7-5336-44e0-bf02-2b7c5ab2c816 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:28:05.565294 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72663cf7-5336-44e0-bf02-2b7c5ab2c816 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:28:05.568866 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc07ca4-cd31-4063-8906-5c7ca385eb6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75135b856134ba4b9ccac337886f682', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:28:05.569491 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc07ca4-cd31-4063-8906-5c7ca385eb6c service cinder] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:28:05.569767 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc07ca4-cd31-4063-8906-5c7ca385eb6c service cinder] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:28:05.570035 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc07ca4-cd31-4063-8906-5c7ca385eb6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:28:05.616006 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:28:05.626403 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc07ca4-cd31-4063-8906-5c7ca385eb6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:28:05.627818 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc07ca4-cd31-4063-8906-5c7ca385eb6c service cinder] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:28:05.636476 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1458/2916] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:28:05 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:28:10.051625 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9498c927-44d3-4f0e-9a98-f0d35435a34c None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:28:10.053000 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-9498c927-44d3-4f0e-9a98-f0d35435a34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:28:10.065657 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9498c927-44d3-4f0e-9a98-f0d35435a34c None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:28:10.069110 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae61bd8-9ac3-45da-8057-6452a6d110f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75135b856134ba4b9ccac337886f682', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:28:10.069737 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae61bd8-9ac3-45da-8057-6452a6d110f1 service cinder] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:28:10.070013 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae61bd8-9ac3-45da-8057-6452a6d110f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:28:10.070280 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae61bd8-9ac3-45da-8057-6452a6d110f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:28:10.079350 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae61bd8-9ac3-45da-8057-6452a6d110f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:28:10.080749 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae61bd8-9ac3-45da-8057-6452a6d110f1 service cinder] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:28:10.090046 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1459/2917] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:28:10 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:28:14.985951 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc07ca4-cd31-4063-8906-5c7ca385eb6c service cinder] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:28:15.048914 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc07ca4-cd31-4063-8906-5c7ca385eb6c service cinder] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:28:15.053502 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339c14b8-d51b-4b69-9ae5-3ff661a23151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:28:15.054128 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c14b8-d51b-4b69-9ae5-3ff661a23151 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:28:15.054410 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c14b8-d51b-4b69-9ae5-3ff661a23151 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:28:15.054681 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c14b8-d51b-4b69-9ae5-3ff661a23151 admin admin] PATH_INFO: `/v3/users/0910a1b88a99431d8408f562d614df6b` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:28:15.055793 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339c14b8-d51b-4b69-9ae5-3ff661a23151 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0910a1b88a99431d8408f562d614df6b)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:28:15.057748 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339c14b8-d51b-4b69-9ae5-3ff661a23151 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:28:15.102335 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-339c14b8-d51b-4b69-9ae5-3ff661a23151 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0910a1b88a99431d8408f562d614df6b'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:28:15.102979 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-339c14b8-d51b-4b69-9ae5-3ff661a23151 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0910a1b88a99431d8408f562d614df6b'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:28:15.115401 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-339c14b8-d51b-4b69-9ae5-3ff661a23151 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0910a1b88a99431d8408f562d614df6b'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:28:15.122733 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-339c14b8-d51b-4b69-9ae5-3ff661a23151 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0910a1b88a99431d8408f562d614df6b'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:28:15.123478 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-339c14b8-d51b-4b69-9ae5-3ff661a23151 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0910a1b88a99431d8408f562d614df6b'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:28:15.135689 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1459/2918] 10.222.0.49 () {58 vars in 1224 bytes} [Thu Sep 29 02:28:14 2022] DELETE /identity/v3/users/0910a1b88a99431d8408f562d614df6b => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:28:15.140124 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1fd5ba-b8a1-4163-aba0-799aa67bab02 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:28:15.140611 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1fd5ba-b8a1-4163-aba0-799aa67bab02 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:28:15.140712 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1fd5ba-b8a1-4163-aba0-799aa67bab02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:28:15.160050 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-8e1fd5ba-b8a1-4163-aba0-799aa67bab02 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:28:15.161248 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-8e1fd5ba-b8a1-4163-aba0-799aa67bab02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:28:15.179799 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:28:15.220424 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1460/2919] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:28:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:28:15.230252 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339c14b8-d51b-4b69-9ae5-3ff661a23151 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:28:15.231651 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-339c14b8-d51b-4b69-9ae5-3ff661a23151 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:28:15.289231 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339c14b8-d51b-4b69-9ae5-3ff661a23151 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:28:15.292868 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eaf753-b48e-4ab5-bd93-9e15af7cd11b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:28:15.293496 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eaf753-b48e-4ab5-bd93-9e15af7cd11b service neutron] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:28:15.293776 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eaf753-b48e-4ab5-bd93-9e15af7cd11b service neutron] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:28:15.294045 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eaf753-b48e-4ab5-bd93-9e15af7cd11b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:28:15.302994 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eaf753-b48e-4ab5-bd93-9e15af7cd11b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:28:15.304409 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eaf753-b48e-4ab5-bd93-9e15af7cd11b service neutron] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:28:15.313704 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1460/2920] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:28:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:28:15.574095 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1fd5ba-b8a1-4163-aba0-799aa67bab02 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:28:15.575508 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-8e1fd5ba-b8a1-4163-aba0-799aa67bab02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:28:15.589793 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1fd5ba-b8a1-4163-aba0-799aa67bab02 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:28:15.596008 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0815fb10-f194-413c-b437-838b809fe9cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:28:15.596606 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0815fb10-f194-413c-b437-838b809fe9cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:28:15.596881 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0815fb10-f194-413c-b437-838b809fe9cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:28:15.597765 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0815fb10-f194-413c-b437-838b809fe9cc admin admin] PATH_INFO: `/v3/projects/5143aff4489440fa9adf9c64125f09bf` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:28:15.598598 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0815fb10-f194-413c-b437-838b809fe9cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=5143aff4489440fa9adf9c64125f09bf)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:28:15.600794 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0815fb10-f194-413c-b437-838b809fe9cc admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:28:15.648002 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-0815fb10-f194-413c-b437-838b809fe9cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5143aff4489440fa9adf9c64125f09bf', 'request_id': 'req-0815fb10-f194-413c-b437-838b809fe9cc'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:28:15.654783 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-0815fb10-f194-413c-b437-838b809fe9cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5143aff4489440fa9adf9c64125f09bf', 'request_id': 'req-0815fb10-f194-413c-b437-838b809fe9cc'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:28:15.662395 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-0815fb10-f194-413c-b437-838b809fe9cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5143aff4489440fa9adf9c64125f09bf', 'request_id': 'req-0815fb10-f194-413c-b437-838b809fe9cc'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:28:15.673483 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-0815fb10-f194-413c-b437-838b809fe9cc admin admin] The token cache is being invalidate because project 5143aff4489440fa9adf9c64125f09bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81649) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:28:15.673747 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-0815fb10-f194-413c-b437-838b809fe9cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:28:15.674387 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-0815fb10-f194-413c-b437-838b809fe9cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:28:15.675842 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1461/2921] 10.222.0.49 () {58 vars in 1233 bytes} [Thu Sep 29 02:28:15 2022] DELETE /identity/v3/projects/5143aff4489440fa9adf9c64125f09bf => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:28:15.679811 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eaf753-b48e-4ab5-bd93-9e15af7cd11b service neutron] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:28:15.690138 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eaf753-b48e-4ab5-bd93-9e15af7cd11b service neutron] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:28:15.697767 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:28:15.750201 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd448c24-e546-4035-9dd2-ece200502650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:28:15.750748 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd448c24-e546-4035-9dd2-ece200502650 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:28:15.751027 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd448c24-e546-4035-9dd2-ece200502650 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:28:15.751298 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd448c24-e546-4035-9dd2-ece200502650 admin admin] PATH_INFO: `/v3/users/42fa994f6838453a88fb19b1f6fd86bc` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:28:15.752406 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd448c24-e546-4035-9dd2-ece200502650 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42fa994f6838453a88fb19b1f6fd86bc)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:28:15.754373 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd448c24-e546-4035-9dd2-ece200502650 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:28:15.799118 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-dd448c24-e546-4035-9dd2-ece200502650 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42fa994f6838453a88fb19b1f6fd86bc'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:28:15.799758 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-dd448c24-e546-4035-9dd2-ece200502650 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42fa994f6838453a88fb19b1f6fd86bc'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:28:15.811785 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-dd448c24-e546-4035-9dd2-ece200502650 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42fa994f6838453a88fb19b1f6fd86bc'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:28:15.818985 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-dd448c24-e546-4035-9dd2-ece200502650 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42fa994f6838453a88fb19b1f6fd86bc'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:28:15.819615 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-dd448c24-e546-4035-9dd2-ece200502650 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42fa994f6838453a88fb19b1f6fd86bc'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:28:15.832420 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1461/2922] 10.222.0.49 () {58 vars in 1224 bytes} [Thu Sep 29 02:28:15 2022] DELETE /identity/v3/users/42fa994f6838453a88fb19b1f6fd86bc => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:28:16.099095 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0815fb10-f194-413c-b437-838b809fe9cc admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:28:16.100565 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-0815fb10-f194-413c-b437-838b809fe9cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:28:16.118394 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0815fb10-f194-413c-b437-838b809fe9cc admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:28:16.177086 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3887dd-6a99-4576-8bca-e9544ffb83c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:28:16.177811 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3887dd-6a99-4576-8bca-e9544ffb83c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:28:16.178017 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3887dd-6a99-4576-8bca-e9544ffb83c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:28:16.178291 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3887dd-6a99-4576-8bca-e9544ffb83c0 admin admin] PATH_INFO: `/v3/projects/78f23ec66aba4f11a1ece35043953105` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:28:16.179407 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3887dd-6a99-4576-8bca-e9544ffb83c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78f23ec66aba4f11a1ece35043953105)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:28:16.181320 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3887dd-6a99-4576-8bca-e9544ffb83c0 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:28:16.227835 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-1a3887dd-6a99-4576-8bca-e9544ffb83c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78f23ec66aba4f11a1ece35043953105', 'request_id': 'req-1a3887dd-6a99-4576-8bca-e9544ffb83c0'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:28:16.228956 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:28:16.236450 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-1a3887dd-6a99-4576-8bca-e9544ffb83c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78f23ec66aba4f11a1ece35043953105', 'request_id': 'req-1a3887dd-6a99-4576-8bca-e9544ffb83c0'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:28:16.244418 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-1a3887dd-6a99-4576-8bca-e9544ffb83c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78f23ec66aba4f11a1ece35043953105', 'request_id': 'req-1a3887dd-6a99-4576-8bca-e9544ffb83c0'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:28:16.255413 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-1a3887dd-6a99-4576-8bca-e9544ffb83c0 admin admin] The token cache is being invalidate because project 78f23ec66aba4f11a1ece35043953105 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81649) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:28:16.255701 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-1a3887dd-6a99-4576-8bca-e9544ffb83c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:28:16.256363 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-1a3887dd-6a99-4576-8bca-e9544ffb83c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:28:16.257882 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1462/2923] 10.222.0.49 () {58 vars in 1233 bytes} [Thu Sep 29 02:28:16 2022] DELETE /identity/v3/projects/78f23ec66aba4f11a1ece35043953105 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:28:16.264489 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d64cf3b-caef-4d99-a362-714da402bc71 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:28:16.264976 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d64cf3b-caef-4d99-a362-714da402bc71 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:28:16.265088 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d64cf3b-caef-4d99-a362-714da402bc71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:28:16.286057 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-3d64cf3b-caef-4d99-a362-714da402bc71 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:28:16.287207 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-3d64cf3b-caef-4d99-a362-714da402bc71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:28:16.345948 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1462/2924] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:28:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:28:16.354282 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057fce64-aa5d-4372-ae30-db7d4d3a7451 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:28:16.354564 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057fce64-aa5d-4372-ae30-db7d4d3a7451 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:28:16.354833 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057fce64-aa5d-4372-ae30-db7d4d3a7451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:28:16.374250 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-057fce64-aa5d-4372-ae30-db7d4d3a7451 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:28:16.375465 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-057fce64-aa5d-4372-ae30-db7d4d3a7451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:28:16.383295 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1463/2925] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:28:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:28:16.387383 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d64cf3b-caef-4d99-a362-714da402bc71 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:28:16.397688 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d64cf3b-caef-4d99-a362-714da402bc71 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:28:16.402268 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bda513-c656-411b-9c9b-a38352b59b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:28:16.402864 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bda513-c656-411b-9c9b-a38352b59b69 admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:28:16.403146 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bda513-c656-411b-9c9b-a38352b59b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:28:16.403418 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bda513-c656-411b-9c9b-a38352b59b69 admin admin] PATH_INFO: `/v3/domains` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:28:16.404705 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bda513-c656-411b-9c9b-a38352b59b69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:28:16.404995 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bda513-c656-411b-9c9b-a38352b59b69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:28:16.406884 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bda513-c656-411b-9c9b-a38352b59b69 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:28:16.418347 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1463/2926] 10.222.0.49 () {58 vars in 1153 bytes} [Thu Sep 29 02:28:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:28:16.422628 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057fce64-aa5d-4372-ae30-db7d4d3a7451 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:28:16.432010 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057fce64-aa5d-4372-ae30-db7d4d3a7451 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:28:16.437333 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a9c642-cdab-4ccb-8f90-a19cf902454a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:28:16.437946 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a9c642-cdab-4ccb-8f90-a19cf902454a admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:28:16.438221 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a9c642-cdab-4ccb-8f90-a19cf902454a admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:28:16.438493 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a9c642-cdab-4ccb-8f90-a19cf902454a admin admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:28:16.439146 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a9c642-cdab-4ccb-8f90-a19cf902454a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:28:16.441040 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a9c642-cdab-4ccb-8f90-a19cf902454a admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:28:16.467968 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1464/2927] 10.222.0.49 () {60 vars in 1153 bytes} [Thu Sep 29 02:28:16 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:28:16.472046 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bda513-c656-411b-9c9b-a38352b59b69 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:28:16.481925 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bda513-c656-411b-9c9b-a38352b59b69 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:28:16.494023 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:28:16.539556 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1347f6c5-84e8-4e1e-95eb-c50d63d11964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:28:16.540077 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1347f6c5-84e8-4e1e-95eb-c50d63d11964 admin admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:28:16.540352 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1347f6c5-84e8-4e1e-95eb-c50d63d11964 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:28:16.540619 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1347f6c5-84e8-4e1e-95eb-c50d63d11964 admin admin] PATH_INFO: `/v3/users` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:28:16.541231 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1347f6c5-84e8-4e1e-95eb-c50d63d11964 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:28:16.543145 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1347f6c5-84e8-4e1e-95eb-c50d63d11964 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:28:16.564128 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1464/2928] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 02:28:16 2022] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:28:16.568265 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a9c642-cdab-4ccb-8f90-a19cf902454a admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:28:16.579138 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a9c642-cdab-4ccb-8f90-a19cf902454a admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:28:16.583730 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cef16d-609c-4940-9c97-274f398eb09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:28:16.584316 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cef16d-609c-4940-9c97-274f398eb09b admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:28:16.584818 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cef16d-609c-4940-9c97-274f398eb09b admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:28:16.585095 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cef16d-609c-4940-9c97-274f398eb09b admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:28:16.585771 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cef16d-609c-4940-9c97-274f398eb09b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:28:16.587349 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cef16d-609c-4940-9c97-274f398eb09b admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:28:16.597053 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1465/2929] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:28:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:28:16.600990 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1347f6c5-84e8-4e1e-95eb-c50d63d11964 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:28:16.611677 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1347f6c5-84e8-4e1e-95eb-c50d63d11964 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:28:16.616236 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592c3a65-2ab7-4135-ae62-96449402bb6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:28:16.616836 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592c3a65-2ab7-4135-ae62-96449402bb6b admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:28:16.617114 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592c3a65-2ab7-4135-ae62-96449402bb6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:28:16.617422 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592c3a65-2ab7-4135-ae62-96449402bb6b admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:28:16.618062 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592c3a65-2ab7-4135-ae62-96449402bb6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:28:16.619645 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592c3a65-2ab7-4135-ae62-96449402bb6b admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:28:16.630941 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1465/2930] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:28:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:28:16.635415 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cef16d-609c-4940-9c97-274f398eb09b admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:28:16.646404 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cef16d-609c-4940-9c97-274f398eb09b admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:28:16.651094 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e1020-8c98-49b3-9c21-9312acbc550c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:28:16.651732 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e1020-8c98-49b3-9c21-9312acbc550c admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:28:16.652009 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e1020-8c98-49b3-9c21-9312acbc550c admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:28:16.652279 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e1020-8c98-49b3-9c21-9312acbc550c admin admin] PATH_INFO: `/v3/projects/3c331edd8c4d408e985251530cc82797/users/93220fdfec064e75960c372bc5d66344/roles/f157f905c9c94ccfbfb46e52d443e8f2` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:28:16.667097 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950e1020-8c98-49b3-9c21-9312acbc550c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c331edd8c4d408e985251530cc82797, user_id=93220fdfec064e75960c372bc5d66344, role_id=f157f905c9c94ccfbfb46e52d443e8f2)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:28:16.669859 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950e1020-8c98-49b3-9c21-9312acbc550c admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:28:16.682142 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1466/2931] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:28:16 2022] PUT /identity/v3/projects/3c331edd8c4d408e985251530cc82797/users/93220fdfec064e75960c372bc5d66344/roles/f157f905c9c94ccfbfb46e52d443e8f2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:28:16.693779 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdff9ae-9f5c-42bf-bc11-3b48a8baba98 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:28:16.694070 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdff9ae-9f5c-42bf-bc11-3b48a8baba98 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:28:16.694349 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdff9ae-9f5c-42bf-bc11-3b48a8baba98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:28:16.725678 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-abdff9ae-9f5c-42bf-bc11-3b48a8baba98 None None] MFA Rules not processed for user `93220fdfec064e75960c372bc5d66344`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:28:16.726903 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-abdff9ae-9f5c-42bf-bc11-3b48a8baba98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:28:16.790947 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1466/2932] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:28:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:28:16.803233 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e1020-8c98-49b3-9c21-9312acbc550c admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:28:16.804939 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-950e1020-8c98-49b3-9c21-9312acbc550c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:28:16.883128 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e1020-8c98-49b3-9c21-9312acbc550c admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:28:16.886784 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1c926d-7476-47ab-ad38-a88279f06ba0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d36669146554031ba8596cb583cd6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:28:16.887380 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c926d-7476-47ab-ad38-a88279f06ba0 service glance] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:28:16.887653 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c926d-7476-47ab-ad38-a88279f06ba0 service glance] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:28:16.887920 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c926d-7476-47ab-ad38-a88279f06ba0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:28:16.896128 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1c926d-7476-47ab-ad38-a88279f06ba0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:28:16.897562 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1c926d-7476-47ab-ad38-a88279f06ba0 service glance] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:28:16.907755 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1467/2933] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:28:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:28:26.787958 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=58,keystone:INSERT=3 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:28:26.902328 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=68,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:28:34.521893 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdff9ae-9f5c-42bf-bc11-3b48a8baba98 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:28:34.582299 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdff9ae-9f5c-42bf-bc11-3b48a8baba98 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:28:34.586704 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af377213-811a-4362-8f07-b8c5a9479a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:28:34.587335 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af377213-811a-4362-8f07-b8c5a9479a17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:28:34.587614 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af377213-811a-4362-8f07-b8c5a9479a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:28:34.587877 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af377213-811a-4362-8f07-b8c5a9479a17 admin admin] PATH_INFO: `/v3/users/93220fdfec064e75960c372bc5d66344` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:28:34.588964 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af377213-811a-4362-8f07-b8c5a9479a17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93220fdfec064e75960c372bc5d66344)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:28:34.590891 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af377213-811a-4362-8f07-b8c5a9479a17 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:28:34.635888 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-af377213-811a-4362-8f07-b8c5a9479a17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93220fdfec064e75960c372bc5d66344'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:28:34.636529 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-af377213-811a-4362-8f07-b8c5a9479a17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93220fdfec064e75960c372bc5d66344'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:28:34.649369 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-af377213-811a-4362-8f07-b8c5a9479a17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93220fdfec064e75960c372bc5d66344'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:28:34.657050 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-af377213-811a-4362-8f07-b8c5a9479a17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93220fdfec064e75960c372bc5d66344'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:28:34.657679 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-af377213-811a-4362-8f07-b8c5a9479a17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93220fdfec064e75960c372bc5d66344'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:28:34.669638 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1467/2934] 10.222.0.49 () {58 vars in 1224 bytes} [Thu Sep 29 02:28:34 2022] DELETE /identity/v3/users/93220fdfec064e75960c372bc5d66344 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:28:34.674265 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f467e0a0-c999-4bea-8654-1a6959689ff6 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:28:34.674749 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f467e0a0-c999-4bea-8654-1a6959689ff6 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:28:34.674857 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f467e0a0-c999-4bea-8654-1a6959689ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:28:34.693725 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-f467e0a0-c999-4bea-8654-1a6959689ff6 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:28:34.694918 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-f467e0a0-c999-4bea-8654-1a6959689ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:28:34.755430 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1468/2935] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:28:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:28:34.764779 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af377213-811a-4362-8f07-b8c5a9479a17 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:28:34.766219 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-af377213-811a-4362-8f07-b8c5a9479a17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:28:34.823383 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af377213-811a-4362-8f07-b8c5a9479a17 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:28:34.827608 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b4eb2d-497f-4749-bcc9-2beef324df6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:28:34.828204 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b4eb2d-497f-4749-bcc9-2beef324df6c service neutron] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:28:34.828484 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b4eb2d-497f-4749-bcc9-2beef324df6c service neutron] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:28:34.828755 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b4eb2d-497f-4749-bcc9-2beef324df6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:28:34.837627 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b4eb2d-497f-4749-bcc9-2beef324df6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:28:34.839051 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b4eb2d-497f-4749-bcc9-2beef324df6c service neutron] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:28:34.848795 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1468/2936] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:28:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:28:35.119782 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f467e0a0-c999-4bea-8654-1a6959689ff6 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:28:35.122074 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-f467e0a0-c999-4bea-8654-1a6959689ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:28:35.143819 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f467e0a0-c999-4bea-8654-1a6959689ff6 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:28:35.152468 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b877c27-ccca-4872-82ec-7889d26db430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:28:35.153183 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b877c27-ccca-4872-82ec-7889d26db430 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:28:35.153581 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b877c27-ccca-4872-82ec-7889d26db430 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:28:35.153921 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b877c27-ccca-4872-82ec-7889d26db430 admin admin] PATH_INFO: `/v3/projects/3c331edd8c4d408e985251530cc82797` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:28:35.156379 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b877c27-ccca-4872-82ec-7889d26db430 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c331edd8c4d408e985251530cc82797)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:28:35.158857 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b877c27-ccca-4872-82ec-7889d26db430 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:28:35.205417 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-1b877c27-ccca-4872-82ec-7889d26db430 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c331edd8c4d408e985251530cc82797', 'request_id': 'req-1b877c27-ccca-4872-82ec-7889d26db430'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:28:35.211439 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-1b877c27-ccca-4872-82ec-7889d26db430 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c331edd8c4d408e985251530cc82797', 'request_id': 'req-1b877c27-ccca-4872-82ec-7889d26db430'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:28:35.220005 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-1b877c27-ccca-4872-82ec-7889d26db430 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c331edd8c4d408e985251530cc82797', 'request_id': 'req-1b877c27-ccca-4872-82ec-7889d26db430'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:28:35.230351 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-1b877c27-ccca-4872-82ec-7889d26db430 admin admin] The token cache is being invalidate because project 3c331edd8c4d408e985251530cc82797 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81649) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:28:35.230640 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-1b877c27-ccca-4872-82ec-7889d26db430 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:28:35.231260 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-1b877c27-ccca-4872-82ec-7889d26db430 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:28:35.232730 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1469/2937] 10.222.0.49 () {58 vars in 1233 bytes} [Thu Sep 29 02:28:35 2022] DELETE /identity/v3/projects/3c331edd8c4d408e985251530cc82797 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:28:35.238471 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11205d2-34dd-43e2-8169-fafbc0d52ad5 None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:28:35.238763 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11205d2-34dd-43e2-8169-fafbc0d52ad5 None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:28:35.239037 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11205d2-34dd-43e2-8169-fafbc0d52ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:28:35.258255 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-d11205d2-34dd-43e2-8169-fafbc0d52ad5 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:28:35.259381 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-d11205d2-34dd-43e2-8169-fafbc0d52ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:28:35.275646 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:28:35.319917 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1469/2938] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:28:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:28:35.327985 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f628dc80-8d73-493c-a65b-cb44265298d2 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:28:35.328272 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f628dc80-8d73-493c-a65b-cb44265298d2 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:28:35.328555 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f628dc80-8d73-493c-a65b-cb44265298d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:28:35.349216 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-f628dc80-8d73-493c-a65b-cb44265298d2 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:28:35.350450 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-f628dc80-8d73-493c-a65b-cb44265298d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:28:35.359145 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1470/2939] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:28:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:28:35.363443 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11205d2-34dd-43e2-8169-fafbc0d52ad5 None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:28:35.372871 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11205d2-34dd-43e2-8169-fafbc0d52ad5 None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:28:35.377516 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df4ddd1-89f9-4ee9-a4f8-768c6236c055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:28:35.378108 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df4ddd1-89f9-4ee9-a4f8-768c6236c055 admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:28:35.378385 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df4ddd1-89f9-4ee9-a4f8-768c6236c055 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:28:35.378654 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df4ddd1-89f9-4ee9-a4f8-768c6236c055 admin admin] PATH_INFO: `/v3/domains` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:28:35.379286 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df4ddd1-89f9-4ee9-a4f8-768c6236c055 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81648) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 29 02:28:35.379582 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df4ddd1-89f9-4ee9-a4f8-768c6236c055 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:28:35.381164 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df4ddd1-89f9-4ee9-a4f8-768c6236c055 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:28:35.392556 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1470/2940] 10.222.0.49 () {58 vars in 1153 bytes} [Thu Sep 29 02:28:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 29 02:28:35.396799 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f628dc80-8d73-493c-a65b-cb44265298d2 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:28:35.406704 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f628dc80-8d73-493c-a65b-cb44265298d2 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:28:35.411556 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fa354f-f279-4f32-bd23-c8be2542792c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:28:35.412147 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fa354f-f279-4f32-bd23-c8be2542792c admin admin] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:28:35.412421 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fa354f-f279-4f32-bd23-c8be2542792c admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:28:35.412690 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fa354f-f279-4f32-bd23-c8be2542792c admin admin] PATH_INFO: `/v3/projects` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:28:35.413318 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fa354f-f279-4f32-bd23-c8be2542792c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:28:35.415196 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fa354f-f279-4f32-bd23-c8be2542792c admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:28:35.442348 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1471/2941] 10.222.0.49 () {60 vars in 1153 bytes} [Thu Sep 29 02:28:35 2022] POST /identity/v3/projects => generated 365 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 29 02:28:35.446577 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df4ddd1-89f9-4ee9-a4f8-768c6236c055 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:28:35.456450 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df4ddd1-89f9-4ee9-a4f8-768c6236c055 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:28:35.515274 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2a384f-9aa2-4b4f-8eb8-eeccf697bba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:28:35.515813 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2a384f-9aa2-4b4f-8eb8-eeccf697bba4 admin admin] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:28:35.516095 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2a384f-9aa2-4b4f-8eb8-eeccf697bba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:28:35.516370 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2a384f-9aa2-4b4f-8eb8-eeccf697bba4 admin admin] PATH_INFO: `/v3/users` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:28:35.517010 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2a384f-9aa2-4b4f-8eb8-eeccf697bba4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:28:35.519017 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2a384f-9aa2-4b4f-8eb8-eeccf697bba4 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:28:35.540319 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1471/2942] 10.222.0.49 () {60 vars in 1144 bytes} [Thu Sep 29 02:28:35 2022] POST /identity/v3/users => generated 283 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 29 02:28:35.544627 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fa354f-f279-4f32-bd23-c8be2542792c admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:28:35.555764 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fa354f-f279-4f32-bd23-c8be2542792c admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:28:35.560375 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109476d1-8f23-4af7-86e7-1518533a7dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:28:35.561021 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109476d1-8f23-4af7-86e7-1518533a7dcc admin admin] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:28:35.561371 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109476d1-8f23-4af7-86e7-1518533a7dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:28:35.561646 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109476d1-8f23-4af7-86e7-1518533a7dcc admin admin] PATH_INFO: `/v3/roles` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:28:35.562278 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109476d1-8f23-4af7-86e7-1518533a7dcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:28:35.563848 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109476d1-8f23-4af7-86e7-1518533a7dcc admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:28:35.573432 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1472/2943] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:28:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:28:35.577926 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2a384f-9aa2-4b4f-8eb8-eeccf697bba4 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:28:35.587575 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2a384f-9aa2-4b4f-8eb8-eeccf697bba4 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:28:35.592038 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57886aad-95b1-43ed-a168-1c45f77661fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:28:35.593237 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57886aad-95b1-43ed-a168-1c45f77661fd admin admin] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:28:35.593574 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57886aad-95b1-43ed-a168-1c45f77661fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:28:35.593843 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57886aad-95b1-43ed-a168-1c45f77661fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:28:35.594473 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57886aad-95b1-43ed-a168-1c45f77661fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:28:35.596048 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57886aad-95b1-43ed-a168-1c45f77661fd admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:28:35.606534 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1472/2944] 10.222.0.49 () {58 vars in 1122 bytes} [Thu Sep 29 02:28:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 29 02:28:35.610433 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109476d1-8f23-4af7-86e7-1518533a7dcc admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:28:35.620098 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109476d1-8f23-4af7-86e7-1518533a7dcc admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:28:35.624692 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59af4a73-82a0-4424-8620-42fe597c0f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:28:35.625340 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af4a73-82a0-4424-8620-42fe597c0f25 admin admin] REQUEST_METHOD: `PUT` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:28:35.625687 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af4a73-82a0-4424-8620-42fe597c0f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:28:35.625956 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af4a73-82a0-4424-8620-42fe597c0f25 admin admin] PATH_INFO: `/v3/projects/23ff7f58ad144ecfb9fa1cdc9c7cfadc/users/845b3dc487fc47d383cdbb93b55b5261/roles/f157f905c9c94ccfbfb46e52d443e8f2` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:28:35.640637 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59af4a73-82a0-4424-8620-42fe597c0f25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23ff7f58ad144ecfb9fa1cdc9c7cfadc, user_id=845b3dc487fc47d383cdbb93b55b5261, role_id=f157f905c9c94ccfbfb46e52d443e8f2)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:28:35.643285 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59af4a73-82a0-4424-8620-42fe597c0f25 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:28:35.656407 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1473/2945] 10.222.0.49 () {60 vars in 1483 bytes} [Thu Sep 29 02:28:35 2022] PUT /identity/v3/projects/23ff7f58ad144ecfb9fa1cdc9c7cfadc/users/845b3dc487fc47d383cdbb93b55b5261/roles/f157f905c9c94ccfbfb46e52d443e8f2 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:28:35.666923 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f7831-2d33-479f-b8e8-f7ededcc372d None None] REQUEST_METHOD: `POST` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:28:35.667208 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f7831-2d33-479f-b8e8-f7ededcc372d None None] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:28:35.667481 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f7831-2d33-479f-b8e8-f7ededcc372d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:28:35.695060 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.auth.core [None req-0b2f7831-2d33-479f-b8e8-f7ededcc372d None None] MFA Rules not processed for user `845b3dc487fc47d383cdbb93b55b5261`. Rule list: `[]` (Enabled: `True`). {{(pid=81648) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:28:35.696282 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-0b2f7831-2d33-479f-b8e8-f7ededcc372d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:28:35.761319 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1473/2946] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:28:35 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:28:35.772870 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59af4a73-82a0-4424-8620-42fe597c0f25 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:28:35.774566 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-59af4a73-82a0-4424-8620-42fe597c0f25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:28:35.796455 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:28:35.834246 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59af4a73-82a0-4424-8620-42fe597c0f25 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:28:35.837840 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42da7379-ddce-47ea-a963-b623b715c55b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75135b856134ba4b9ccac337886f682', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:28:35.838438 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42da7379-ddce-47ea-a963-b623b715c55b service cinder] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:28:35.838713 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42da7379-ddce-47ea-a963-b623b715c55b service cinder] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:28:35.838981 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42da7379-ddce-47ea-a963-b623b715c55b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:28:35.847772 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42da7379-ddce-47ea-a963-b623b715c55b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:28:35.849174 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42da7379-ddce-47ea-a963-b623b715c55b service cinder] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:28:35.858196 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1474/2947] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:28:35 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:28:45.758348 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:28:45.854122 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=17 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:29:07.781252 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2f7831-2d33-479f-b8e8-f7ededcc372d None None] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:29:07.842418 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2f7831-2d33-479f-b8e8-f7ededcc372d None None] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:29:07.847107 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111462b5-270e-4d3f-9111-66235c5b7fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:29:07.847735 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111462b5-270e-4d3f-9111-66235c5b7fb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:29:07.848014 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111462b5-270e-4d3f-9111-66235c5b7fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:29:07.848288 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111462b5-270e-4d3f-9111-66235c5b7fb2 admin admin] PATH_INFO: `/v3/users/845b3dc487fc47d383cdbb93b55b5261` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:29:07.849464 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111462b5-270e-4d3f-9111-66235c5b7fb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=845b3dc487fc47d383cdbb93b55b5261)` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:29:07.852038 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111462b5-270e-4d3f-9111-66235c5b7fb2 admin admin] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:29:07.898497 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-111462b5-270e-4d3f-9111-66235c5b7fb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '845b3dc487fc47d383cdbb93b55b5261'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:29:07.899128 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-111462b5-270e-4d3f-9111-66235c5b7fb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '845b3dc487fc47d383cdbb93b55b5261'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:29:07.917509 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-111462b5-270e-4d3f-9111-66235c5b7fb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '845b3dc487fc47d383cdbb93b55b5261'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:29:07.924897 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-111462b5-270e-4d3f-9111-66235c5b7fb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '845b3dc487fc47d383cdbb93b55b5261'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:29:07.925568 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.notifications [None req-111462b5-270e-4d3f-9111-66235c5b7fb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '845b3dc487fc47d383cdbb93b55b5261'} {{(pid=81648) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:29:07.938216 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1474/2948] 10.222.0.49 () {58 vars in 1224 bytes} [Thu Sep 29 02:29:07 2022] DELETE /identity/v3/users/845b3dc487fc47d383cdbb93b55b5261 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 29 02:29:07.942682 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75313b-0ad0-4117-8470-3975743b63d3 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:29:07.943169 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75313b-0ad0-4117-8470-3975743b63d3 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:29:07.943291 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75313b-0ad0-4117-8470-3975743b63d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:29:07.963427 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-8d75313b-0ad0-4117-8470-3975743b63d3 None None] MFA Rules not processed for user `d04b7db4290a4ee3872fe98d8aad0254`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:29:07.964629 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-8d75313b-0ad0-4117-8470-3975743b63d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:29:08.023079 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1475/2949] 10.222.0.49 () {58 vars in 958 bytes} [Thu Sep 29 02:29:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:29:08.032946 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111462b5-270e-4d3f-9111-66235c5b7fb2 admin admin] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:29:08.034356 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-111462b5-270e-4d3f-9111-66235c5b7fb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:29:08.103134 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111462b5-270e-4d3f-9111-66235c5b7fb2 admin admin] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:29:08.106801 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046f9826-dd46-406c-9c25-f43cb7268fab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:29:08.107402 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f9826-dd46-406c-9c25-f43cb7268fab service neutron] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:29:08.107677 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f9826-dd46-406c-9c25-f43cb7268fab service neutron] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:29:08.107975 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f9826-dd46-406c-9c25-f43cb7268fab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:29:08.117386 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046f9826-dd46-406c-9c25-f43cb7268fab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:29:08.118808 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046f9826-dd46-406c-9c25-f43cb7268fab service neutron] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:29:08.128488 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1475/2950] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:29:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:29:08.388038 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d75313b-0ad0-4117-8470-3975743b63d3 None None] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:29:08.389530 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-8d75313b-0ad0-4117-8470-3975743b63d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:29:08.402193 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d75313b-0ad0-4117-8470-3975743b63d3 None None] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:29:08.407632 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c6de62-824d-452c-82c2-aafc8fe75497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04b7db4290a4ee3872fe98d8aad0254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a47c9ae604c439cb80f84e69bc4f995', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:29:08.408780 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c6de62-824d-452c-82c2-aafc8fe75497 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:29:08.409260 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c6de62-824d-452c-82c2-aafc8fe75497 admin admin] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:29:08.409828 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c6de62-824d-452c-82c2-aafc8fe75497 admin admin] PATH_INFO: `/v3/projects/23ff7f58ad144ecfb9fa1cdc9c7cfadc` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:29:08.411930 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c6de62-824d-452c-82c2-aafc8fe75497 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23ff7f58ad144ecfb9fa1cdc9c7cfadc)` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:29:08.415661 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c6de62-824d-452c-82c2-aafc8fe75497 admin admin] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:29:08.466197 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-50c6de62-824d-452c-82c2-aafc8fe75497 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23ff7f58ad144ecfb9fa1cdc9c7cfadc', 'request_id': 'req-50c6de62-824d-452c-82c2-aafc8fe75497'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:29:08.472450 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-50c6de62-824d-452c-82c2-aafc8fe75497 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23ff7f58ad144ecfb9fa1cdc9c7cfadc', 'request_id': 'req-50c6de62-824d-452c-82c2-aafc8fe75497'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:29:08.480104 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-50c6de62-824d-452c-82c2-aafc8fe75497 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23ff7f58ad144ecfb9fa1cdc9c7cfadc', 'request_id': 'req-50c6de62-824d-452c-82c2-aafc8fe75497'} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:29:08.490246 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-50c6de62-824d-452c-82c2-aafc8fe75497 admin admin] The token cache is being invalidate because project 23ff7f58ad144ecfb9fa1cdc9c7cfadc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81649) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 29 02:29:08.490527 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-50c6de62-824d-452c-82c2-aafc8fe75497 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:29:08.491154 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.notifications [None req-50c6de62-824d-452c-82c2-aafc8fe75497 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81649) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 29 02:29:08.492841 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1476/2951] 10.222.0.49 () {58 vars in 1233 bytes} [Thu Sep 29 02:29:08 2022] DELETE /identity/v3/projects/23ff7f58ad144ecfb9fa1cdc9c7cfadc => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 29 02:29:18.123999 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:29:18.487317 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:29:53.586687 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046f9826-dd46-406c-9c25-f43cb7268fab service neutron] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:29:53.588083 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-046f9826-dd46-406c-9c25-f43cb7268fab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:29:53.724397 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046f9826-dd46-406c-9c25-f43cb7268fab service neutron] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:29:53.782382 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae78a795-cd29-4b63-a73a-427d39750ab4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cbb39731a6b42e2a6647d6134b5c7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:29:53.783238 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae78a795-cd29-4b63-a73a-427d39750ab4 service placement] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:29:53.783514 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae78a795-cd29-4b63-a73a-427d39750ab4 service placement] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:29:53.783781 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae78a795-cd29-4b63-a73a-427d39750ab4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:29:53.785519 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-ae78a795-cd29-4b63-a73a-427d39750ab4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:29:53.797525 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae78a795-cd29-4b63-a73a-427d39750ab4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:29:53.799096 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae78a795-cd29-4b63-a73a-427d39750ab4 service placement] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:29:53.808940 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1476/2952] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:29:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:30:03.804615 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=89 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:32:59.206303 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c6de62-824d-452c-82c2-aafc8fe75497 admin admin] Authenticating user token {{(pid=81649) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:32:59.207704 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-50c6de62-824d-452c-82c2-aafc8fe75497 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:32:59.290213 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c6de62-824d-452c-82c2-aafc8fe75497 admin admin] Validating token access rules against request {{(pid=81649) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:32:59.293783 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26020f0-89fb-431d-aa69-5546bfd6ce27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81649) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:32:59.294380 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26020f0-89fb-431d-aa69-5546bfd6ce27 service neutron] REQUEST_METHOD: `GET` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:32:59.294652 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26020f0-89fb-431d-aa69-5546bfd6ce27 service neutron] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:32:59.294919 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26020f0-89fb-431d-aa69-5546bfd6ce27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:32:59.296604 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-e26020f0-89fb-431d-aa69-5546bfd6ce27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:32:59.384091 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26020f0-89fb-431d-aa69-5546bfd6ce27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:32:59.385543 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26020f0-89fb-431d-aa69-5546bfd6ce27 service neutron] RBAC: Authorization granted {{(pid=81649) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:32:59.405372 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1477/2953] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:32:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:32:59.412982 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae78a795-cd29-4b63-a73a-427d39750ab4 service placement] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:32:59.422469 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae78a795-cd29-4b63-a73a-427d39750ab4 service placement] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:32:59.426927 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bd0ca7-d965-490e-9d26-b18dcfb4191f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:32:59.427520 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd0ca7-d965-490e-9d26-b18dcfb4191f service neutron] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:32:59.427798 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd0ca7-d965-490e-9d26-b18dcfb4191f service neutron] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:32:59.428069 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd0ca7-d965-490e-9d26-b18dcfb4191f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:32:59.429961 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.fernet_utils [None req-25bd0ca7-d965-490e-9d26-b18dcfb4191f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81648) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:32:59.471611 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application [None req-25bd0ca7-d965-490e-9d26-b18dcfb4191f service neutron] Could not find project: df0405453f304b0091c0d9eda1c17725.: keystone.exception.ProjectNotFound: Could not find project: df0405453f304b0091c0d9eda1c17725. Sep 29 02:32:59.471611 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 29 02:32:59.471611 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 29 02:32:59.471611 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 29 02:32:59.471611 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 29 02:32:59.471611 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 29 02:32:59.471611 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 29 02:32:59.471611 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 29 02:32:59.471611 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 29 02:32:59.471611 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 29 02:32:59.471611 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 29 02:32:59.471611 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 29 02:32:59.471611 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 285, in get Sep 29 02:32:59.471611 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:validate_token') Sep 29 02:32:59.471611 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Sep 29 02:32:59.473131 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Sep 29 02:32:59.473131 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Sep 29 02:32:59.473131 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Sep 29 02:32:59.473131 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 02:32:59.473131 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 02:32:59.473131 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 145, in validate_token Sep 29 02:32:59.473131 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application token = self._validate_token(token_id) Sep 29 02:32:59.473131 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 02:32:59.473131 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 02:32:59.473131 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 02:32:59.473131 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 02:32:59.473131 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 02:32:59.473131 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 02:32:59.473131 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 02:32:59.473131 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 02:32:59.473131 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 02:32:59.473131 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 02:32:59.474655 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 02:32:59.474655 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 02:32:59.474655 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 02:32:59.474655 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 02:32:59.474655 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 179, in _validate_token Sep 29 02:32:59.474655 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application token.mint(token_id, issued_at) Sep 29 02:32:59.474655 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 579, in mint Sep 29 02:32:59.474655 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application self._validate_token_resources() Sep 29 02:32:59.474655 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 464, in _validate_token_resources Sep 29 02:32:59.474655 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application if self.project and not self.project.get('enabled'): Sep 29 02:32:59.474655 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 162, in project Sep 29 02:32:59.474655 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application self.__project = PROVIDERS.resource_api.get_project( Sep 29 02:32:59.474655 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 29 02:32:59.474655 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 29 02:32:59.474655 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 29 02:32:59.474655 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 29 02:32:59.474655 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 29 02:32:59.475999 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.get_or_create( Sep 29 02:32:59.475999 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 29 02:32:59.475999 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application with Lock( Sep 29 02:32:59.475999 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 29 02:32:59.475999 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._enter() Sep 29 02:32:59.475999 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 29 02:32:59.475999 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 29 02:32:59.475999 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 29 02:32:59.475999 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.creator() Sep 29 02:32:59.475999 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 29 02:32:59.475999 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application created_value = creator( Sep 29 02:32:59.475999 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 29 02:32:59.475999 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 29 02:32:59.475999 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 29 02:32:59.475999 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 29 02:32:59.475999 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 29 02:32:59.475999 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 29 02:32:59.477283 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: df0405453f304b0091c0d9eda1c17725. Sep 29 02:32:59.477283 dv-cinder-740146-21-smb devstack@keystone.service[81648]: ERROR keystone.server.flask.application Sep 29 02:32:59.477283 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1477/2954] 10.222.0.49 () {60 vars in 1396 bytes} [Thu Sep 29 02:32:59 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 113 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 29 02:32:59.512890 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d91a0c2-ac00-44da-9e0b-f8205d380309 None None] REQUEST_METHOD: `POST` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:32:59.513175 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d91a0c2-ac00-44da-9e0b-f8205d380309 None None] SCRIPT_NAME: `/identity` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:32:59.513470 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d91a0c2-ac00-44da-9e0b-f8205d380309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81649) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:32:59.570351 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.auth.core [None req-0d91a0c2-ac00-44da-9e0b-f8205d380309 None None] MFA Rules not processed for user `f3325a7111d447f4a9cf00c672d5420f`. Rule list: `[]` (Enabled: `True`). {{(pid=81649) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 29 02:32:59.571540 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG keystone.common.fernet_utils [None req-0d91a0c2-ac00-44da-9e0b-f8205d380309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81649) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 29 02:32:59.580757 dv-cinder-740146-21-smb devstack@keystone.service[81649]: [pid: 81649|app: 0|req: 1478/2955] 10.222.0.49 () {58 vars in 1009 bytes} [Thu Sep 29 02:32:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 29 02:32:59.591185 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bd0ca7-d965-490e-9d26-b18dcfb4191f service neutron] Authenticating user token {{(pid=81648) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 29 02:32:59.599872 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bd0ca7-d965-490e-9d26-b18dcfb4191f service neutron] Validating token access rules against request {{(pid=81648) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 29 02:32:59.603403 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143f6e8b-8c4f-45c5-b0a9-00bc673f259f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2053f823bd3c4098a43c299890c1f733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1d8fd250c84c5887cb3173053ea2dd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81648) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 29 02:32:59.603976 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143f6e8b-8c4f-45c5-b0a9-00bc673f259f service neutron] REQUEST_METHOD: `GET` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 29 02:32:59.604249 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143f6e8b-8c4f-45c5-b0a9-00bc673f259f service neutron] SCRIPT_NAME: `/identity` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 29 02:32:59.604515 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143f6e8b-8c4f-45c5-b0a9-00bc673f259f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81648) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 29 02:32:59.614858 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143f6e8b-8c4f-45c5-b0a9-00bc673f259f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 29 02:32:59.616264 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143f6e8b-8c4f-45c5-b0a9-00bc673f259f service neutron] RBAC: Authorization granted {{(pid=81648) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 29 02:32:59.626631 dv-cinder-740146-21-smb devstack@keystone.service[81648]: [pid: 81648|app: 0|req: 1478/2956] 10.222.0.49 () {60 vars in 1365 bytes} [Thu Sep 29 02:32:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 29 02:33:09.568156 dv-cinder-740146-21-smb devstack@keystone.service[81649]: DEBUG dbcounter [-] [81649] Writing DB stats keystone:SELECT=94 {{(pid=81649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:33:09.622142 dv-cinder-740146-21-smb devstack@keystone.service[81648]: DEBUG dbcounter [-] [81648] Writing DB stats keystone:SELECT=10 {{(pid=81648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}